WebHarvest - web data extraction tool / Bugs / #13 Little Bug with MIME types in HttpProcessor

#13 Little Bug with MIME types in HttpProcessor

Milestone: Backlog

Status: closed

Owner: Robert Bala

Labels: None

Priority: 5

Updated: 2025-10-09

Created: 2008-10-29

Creator: Anonymous

Private: No

In org.webharvest.runtime.processors.HttpProcessor.execute(Scraper scraper, ScraperContext context) the response is tried to convert to a string, if MIME-Type starts with "text" or "application/xml" or if it is null. For me I added also "application/rss". If the charset is not used, the encoding gets broken, because it is not considered (body.toString in BaseProcessor).

Discussion

Nobody/Anonymous - 2008-10-29

bugfixed HttpProcessor

HttpProcessor.java

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Anonymous
  
  Add attachments
  Cancel
  You seem to have CSS turned off. Please don't fill out this field.
  
  You seem to have CSS turned off. Please don't fill out this field.

Robert Bala - 2025-10-09

status: open --> closed

assigned_to: Robert Bala
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Anonymous
  
  Add attachments
  Cancel
  You seem to have CSS turned off. Please don't fill out this field.
  
  You seem to have CSS turned off. Please don't fill out this field.

Anonymous

Little Bug with MIME types in HttpProcessor

Group

Searches

Help

#13 Little Bug with MIME types in HttpProcessor

Discussion