[ 
https://issues.apache.org/jira/browse/NUTCH-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel updated NUTCH-2611:
-----------------------------------
    Fix Version/s: 1.15

> Add line-breaks when parsing HTML block-level elements
> ------------------------------------------------------
>
>                 Key: NUTCH-2611
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2611
>             Project: Nutch
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 1.14
>            Reporter: Yossi Tamari
>            Priority: Major
>             Fix For: 1.15
>
>
> Currently, the HTML and Tika parser only add newlines following text-nodes 
> that contain only whitespaces (e.g </span> <span>), but not based on what the 
> tags are, so for example a </div><div> will not add a new line.
> While some applications do not differentiate between a space and a new line, 
> many others see the semantic difference (two following words in the same 
> sentence are "near", but in separate sentences they are not).
> I believe adding newlines after block-level HTML elements, while not a 
> panacea, will be an improvement on the current behavior.
> NUTCH-2318 is related to this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to