[
https://issues.apache.org/jira/browse/HIVE-24151?focusedWorklogId=483199&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-483199
]
ASF GitHub Bot logged work on HIVE-24151:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Sep/20 21:31
Start Date: 12/Sep/20 21:31
Worklog Time Spent: 10m
Work Description: szlta edited a comment on pull request #1490:
URL: https://github.com/apache/hive/pull/1490#issuecomment-691122063
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 483199)
Time Spent: 1.5h (was: 1h 20m)
> MultiDelimitSerDe shifts data if strings contain non-ASCII characters
> ---------------------------------------------------------------------
>
> Key: HIVE-24151
> URL: https://issues.apache.org/jira/browse/HIVE-24151
> Project: Hive
> Issue Type: Bug
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> HIVE-22360 intended to fix another MultiDelimitSerde problem (with NULL last
> columns) but introduced a regression: the approach of the fix is pretty much
> all wrong, as the existing logic that operated on bytes got replaced by regex
> matcher logic which deals in character positions, rather than byte positions.
> As some non ASCII characters consist of more than 1 byte, the whole record
> may get shifted due to this.
> With this ticket I'm going to restore the old logic, and apply the proper fix
> on that, but keeping (and extending) the test cases added with HIVE-22360 so
> that we have a solution for both issues.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
