[
https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111496#comment-17111496
]
Raymond Xu commented on HUDI-648:
---------------------------------
I'm thinking of making `.hoodie/errors/`a dir to save all error'ed records.
Haven't thought about the actual formats...maybe it'll be good enough if we
start with plain text containing stacktrace info. Do you think we should do an
RFC for this? I'd be happy to write one. cc [~liujinhui] [~vinoth]
> Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction
> writes
> ------------------------------------------------------------------------------------
>
> Key: HUDI-648
> URL: https://issues.apache.org/jira/browse/HUDI-648
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: DeltaStreamer, Spark Integration, Writer Core
> Reporter: Vinoth Chandar
> Priority: Major
>
> We would like a way to hand the erroring records from writing or compaction
> back to the users, in a separate table or log. This needs to work generically
> across all the different writer paths.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
