[
https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962861#comment-16962861
]
vinoyang commented on HUDI-289:
-------------------------------
[~vinoth] Report my progress: I am refactoring the dag package. I am trying to
make all nodes follow the same contract method: {{execute}}. Currently, the
{{execute}} method follows the conventions in implementation, but have
different signatures.
To do this, I will encapsulate a context object (named possibly:
{{ExecutionContext}} or {{DagContext}}) to provide an execution environment for
all nodes. This will make the {{DagScheduler}} logic clearer (no need to
identify the specific node type).
> Implement a long running test for Hudi writing and querying end-end
> -------------------------------------------------------------------
>
> Key: HUDI-289
> URL: https://issues.apache.org/jira/browse/HUDI-289
> Project: Apache Hudi (incubating)
> Issue Type: Test
> Components: Usability
> Reporter: Vinoth Chandar
> Assignee: vinoyang
> Priority: Major
> Fix For: 0.5.1
>
>
> We would need an equivalent of an end-end test which runs some workload for
> few hours atleast, triggers various actions like commit, deltacopmmit,
> rollback, compaction and ensures correctness of code before every release
> P.S: Learn from all the CSS issues managing compaction..
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
