[
https://issues.apache.org/jira/browse/HIVE-20639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640953#comment-16640953
]
Hive QA commented on HIVE-20639:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12942648/HIVE-20639.4.patch
{color:green}SUCCESS:{color} +1 due to 10 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 10 failed/errored test(s), 14952 tests
executed
*Failed tests:*
{noformat}
TestArrowColumnarBatchSerDe - did not produce a TEST-*.xml file (likely timed
out) (batchId=288)
TestDataWritableReadSupport - did not produce a TEST-*.xml file (likely timed
out) (batchId=288)
TestDataWritableWriter - did not produce a TEST-*.xml file (likely timed out)
(batchId=288)
TestHiveSchemaConverter - did not produce a TEST-*.xml file (likely timed out)
(batchId=288)
TestParquetFilterPredicate - did not produce a TEST-*.xml file (likely timed
out) (batchId=288)
TestParquetSerDe - did not produce a TEST-*.xml file (likely timed out)
(batchId=288)
TestVectorizedDictionaryEncodingColumnReader - did not produce a TEST-*.xml
file (likely timed out) (batchId=288)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stat_estimate_related_col]
(batchId=43)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[timestamptz_2]
(batchId=85)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[external_jdbc_table2]
(batchId=172)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/14285/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/14285/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-14285/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 10 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12942648 - PreCommit-HIVE-Build
> Add ability to Write Data from Hive Table/Query to Kafka Topic
> --------------------------------------------------------------
>
> Key: HIVE-20639
> URL: https://issues.apache.org/jira/browse/HIVE-20639
> Project: Hive
> Issue Type: New Feature
> Components: kafka integration
> Reporter: slim bouguerra
> Assignee: slim bouguerra
> Priority: Major
> Attachments: HIVE-20639.2.patch, HIVE-20639.3.patch,
> HIVE-20639.4.patch, HIVE-20639.patch
>
>
> This patch adds multiple record writers to allow Hive user writing data
> directly to a Kafka Topic.
> The end goal is have a writer that provides multiple write semantics modes.
> * A BEST_EFFORT where all the records will be delivered with no guarantee or
> reties eg best effort mode. (Done)
> * B At_least_once, each record will be delivered with retries from the Kafka
> Producer and Hive Write Task. (Done)
> * C Exactly_once , Writer will be using Kafka Transaction API to ensure that
> each record is delivered once. (not so, still need more discussions)
> In addition to the new feature i have refactored the existing code to make it
> more readable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
