[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503640#comment-17503640 ] Etienne Chauchot commented on BEAM-14064: - [~egalpin] don't worry you did a great

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503622#comment-17503622 ] Etienne Chauchot commented on BEAM-14064: - [~lcwik] thanks for opening this issue

[jira] [Updated] (BEAM-13956) Serialize/deserialize StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13956: Summary: Serialize/deserialize StsClient when serializing/deserializing StsAssumeRoleCreden

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17485634#comment-17485634 ] Etienne Chauchot commented on BEAM-10838: - [~clandry94] SSL tests were defered to

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482538#comment-17482538 ] Etienne Chauchot commented on BEAM-13137: - ticket [BEAM-5172|https://issues.apach

[jira] [Updated] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-5172: --- Fix Version/s: 2.37.0 Resolution: Fixed Status: Resolved (was: Open) [~egal

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482316#comment-17482316 ] Etienne Chauchot commented on BEAM-13137: - [~egalpin] if you took a look at all E

[jira] [Commented] (BEAM-13738) Renable ignored test in SqsUnboundedReaderTest

[ https://issues.apache.org/jira/browse/BEAM-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481744#comment-17481744 ] Etienne Chauchot commented on BEAM-13738: - Thanks, I assigned to you to keep trac

[jira] [Commented] (BEAM-13738) Renable ignored test in SqsUnboundedReaderTest

[ https://issues.apache.org/jira/browse/BEAM-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481743#comment-17481743 ] Etienne Chauchot commented on BEAM-13738: - good catch Moritz ! > Renable ignored

[jira] [Assigned] (BEAM-13738) Renable ignored test in SqsUnboundedReaderTest

[ https://issues.apache.org/jira/browse/BEAM-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-13738: --- Assignee: Moritz Mack > Renable ignored test in SqsUnboundedReaderTest > ---

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481673#comment-17481673 ] Etienne Chauchot commented on BEAM-13136: - [~egalpin] just added another leftover

[jira] [Updated] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13137: Fix Version/s: 2.37.0 Resolution: Fixed Status: Resolved (was: Open) > m

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481647#comment-17481647 ] Etienne Chauchot commented on BEAM-13137: - [~egalpin] thx for the update. knowing

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480935#comment-17480935 ] Etienne Chauchot commented on BEAM-10945: - Well, an important parameter that we d

[jira] [Updated] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13136: Description: While auditing about flakiness issues, I saw lefovers on the test code and pr

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479263#comment-17479263 ] Etienne Chauchot commented on BEAM-10838: - [~kenn] can you give [~clandry94] the

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479261#comment-17479261 ] Etienne Chauchot commented on BEAM-10838: - [~clandry94] or lazy init (init just b

[jira] [Comment Edited] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478389#comment-17478389 ] Etienne Chauchot edited comment on BEAM-10838 at 1/20/22, 10:52 AM: ---

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479258#comment-17479258 ] Etienne Chauchot commented on BEAM-10945: - 1024 is the ES slice API limitation.

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479257#comment-17479257 ] Etienne Chauchot commented on BEAM-10945: - [~egalpin] allowing the user to specif

[jira] [Updated] (BEAM-13503) BulkIO public constructor: Missing required property: throwWriteErrors

[ https://issues.apache.org/jira/browse/BEAM-13503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13503: Fix Version/s: 2.37.0 Resolution: Fixed Status: Resolved (was: Open) > B

[jira] [Commented] (BEAM-10723) SSL authentication key set to trustMaterial instead of keyMaterial

[ https://issues.apache.org/jira/browse/BEAM-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478427#comment-17478427 ] Etienne Chauchot commented on BEAM-10723: - [~kenn] I took a look at the PR, it st

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478416#comment-17478416 ] Etienne Chauchot commented on BEAM-10945: - [~kenn] [~DraCzech] indeed this setup

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478403#comment-17478403 ] Etienne Chauchot commented on BEAM-10838: - [~kenn] can you give Conor the contrib

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478389#comment-17478389 ] Etienne Chauchot commented on BEAM-10838: - [~kenn] [~clandry94] +1 on this. [~cla

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477044#comment-17477044 ] Etienne Chauchot commented on BEAM-13137: - Merged through [8c2e1fd|https://githu

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476243#comment-17476243 ] Etienne Chauchot commented on BEAM-13137: - yes I saw in the PR. better indeed to

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476104#comment-17476104 ] Etienne Chauchot commented on BEAM-13136: - [~egalpin] Not urgent this one (compar

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476093#comment-17476093 ] Etienne Chauchot commented on BEAM-13137: - [~egalpin] Thanks for taking a look !

[jira] [Updated] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13136: Description: While auditing about flakiness issues, I saw lefovers on the test code and pr

[jira] [Commented] (BEAM-3926) Support MetricsPusher in Dataflow Runner

[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474507#comment-17474507 ] Etienne Chauchot commented on BEAM-3926: [~kenn] still no metricsPusher support in

[jira] [Commented] (BEAM-4088) ExecutorServiceParallelExecutorTest#ensureMetricsThreadDoesntLeak in PR #4965 does not pass in gradle

[ https://issues.apache.org/jira/browse/BEAM-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474504#comment-17474504 ] Etienne Chauchot commented on BEAM-4088: [~kenn] still disabled not fixed > Execu

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474503#comment-17474503 ] Etienne Chauchot commented on BEAM-5172: [~kenn] ongoing related tests > org.apac

[jira] [Commented] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474501#comment-17474501 ] Etienne Chauchot commented on BEAM-3310: [~kenn] lacks the support for the other r

[jira] [Commented] (BEAM-3816) [nexmark] Something is slightly off with Query 6

[ https://issues.apache.org/jira/browse/BEAM-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474499#comment-17474499 ] Etienne Chauchot commented on BEAM-3816: AFAICT the PR just put the put the test t

[jira] [Comment Edited] (BEAM-3816) [nexmark] Something is slightly off with Query 6

[ https://issues.apache.org/jira/browse/BEAM-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474499#comment-17474499 ] Etienne Chauchot edited comment on BEAM-3816 at 1/12/22, 12:55 PM: -

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474494#comment-17474494 ] Etienne Chauchot commented on BEAM-13136: - [~egalpin] would you be able to work o

[jira] [Assigned] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-13137: --- Assignee: Evan Galpin > make ElasticsearchIO$BoundedElasticsearchSource#getEstimated

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474493#comment-17474493 ] Etienne Chauchot commented on BEAM-13137: - [~egalpin] would you be able to work o

[jira] [Comment Edited] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453863#comment-17453863 ] Etienne Chauchot edited comment on BEAM-10430 at 12/6/21, 9:03 AM:

[jira] [Commented] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453863#comment-17453863 ] Etienne Chauchot commented on BEAM-10430: - Also the important is to be in total s

[jira] [Comment Edited] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453863#comment-17453863 ] Etienne Chauchot edited comment on BEAM-10430 at 12/6/21, 9:03 AM:

[jira] [Updated] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-10430: Assignee: Etienne Chauchot Resolution: Not A Problem Status: Resolved (was: O

[jira] [Commented] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453005#comment-17453005 ] Etienne Chauchot commented on BEAM-10430: - you might want to add also:  com.fas

[jira] [Comment Edited] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453005#comment-17453005 ] Etienne Chauchot edited comment on BEAM-10430 at 12/3/21, 1:27 PM:

[jira] [Commented] (BEAM-10430) Can't run WordCount on EMR With Flink Runner via YARN

[ https://issues.apache.org/jira/browse/BEAM-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17452971#comment-17452971 ] Etienne Chauchot commented on BEAM-10430: - you need to add to your project:  {cod

[jira] [Commented] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

[ https://issues.apache.org/jira/browse/BEAM-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17443867#comment-17443867 ] Etienne Chauchot commented on BEAM-8470: Hi [~yunta] we can run nexmark but only i

[jira] [Commented] (BEAM-13203) Potential data loss when using SnsIO.writeAsync

[ https://issues.apache.org/jira/browse/BEAM-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441190#comment-17441190 ] Etienne Chauchot commented on BEAM-13203: - yes, proper async mechanism with retri

[jira] [Commented] (BEAM-13209) DynamoDBIO silently drops unprocessed items

[ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441188#comment-17441188 ] Etienne Chauchot commented on BEAM-13209: - We should implement retrials as it was

[jira] [Commented] (BEAM-13209) DynamoDBIO silently drops unprocessed items

[ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441185#comment-17441185 ] Etienne Chauchot commented on BEAM-13209: - regarding data loss comment, I'd raise

[jira] [Updated] (BEAM-13209) DynamoDBIO silently drops unprocessed items

[ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13209: Priority: P0 (was: P2) > DynamoDBIO silently drops unprocessed items > ---

[jira] [Commented] (BEAM-13209) DynamoDBIO silently drops unprocessed items

[ https://issues.apache.org/jira/browse/BEAM-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441186#comment-17441186 ] Etienne Chauchot commented on BEAM-13209: - Thanks for identifying this [~mosche] 

[jira] [Commented] (BEAM-13203) Potential data loss when using SnsIO.writeAsync

[ https://issues.apache.org/jira/browse/BEAM-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441184#comment-17441184 ] Etienne Chauchot commented on BEAM-13203: - Thanks for identifying this [~mosche]

[jira] [Commented] (BEAM-13203) Potential data loss when using SnsIO.writeAsync

[ https://issues.apache.org/jira/browse/BEAM-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441183#comment-17441183 ] Etienne Chauchot commented on BEAM-13203: - regarding data loss comment, I'd raise

[jira] [Updated] (BEAM-13203) Potential data loss when using SnsIO.writeAsync

[ https://issues.apache.org/jira/browse/BEAM-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13203: Priority: P0 (was: P1) > Potential data loss when using SnsIO.writeAsync > ---

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441170#comment-17441170 ] Etienne Chauchot commented on BEAM-5172: [~ibzib] ok fair enough > org.apache.bea

[jira] [Commented] (BEAM-12730) Add custom delimiters to Python TextIO reads

[ https://issues.apache.org/jira/browse/BEAM-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438866#comment-17438866 ] Etienne Chauchot commented on BEAM-12730: - done: assigned to 2.35 and removed lab

[jira] [Updated] (BEAM-12730) Add custom delimiters to Python TextIO reads

[ https://issues.apache.org/jira/browse/BEAM-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12730: Labels: (was: beginner newbie starter) > Add custom delimiters to Python TextIO reads > -

[jira] [Updated] (BEAM-12730) Add custom delimiters to Python TextIO reads

[ https://issues.apache.org/jira/browse/BEAM-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12730: Fix Version/s: (was: 2.34.0) 2.35.0 > Add custom delimiters to Pytho

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17438613#comment-17438613 ] Etienne Chauchot commented on BEAM-5172: No worries for the lack of bandwidth. And

[jira] [Comment Edited] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435498#comment-17435498 ] Etienne Chauchot edited comment on BEAM-5172 at 11/4/21, 10:12 AM: -

[jira] [Commented] (BEAM-12730) Add custom delimiters to Python TextIO reads

[ https://issues.apache.org/jira/browse/BEAM-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435918#comment-17435918 ] Etienne Chauchot commented on BEAM-12730: - Hi [~EugeneNikolaiev]. It's been years

[jira] [Comment Edited] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435498#comment-17435498 ] Etienne Chauchot edited comment on BEAM-5172 at 10/29/21, 9:12 AM: -

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435498#comment-17435498 ] Etienne Chauchot commented on BEAM-5172: Took a look at the 3 flakiness: 1. [htt

[jira] [Updated] (BEAM-13136) Clean leftovers of old ESIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13136: Description: While auditing about flakiness issues, I saw lefovers on the test code and pr

[jira] [Created] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

Etienne Chauchot created BEAM-13137: --- Summary: make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic Key: BEAM-13137 URL: https://issues.apache.org/jira/browse/BEAM-13137

[jira] [Updated] (BEAM-13136) Clean leftovers of old ESIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13136: Description: While auditing about flakiness issues, I saw lefovers on the test code and pr

[jira] [Updated] (BEAM-13136) Clean leftovers of old ESIO versions / test mechanism

[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-13136: Description: While auditing about flakiness issues, I saw lefovers on the test code and pr

[jira] [Created] (BEAM-13136) Clean leftovers of old ESIO versions / test mechanism

Etienne Chauchot created BEAM-13136: --- Summary: Clean leftovers of old ESIO versions / test mechanism Key: BEAM-13136 URL: https://issues.apache.org/jira/browse/BEAM-13136 Project: Beam Issu

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431031#comment-17431031 ] Etienne Chauchot commented on BEAM-5172: [This|https://github.com/apache/beam/comm

[jira] [Updated] (BEAM-10990) Elasticsearch IO Infinite loop with write Error when the pipeline job streaming mode

[ https://issues.apache.org/jira/browse/BEAM-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-10990: Fix Version/s: 2.35.0 Resolution: Fixed Status: Resolved (was: Triage Nee

[jira] [Commented] (BEAM-4383) Enable block size support in ParquetIO

[ https://issues.apache.org/jira/browse/BEAM-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429971#comment-17429971 ] Etienne Chauchot commented on BEAM-4383: [~ŁukaszG] is it not already implemented

[jira] [Updated] (BEAM-12849) Structured Streaming runner: Migrate metrics sources

[ https://issues.apache.org/jira/browse/BEAM-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12849: Assignee: Etienne Chauchot Resolution: Not A Problem Status: Resolved (was: T

[jira] [Updated] (BEAM-12909) Add spark3 to nexmark runs

[ https://issues.apache.org/jira/browse/BEAM-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12909: Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Tr

[jira] [Updated] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-7093: --- Resolution: Fixed Status: Resolved (was: Open) > Support Spark 3 in Spark runner > --

[jira] [Assigned] (BEAM-12909) Add spark3 to nexmark runs

[ https://issues.apache.org/jira/browse/BEAM-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-12909: --- Assignee: Etienne Chauchot > Add spark3 to nexmark runs > --

[jira] [Created] (BEAM-12909) Add spark3 to nexmark runs

Etienne Chauchot created BEAM-12909: --- Summary: Add spark3 to nexmark runs Key: BEAM-12909 URL: https://issues.apache.org/jira/browse/BEAM-12909 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-12849) Structured Streaming runner: Migrate metrics sources

[ https://issues.apache.org/jira/browse/BEAM-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416141#comment-17416141 ] Etienne Chauchot commented on BEAM-12849: - it seems to be a gradle conf issue: gr

[jira] [Updated] (BEAM-12153) OOM on GBK in SparkRunner and SpartStructuredStreamingRunner

[ https://issues.apache.org/jira/browse/BEAM-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12153: Fix Version/s: Not applicable Resolution: Not A Problem Status: Resolved

[jira] [Commented] (BEAM-12153) OOM on GBK in SparkRunner and SpartStructuredStreamingRunner

[ https://issues.apache.org/jira/browse/BEAM-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415412#comment-17415412 ] Etienne Chauchot commented on BEAM-12153: - Also, the materialization happens insi

[jira] [Commented] (BEAM-12153) OOM on GBK in SparkRunner and SpartStructuredStreamingRunner

[ https://issues.apache.org/jira/browse/BEAM-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414962#comment-17414962 ] Etienne Chauchot commented on BEAM-12153: - Did the test of GroupByKeyLoadTests wi

[jira] [Commented] (BEAM-12153) OOM on GBK in SparkRunner and SpartStructuredStreamingRunner

[ https://issues.apache.org/jira/browse/BEAM-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414936#comment-17414936 ] Etienne Chauchot commented on BEAM-12153: - Did the test of GroupByKeyLoadTests  w

[jira] [Commented] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413939#comment-17413939 ] Etienne Chauchot commented on BEAM-7093: yes of course, I forgot to move it to 2.3

[jira] [Updated] (BEAM-12727) deduplication: Concatenate CombineFn

[ https://issues.apache.org/jira/browse/BEAM-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12727: Fix Version/s: 2.34.0 Resolution: Fixed Status: Resolved (was: In Progres

[jira] [Commented] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411797#comment-17411797 ] Etienne Chauchot commented on BEAM-7093: [~ibzib] no it is not a regression, just

[jira] [Updated] (BEAM-12849) Structured Streaming runner: Migrate metrics sources

[ https://issues.apache.org/jira/browse/BEAM-12849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12849: Summary: Structured Streaming runner: Migrate metrics sources (was: Migrate metrics source

[jira] [Comment Edited] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411190#comment-17411190 ] Etienne Chauchot edited comment on BEAM-7093 at 9/7/21, 12:30 PM: --

[jira] [Created] (BEAM-12849) Migrate metrics sources

Etienne Chauchot created BEAM-12849: --- Summary: Migrate metrics sources Key: BEAM-12849 URL: https://issues.apache.org/jira/browse/BEAM-12849 Project: Beam Issue Type: Sub-task Com

[jira] [Reopened] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reopened BEAM-7093: reopening because beam metrics are not properly supported > Support Spark 3 in Spark runner > -

[jira] [Comment Edited] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409459#comment-17409459 ] Etienne Chauchot edited comment on BEAM-5172 at 9/3/21, 11:38 AM: --

[jira] [Updated] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-5172: --- Priority: P0 (was: P1) > org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky >

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409459#comment-17409459 ] Etienne Chauchot commented on BEAM-5172: actually they are flaky in all ES version

[jira] [Assigned] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-5172: -- Assignee: Evan Galpin > org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is fla

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409348#comment-17409348 ] Etienne Chauchot commented on BEAM-5172: testSizes and testSplit seem to be flaky

[jira] [Work started] (BEAM-12727) deduplication: Concatenate CombineFn

[ https://issues.apache.org/jira/browse/BEAM-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12727 started by Etienne Chauchot. --- > deduplication: Concatenate CombineFn > -

[jira] [Updated] (BEAM-12601) Support append-only indices in ES output

[ https://issues.apache.org/jira/browse/BEAM-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12601: Fix Version/s: 2.33.0 Resolution: Done Status: Resolved (was: Triage Need

[jira] [Created] (BEAM-12727) deduplication: Concatenate CombineFn

Etienne Chauchot created BEAM-12727: --- Summary: deduplication: Concatenate CombineFn Key: BEAM-12727 URL: https://issues.apache.org/jira/browse/BEAM-12727 Project: Beam Issue Type: Improveme

[jira] [Updated] (BEAM-12630) Spark Structured Streaming runner: deal with change in dataStreamWriter wait for termination

[ https://issues.apache.org/jira/browse/BEAM-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12630: Resolution: Done Status: Resolved (was: In Progress) > Spark Structured Streaming

[jira] [Updated] (BEAM-7093) Support Spark 3 in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-7093: --- Resolution: Done Status: Resolved (was: Triage Needed) > Support Spark 3 in Spark run

[jira] [Updated] (BEAM-12629) Spark Structured Streaming runner: migrate Beam sources wrappers

[ https://issues.apache.org/jira/browse/BEAM-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-12629: Resolution: Done Status: Resolved (was: In Progress) > Spark Structured Streaming

  1   2   3   4   5   6   >