[jira] [Commented] (BEAM-13487) WriteToBigQuery Dynamic table destinations returns wrong tableId

2022-03-04 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501421#comment-17501421 ] Evan Galpin commented on BEAM-13487: [~aremedi] I traced the code and I believe that

[jira] [Commented] (BEAM-13487) WriteToBigQuery Dynamic table destinations returns wrong tableId

2022-03-04 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501522#comment-17501522 ] Evan Galpin commented on BEAM-13487: Ah, my apologies!  I missed that you mentioned t

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-07 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502493#comment-17502493 ] Evan Galpin commented on BEAM-14064: [~lcwik] Thanks for porting this from the mailin

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-09 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503634#comment-17503634 ] Evan Galpin commented on BEAM-14064: Definitely a good point, I'll keep that in mind

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Affects Version/s: 2.37.0 > ElasticSearchIO#Write buffering and outputting across windows > -

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Fix Version/s: 2.38.0 > ElasticSearchIO#Write buffering and outputting across windows > -

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Resolution: Fixed Status: Resolved (was: Open) > ElasticSearchIO#Write buffering and outputt

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504527#comment-17504527 ] Evan Galpin commented on BEAM-14064: [~kenn] I've updated the ticket adding the fix v

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504531#comment-17504531 ] Evan Galpin commented on BEAM-14064: There's still open discussion[1] around the best

[jira] [Reopened] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-15 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reopened BEAM-14064: Reopening based on dev@ thread[1].  The previous fix has the side-effect of non-deterministically outp

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-16 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Status: Open (was: Triage Needed) > ElasticSearchIO#Write buffering and outputting across windows >

[jira] [Work started] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-16 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14064 started by Evan Galpin. -- > ElasticSearchIO#Write buffering and outputting across windows > --

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Priority: P1 (was: P2) > ElasticSearchIO#Write buffering and outputting across windows > ---

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Fix Version/s: (was: 2.38.0) > ElasticSearchIO#Write buffering and outputting across windows > --

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Fix Version/s: 2.38.0 > ElasticSearchIO#Write buffering and outputting across windows > -

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508294#comment-17508294 ] Evan Galpin commented on BEAM-14064: What's the best way to denote whether this issue

[jira] [Commented] (BEAM-14000) Elastic search IO doesnot work when both username/password and keystore are used

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508349#comment-17508349 ] Evan Galpin commented on BEAM-14000: I'm not sure of the answer to whether or not it'

[jira] [Commented] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508357#comment-17508357 ] Evan Galpin commented on BEAM-14024: Thanks [~chamikara] !  There's an open PR to add

[jira] [Assigned] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-03-17 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-14024: -- Assignee: Evan Galpin > Support ES 8.x for ElasticsearchIO > -

[jira] [Created] (BEAM-14003) Add support for Elasticsearch 8.x

2022-02-25 Thread Evan Galpin (Jira)
Evan Galpin created BEAM-14003: -- Summary: Add support for Elasticsearch 8.x Key: BEAM-14003 URL: https://issues.apache.org/jira/browse/BEAM-14003 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-24 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512133#comment-17512133 ] Evan Galpin commented on BEAM-14064: Hi Daniel!  Thank you for managing the release a

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-25 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512484#comment-17512484 ] Evan Galpin commented on BEAM-14064: Thanks Daniel, that sounds great.  I'd be happy

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513384#comment-17513384 ] Evan Galpin commented on BEAM-14064: [~danoliveira] I was mistaken; the current state

[jira] [Updated] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-03-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14064: --- Fix Version/s: 2.39.0 (was: 2.38.0) > ElasticSearchIO#Write buffering and outp

[jira] [Assigned] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-03-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-13136: -- Assignee: Evan Galpin > Clean leftovers of old ElasticSearchIO versions / test mechanism > ---

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-03-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513503#comment-17513503 ] Evan Galpin commented on BEAM-13136: FYI fixes for this issue are included as part of

[jira] [Commented] (BEAM-14000) Elastic search IO doesnot work when both username/password and keystore are used

2022-04-01 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515981#comment-17515981 ] Evan Galpin commented on BEAM-14000: [~nishantjain91] that would be great, please go

[jira] [Comment Edited] (BEAM-14000) Elastic search IO doesnot work when both username/password and keystore are used

2022-04-01 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515981#comment-17515981 ] Evan Galpin edited comment on BEAM-14000 at 4/1/22 3:56 PM: [

[jira] [Commented] (BEAM-14000) Elastic search IO doesnot work when both username/password and keystore are used

2022-04-06 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17518139#comment-17518139 ] Evan Galpin commented on BEAM-14000: Thanks [~nishantjain91] !  I'll have a look at t

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-04-29 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530104#comment-17530104 ] Evan Galpin commented on BEAM-13136: Fixed in https://github.com/apache/beam/pull/16

[jira] [Updated] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-04-29 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-13136: --- Fix Version/s: 2.38.0 > Clean leftovers of old ElasticSearchIO versions / test mechanism > --

[jira] [Updated] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-04-29 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-13136: --- Resolution: Fixed Status: Resolved (was: Open) > Clean leftovers of old ElasticSearchIO vers

[jira] [Commented] (BEAM-14064) ElasticSearchIO#Write buffering and outputting across windows

2022-05-03 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531325#comment-17531325 ] Evan Galpin commented on BEAM-14064: [~yichi] It's my understanding that the PR [htt

[jira] [Created] (BEAM-14531) Adds Testcontainers with SSL config for SSL-specific testing

2022-05-30 Thread Evan Galpin (Jira)
Evan Galpin created BEAM-14531: -- Summary: Adds Testcontainers with SSL config for SSL-specific testing Key: BEAM-14531 URL: https://issues.apache.org/jira/browse/BEAM-14531 Project: Beam Issue

[jira] [Updated] (BEAM-14003) Add support for Elasticsearch 8.x

2022-04-18 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14003: --- Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: Open) > Add support

[jira] [Updated] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-04-18 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14024: --- Resolution: Fixed Status: Resolved (was: Open) Resolved as of [https://github.com/apache/bea

[jira] [Updated] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-04-18 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-14024: --- Resolution: Duplicate (was: Fixed) Status: Resolved (was: Resolved) > Support ES 8.x for El

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-10-25 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17433780#comment-17433780 ] Evan Galpin commented on BEAM-5172: --- I checked quite a few PRs last week.  I did see a s

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-10-26 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434464#comment-17434464 ] Evan Galpin commented on BEAM-5172: --- I think it's safe to say that some read tests are s

[jira] [Created] (BEAM-13148) Add ability to Write to GCP PubSub with an orderingKey

2021-10-29 Thread Evan Galpin (Jira)
Evan Galpin created BEAM-13148: -- Summary: Add ability to Write to GCP PubSub with an orderingKey Key: BEAM-13148 URL: https://issues.apache.org/jira/browse/BEAM-13148 Project: Beam Issue Type: I

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-11-02 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437364#comment-17437364 ] Evan Galpin commented on BEAM-5172: --- I apologize for the timing but I'm swamped right no

[jira] [Updated] (BEAM-12093) Overhaul ElasticsearchIO#Write

2021-04-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12093: --- Labels: elasticsearch (was: ) > Overhaul ElasticsearchIO#Write > -- > >

[jira] [Assigned] (BEAM-12093) Overhaul ElasticsearchIO#Write

2021-04-23 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-12093: -- Assignee: Evan Galpin > Overhaul ElasticsearchIO#Write > -- > >

[jira] [Commented] (BEAM-10990) Elasticsearch IO Infinite loop with write Error when the pipeline job streaming mode

2021-05-03 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17338466#comment-17338466 ] Evan Galpin commented on BEAM-10990: This may be partially "fixed" (depending on use-

[jira] [Updated] (BEAM-12093) Overhaul ElasticsearchIO#Write

2021-05-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12093: --- Fix Version/s: 2.31.0 > Overhaul ElasticsearchIO#Write > -- > >

[jira] [Updated] (BEAM-12093) Overhaul ElasticsearchIO#Write

2021-05-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12093: --- Resolution: Done Status: Resolved (was: Open) > Overhaul ElasticsearchIO#Write > ---

[jira] [Created] (BEAM-12414) Support PerKey Combiner.ToDict in python SDK

2021-05-27 Thread Evan Galpin (Jira)
Evan Galpin created BEAM-12414: -- Summary: Support PerKey Combiner.ToDict in python SDK Key: BEAM-12414 URL: https://issues.apache.org/jira/browse/BEAM-12414 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-05-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17353387#comment-17353387 ] Evan Galpin commented on BEAM-12421: thanks [~lboutros] ! > Migrate elasticsearchio

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-05-28 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17353391#comment-17353391 ] Evan Galpin commented on BEAM-5172: --- [~echauchot] the recent failures are unfortunately

[jira] [Updated] (BEAM-12414) Support PerKey Combiner.ToDict in python SDK

2021-05-31 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12414: --- Description: -apache_beam.transforms.combiners.ToDict only support CombineGlobally semantics current

[jira] [Work started] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-06-03 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12421 started by Evan Galpin. -- > Migrate elasticsearchio tests to test containers > ---

[jira] [Updated] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-06-03 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12421: --- Status: Open (was: Triage Needed) > Migrate elasticsearchio tests to test containers > -

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-04 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17357528#comment-17357528 ] Evan Galpin commented on BEAM-5172: --- Hopefully flakiness is reduced in part by https://

[jira] [Assigned] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-04 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-5172: - Assignee: Evan Galpin > org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky > -

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-07 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358590#comment-17358590 ] Evan Galpin commented on BEAM-5172: --- If this is indeed tied to server load, what recours

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-08 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359476#comment-17359476 ] Evan Galpin commented on BEAM-5172: --- [~echauchot] were the errors you posted from a buil

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-06-10 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361316#comment-17361316 ] Evan Galpin commented on BEAM-5172: --- @Andrew I have a PR open[1] which attempts to allev

[jira] [Commented] (BEAM-12632) ElasticsearchIO: Enabling both User/Pass auth and SSL overwrites User/Pass

2021-07-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388258#comment-17388258 ] Evan Galpin commented on BEAM-12632: [~dboshardy] Do you happen to know if this is a

[jira] [Updated] (BEAM-12632) ElasticsearchIO: Enabling both User/Pass auth and SSL overwrites User/Pass

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12632: --- Component/s: (was: sdk-java-core) io-java-elasticsearch > ElasticsearchIO: Enabl

[jira] [Commented] (BEAM-12722) Add ElasticsearchIO External Versioning

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394089#comment-17394089 ] Evan Galpin commented on BEAM-12722: [~bdaghir] this should be available as of SDK 2.

[jira] [Assigned] (BEAM-12722) Add ElasticsearchIO External Versioning

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-12722: -- Assignee: Evan Galpin > Add ElasticsearchIO External Versioning >

[jira] [Commented] (BEAM-12577) In stream mode, ElasticsearchIO transform becomes unavailable

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394091#comment-17394091 ] Evan Galpin commented on BEAM-12577: [~jgallon] Could you elaborate on your use case?

[jira] [Assigned] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-12421: -- Assignee: Evan Galpin > Migrate elasticsearchio tests to test containers > ---

[jira] [Updated] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12421: --- Fix Version/s: 2.31.0 > Migrate elasticsearchio tests to test containers > --

[jira] [Updated] (BEAM-12421) Migrate elasticsearchio tests to test containers

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12421: --- Resolution: Done Status: Resolved (was: Open) > Migrate elasticsearchio tests to test contai

[jira] [Updated] (BEAM-12722) Add ElasticsearchIO External Versioning

2021-08-05 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12722: --- Status: Open (was: Triage Needed) > Add ElasticsearchIO External Versioning > --

[jira] [Assigned] (BEAM-10990) Elasticsearch IO Infinite loop with write Error when the pipeline job streaming mode

2021-08-12 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-10990: -- Assignee: Evan Galpin > Elasticsearch IO Infinite loop with write Error when the pipeline job

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-09-07 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411466#comment-17411466 ] Evan Galpin commented on BEAM-5172: --- Thanks [~echauchot] , I'm going to have a look ASAP

[jira] [Created] (BEAM-12093) Overhaul ElasticsearchIO#Write

2021-04-05 Thread Evan Galpin (Jira)
Evan Galpin created BEAM-12093: -- Summary: Overhaul ElasticsearchIO#Write Key: BEAM-12093 URL: https://issues.apache.org/jira/browse/BEAM-12093 Project: Beam Issue Type: Improvement Com

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431435#comment-17431435 ] Evan Galpin commented on BEAM-5172: --- Will do [~echauchot] ! 👍 > org.apache.beam.sdk.io.

[jira] [Updated] (BEAM-12722) Add ElasticsearchIO External Versioning

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-12722: --- Fix Version/s: 2.31.0 Resolution: Fixed Status: Resolved (was: Open) > Add Elastic

[jira] [Assigned] (BEAM-12722) Add ElasticsearchIO External Versioning

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-12722: -- Assignee: Evan Galpin > Add ElasticsearchIO External Versioning >

[jira] [Commented] (BEAM-11309) Error handling in ElasticIO write method

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431436#comment-17431436 ] Evan Galpin commented on BEAM-11309: [~lionelsetan] I believe this may be addressed a

[jira] [Commented] (BEAM-11276) Write with custom indexName and docId not present in document itself

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431439#comment-17431439 ] Evan Galpin commented on BEAM-11276: [~lionelsetan] I think the advised approach woul

[jira] [Commented] (BEAM-10485) Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn

2021-10-20 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431440#comment-17431440 ] Evan Galpin commented on BEAM-10485: Closely related to/duplicate of BEAM-5172 I beli

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

2022-01-24 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481197#comment-17481197 ] Evan Galpin commented on BEAM-13137: Update: so far I have not seen flaky failures i

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

2022-01-25 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481905#comment-17481905 ] Evan Galpin commented on BEAM-13137: [~echauchot] Do you feel we could also close ht

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

2022-01-26 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482526#comment-17482526 ] Evan Galpin commented on BEAM-13137: [~echauchot] I reintroduced even the tests previ

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2022-01-26 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482528#comment-17482528 ] Evan Galpin commented on BEAM-5172: --- Update: since merging https://github.com/apache/bea

[jira] [Assigned] (BEAM-10485) Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn

2022-01-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin reassigned BEAM-10485: -- Assignee: Evan Galpin > Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn >

[jira] [Updated] (BEAM-10485) Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn

2022-01-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Galpin updated BEAM-10485: --- Fix Version/s: 2.37.0 Resolution: Resolved Status: Resolved (was: Open) > Failure

[jira] [Commented] (BEAM-10485) Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn

2022-01-27 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483412#comment-17483412 ] Evan Galpin commented on BEAM-10485: Closing this ticket as well, given the resolutio

[jira] [Commented] (BEAM-13136) Clean leftovers of old ElasticSearchIO versions / test mechanism

2022-01-13 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475457#comment-17475457 ] Evan Galpin commented on BEAM-13136: [~echauchot] yes this is definitely something I

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

2022-01-13 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475469#comment-17475469 ] Evan Galpin commented on BEAM-13137: [~echauchot] I'm wondering if the flakiness coul

[jira] [Commented] (BEAM-5172) org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky

2022-01-13 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475513#comment-17475513 ] Evan Galpin commented on BEAM-5172: --- Latest related PR:  [https://github.com/apache/beam

[jira] [Commented] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

2022-01-14 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476220#comment-17476220 ] Evan Galpin commented on BEAM-13137: Thanks [~echauchot] I've added the index.store.{

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

2022-01-19 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478789#comment-17478789 ] Evan Galpin commented on BEAM-10945: [~DraCzech] Am I understanding correctly that th

[jira] [Commented] (BEAM-10838) Add a withSSLContext builder method to ElasticsearchIO

2022-01-19 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478796#comment-17478796 ] Evan Galpin commented on BEAM-10838: I'm +1 as well. Looks like we could probably ov

[jira] [Commented] (BEAM-10945) ElasticsearchIO performs 0 division on DirectRunner

2022-01-21 Thread Evan Galpin (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480088#comment-17480088 ] Evan Galpin commented on BEAM-10945: [~echauchot] I think I used confusing terminolog