[jira] [Created] (BEAM-13840) :sdks:java:io:amazon-web-services(2) use legacy rawtypes

2022-02-07 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-13840: -- Summary: :sdks:java:io:amazon-web-services(2) use legacy rawtypes Key: BEAM-13840 URL: https://issues.apache.org/jira/browse/BEAM-13840 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-13840) :sdks:java:io:amazon-web-services(2) use legacy rawtypes

2022-02-07 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13840: -- Assignee: Moritz Mack > :sdks:java:io:amazon-web-services(2) use legacy rawtypes > ---

[jira] [Updated] (BEAM-13840) :sdks:java:io:amazon-web-services(2) use legacy rawtypes

2022-02-07 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13840: --- Status: Open (was: Triage Needed) > :sdks:java:io:amazon-web-services(2) use legacy rawtypes > -

[jira] [Commented] (BEAM-13854) Document casting trick for Avro value serializer in KafkaIO

2022-02-08 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489068#comment-17489068 ] Moritz Mack commented on BEAM-13854: [~mcasters] I agree, that workaround should have

[jira] [Updated] (BEAM-13563) Generalize AWS client provider to be independent of client type

2022-02-10 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13563: --- Fix Version/s: (was: 2.37.0) > Generalize AWS client provider to be independent of client type >

[jira] [Commented] (BEAM-13563) Generalize AWS client provider to be independent of client type

2022-02-10 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490396#comment-17490396 ] Moritz Mack commented on BEAM-13563: Absolutely [~bhulette] , fix version was just se

[jira] [Updated] (BEAM-13235) Investigate feature parity of AWS IO connectors on SDK v1 vs. v2

2022-02-13 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13235: --- Labels: aws ios java (was: aws ios java stale-assigned) > Investigate feature parity of AWS IO conne

[jira] [Updated] (BEAM-13174) Deprecate amazon-web-services & kinesis module (SDK v1)

2022-02-13 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13174: --- Labels: aws-sdk-v1 (was: aws-sdk-v1 stale-assigned) > Deprecate amazon-web-services & kinesis module

[jira] [Updated] (BEAM-13175) Implement missing KinesisIO.Write for aws2

2022-02-13 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13175: --- Labels: aws-sdk-v2 (was: stale-assigned) > Implement missing KinesisIO.Write for aws2 >

[jira] [Assigned] (BEAM-13415) SqsIO.write should be implemented using batch API

2022-02-15 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13415: -- Assignee: Moritz Mack > SqsIO.write should be implemented using batch API > --

[jira] [Commented] (BEAM-13206) Consolidate multiple levels of retries for AWS IOs

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493128#comment-17493128 ] Moritz Mack commented on BEAM-13206: For AWS Sdk v2 this will be fixed by BEAM-13563.

[jira] [Updated] (BEAM-13235) Investigate feature parity of AWS IO connectors on SDK v1 vs. v2

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13235: --- Fix Version/s: Not applicable Resolution: Done Status: Resolved (was: Open) > Inve

[jira] [Commented] (BEAM-13235) Investigate feature parity of AWS IO connectors on SDK v1 vs. v2

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493130#comment-17493130 ] Moritz Mack commented on BEAM-13235: All missing features of the AWS SDK v2 module ar

[jira] [Updated] (BEAM-13840) :sdks:java:io:amazon-web-services(2) use legacy rawtypes

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13840: --- Fix Version/s: 2.37.0 Resolution: Fixed Status: Resolved (was: Open) > :sdks:java:

[jira] [Commented] (BEAM-13847) Support dynamic partitioning of JdbcIO ranges via SDF

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493145#comment-17493145 ] Moritz Mack commented on BEAM-13847: Should this be closed [~pabloem] ? > Support dy

[jira] [Commented] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-16 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493344#comment-17493344 ] Moritz Mack commented on BEAM-13956: [~i_maravic] So rather than having an environmen

[jira] [Commented] (BEAM-14011) AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters

2022-03-01 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499897#comment-17499897 ] Moritz Mack commented on BEAM-14011: Thanks a lot [~stephenpatel] (y) > AWS SDK2 S3F

[jira] [Updated] (BEAM-14011) AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters

2022-03-01 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14011: --- Status: Open (was: Triage Needed) > AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request para

[jira] [Commented] (BEAM-14011) AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters

2022-03-02 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500019#comment-17500019 ] Moritz Mack commented on BEAM-14011: Good point [~aromanenko] , I didn't notice befor

[jira] [Updated] (BEAM-13563) Generalize AWS client provider to be independent of client type

2022-03-03 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13563: --- Fix Version/s: 2.38.0 Resolution: Fixed Status: Resolved (was: In Progress) > Gene

[jira] [Commented] (BEAM-13956) Serialize/deserialize StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-03-03 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500765#comment-17500765 ] Moritz Mack commented on BEAM-13956: [~i_maravic] Sorry, took a bit to get things mer

[jira] [Updated] (BEAM-13738) Reenable ignored test in SqsUnboundedReaderTest

2022-03-14 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13738: --- Fix Version/s: 2.37.0 Resolution: Fixed Status: Resolved (was: Open) > Reenable ig

[jira] [Created] (BEAM-14104) Shard aware partitioner

2022-03-15 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14104: -- Summary: Shard aware partitioner Key: BEAM-14104 URL: https://issues.apache.org/jira/browse/BEAM-14104 Project: Beam Issue Type: Improvement Components

[jira] [Assigned] (BEAM-14104) Shard aware partitioner

2022-03-15 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14104: -- Assignee: Moritz Mack > Shard aware partitioner > --- > >

[jira] [Updated] (BEAM-14104) Shard aware Kinesis partitioner (AWS Sdk v2)

2022-03-15 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Summary: Shard aware Kinesis partitioner (AWS Sdk v2) (was: Shard aware partitioner) > Shard aware

[jira] [Updated] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-03-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Description: Implement advanced Kinesis record aggregation that is aware of active shards in the stre

[jira] [Updated] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-03-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Summary: Shard aware Kinesis record aggregation (AWS Sdk v2) (was: Shard aware Kinesis partitioner (

[jira] [Assigned] (BEAM-14125) Update IO matrix for website recommending usage of AWS 2

2022-03-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14125: -- Assignee: Moritz Mack > Update IO matrix for website recommending usage of AWS 2 > ---

[jira] [Updated] (BEAM-14125) Update IO matrix for website recommending usage of AWS 2

2022-03-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14125: --- Parent: BEAM-13174 Issue Type: Sub-task (was: Task) > Update IO matrix for website recommend

[jira] [Created] (BEAM-14125) Update IO matrix for website recommending usage of AWS 2

2022-03-18 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14125: -- Summary: Update IO matrix for website recommending usage of AWS 2 Key: BEAM-14125 URL: https://issues.apache.org/jira/browse/BEAM-14125 Project: Beam Issue Type:

[jira] [Updated] (BEAM-14125) Update IO matrix for website recommending usage of AWS 2

2022-03-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14125: --- Status: Open (was: Triage Needed) > Update IO matrix for website recommending usage of AWS 2 > -

[jira] [Updated] (BEAM-13206) Consolidate multiple levels of retries for AWS IOs

2022-03-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13206: --- Fix Version/s: 2.38.0 Resolution: Fixed Status: Resolved (was: In Progress) > Cons

[jira] [Work started] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-03-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14104 started by Moritz Mack. -- > Shard aware Kinesis record aggregation (AWS Sdk v2) >

[jira] [Updated] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-03-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Status: Open (was: Triage Needed) > Shard aware Kinesis record aggregation (AWS Sdk v2) > --

[jira] [Updated] (BEAM-13232) Underlying AWS Kinesis clients are not closed

2022-03-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13232: --- Labels: aws aws-sdk-v2 kinesis (was: aws kinesis) > Underlying AWS Kinesis clients are not closed >

[jira] [Assigned] (BEAM-13232) Underlying AWS Kinesis clients are not closed

2022-03-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13232: -- Assignee: Moritz Mack > Underlying AWS Kinesis clients are not closed > --

[jira] [Work started] (BEAM-13232) Underlying AWS Kinesis clients are not closed

2022-03-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-13232 started by Moritz Mack. -- > Underlying AWS Kinesis clients are not closed > --

[jira] [Updated] (BEAM-14166) Improvements to RowWithGetter

2022-03-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14166: --- Status: Open (was: Triage Needed) > Improvements to RowWithGetter > - >

[jira] [Created] (BEAM-14166) Improvements to RowWithGetter

2022-03-24 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14166: -- Summary: Improvements to RowWithGetter Key: BEAM-14166 URL: https://issues.apache.org/jira/browse/BEAM-14166 Project: Beam Issue Type: Improvement Comp

[jira] [Assigned] (BEAM-14166) Improvements to RowWithGetter

2022-03-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14166: -- Assignee: Moritz Mack > Improvements to RowWithGetter > - > >

[jira] [Assigned] (BEAM-13415) SqsIO.write should be implemented using batch API

2022-03-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13415: -- Assignee: Moritz Mack > SqsIO.write should be implemented using batch API > --

[jira] [Commented] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493855#comment-17493855 ] Moritz Mack commented on BEAM-13956: [~i_maravic] I don't think such a mechanism exis

[jira] [Created] (BEAM-13965) Polymorphic types not supported in PipelineOptions

2022-02-17 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-13965: -- Summary: Polymorphic types not supported in PipelineOptions Key: BEAM-13965 URL: https://issues.apache.org/jira/browse/BEAM-13965 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-13965) Polymorphic types not supported in PipelineOptions

2022-02-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13965: --- Description: I noticed that polymorphic types using @JsonTypeInfo and @JsonSubTypes are currently no

[jira] [Updated] (BEAM-13965) Polymorphic types not supported in PipelineOptions

2022-02-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13965: --- Description: I noticed that polymorphic types using @JsonTypeInfo and @JsonSubTypes are currently no

[jira] [Commented] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494073#comment-17494073 ] Moritz Mack commented on BEAM-13956: Propagating environment variables is hardly poss

[jira] [Commented] (BEAM-13965) Polymorphic types not supported in PipelineOptions

2022-02-17 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494428#comment-17494428 ] Moritz Mack commented on BEAM-13965: Unless I'm overseen something major, it should b

[jira] [Commented] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17495616#comment-17495616 ] Moritz Mack commented on BEAM-13956: [~i_maravic]  another small PR to prepare Client

[jira] [Assigned] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13956: -- Assignee: Moritz Mack > Serialize/deserialize used StsClient when serializing/deserializing >

[jira] [Assigned] (BEAM-13956) Serialize/deserialize used StsClient when serializing/deserializing StsAssumeRoleCredentialsProvider

2022-02-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13956: -- Assignee: (was: Moritz Mack) > Serialize/deserialize used StsClient when serializing/deser

[jira] [Assigned] (BEAM-13965) Polymorphic types not supported in PipelineOptions

2022-02-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13965: -- Assignee: Moritz Mack > Polymorphic types not supported in PipelineOptions > -

[jira] [Updated] (BEAM-13663) Fix AWS client configuration in AwsModule

2022-02-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13663: --- Fix Version/s: 2.38.0 Resolution: Fixed Status: Resolved (was: In Progress) > Fix

[jira] [Updated] (BEAM-14363) Kinesis WatermarkParameters builder clobbers values

2022-04-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14363: --- Labels: aws-sdk-v1 aws-sdk-v2 (was: ) > Kinesis WatermarkParameters builder clobbers values > --

[jira] [Updated] (BEAM-14363) Kinesis WatermarkParameters builder clobbers values

2022-04-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14363: --- Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: In Progress) > Kine

[jira] [Assigned] (BEAM-14363) Kinesis WatermarkParameters builder clobbers values

2022-04-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14363: -- Assignee: Moritz Mack (was: Nick Caballero) > Kinesis WatermarkParameters builder clobbers va

[jira] [Assigned] (BEAM-14363) Kinesis WatermarkParameters builder clobbers values

2022-04-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14363: -- Assignee: Nick Caballero (was: Moritz Mack) > Kinesis WatermarkParameters builder clobbers va

[jira] [Updated] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-05-08 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Labels: aws-sdk-v2 kinesis (was: aws-sdk-v2 kinesis stale-assigned) > Shard aware Kinesis record agg

[jira] [Updated] (BEAM-14104) Shard aware Kinesis record aggregation (AWS Sdk v2)

2022-05-08 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14104: --- Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: In Progress) > Shar

[jira] [Updated] (BEAM-14334) Avoid using forkEvery in Spark runner tests

2022-05-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14334: --- Fix Version/s: 2.40.0 Resolution: Fixed Status: Resolved (was: Open) > Avoid using

[jira] [Updated] (BEAM-13174) Deprecate amazon-web-services & kinesis module (SDK v1)

2022-05-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13174: --- Labels: aws-sdk-v1 (was: aws-sdk-v1 stale-assigned) > Deprecate amazon-web-services & kinesis module

[jira] [Updated] (BEAM-11653) MetricsSinkTest is failing with Spark 3

2022-05-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-11653: --- Fix Version/s: 2.40.0 Resolution: Fixed Status: Resolved (was: Open) > MetricsSink

[jira] [Updated] (BEAM-11653) MetricsSinkTest is failing with Spark 3

2022-05-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-11653: --- Labels: (was: stale-assigned) > MetricsSinkTest is failing with Spark 3 > -

[jira] [Updated] (BEAM-13415) SqsIO.write should be implemented using batch API

2022-05-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13415: --- Labels: aws aws-sdk-v2 sqs (was: aws aws-sdk-v2 sqs stale-assigned) > SqsIO.write should be implemen

[jira] [Updated] (BEAM-13174) Deprecate amazon-web-services & kinesis module (SDK v1)

2022-04-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13174: --- Labels: aws-sdk-v1 (was: aws-sdk-v1 stale-assigned) > Deprecate amazon-web-services & kinesis module

[jira] [Commented] (BEAM-13174) Deprecate amazon-web-services & kinesis module (SDK v1)

2022-04-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524050#comment-17524050 ] Moritz Mack commented on BEAM-13174: Next steps are: * Announce / Advertise latest A

[jira] [Created] (BEAM-14323) Improve IDE integration for Spark cross version builds

2022-04-18 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14323: -- Summary: Improve IDE integration for Spark cross version builds Key: BEAM-14323 URL: https://issues.apache.org/jira/browse/BEAM-14323 Project: Beam Issue Type: I

[jira] [Assigned] (BEAM-14323) Improve IDE integration for Spark cross version builds

2022-04-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14323: -- Assignee: Moritz Mack > Improve IDE integration for Spark cross version builds > -

[jira] [Updated] (BEAM-14323) Improve IDE integration for Spark cross version builds

2022-04-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14323: --- Status: Open (was: Triage Needed) > Improve IDE integration for Spark cross version builds > ---

[jira] [Work started] (BEAM-14323) Improve IDE integration for Spark cross version builds

2022-04-18 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14323 started by Moritz Mack. -- > Improve IDE integration for Spark cross version builds > -

[jira] [Created] (BEAM-14334) Avoid using forkEvery in Spark runner tests

2022-04-20 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14334: -- Summary: Avoid using forkEvery in Spark runner tests Key: BEAM-14334 URL: https://issues.apache.org/jira/browse/BEAM-14334 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-14334) Avoid using forkEvery in Spark runner tests

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14334: -- Assignee: Moritz Mack > Avoid using forkEvery in Spark runner tests >

[jira] [Updated] (BEAM-14334) Avoid using forkEvery in Spark runner tests

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14334: --- Status: Open (was: Triage Needed) > Avoid using forkEvery in Spark runner tests > --

[jira] [Commented] (BEAM-14334) Avoid using forkEvery in Spark runner tests

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17524828#comment-17524828 ] Moritz Mack commented on BEAM-14334: Looks like BEAM-11653 was failing due do a Spark

[jira] [Assigned] (BEAM-11653) MetricsSinkTest is failing with Spark 3

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-11653: -- Assignee: Moritz Mack > MetricsSinkTest is failing with Spark 3 >

[jira] [Created] (BEAM-14335) Spotless sources for Spark runner

2022-04-20 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14335: -- Summary: Spotless sources for Spark runner Key: BEAM-14335 URL: https://issues.apache.org/jira/browse/BEAM-14335 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-14335) Spotless sources for Spark runner

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14335: --- Status: Open (was: Triage Needed) > Spotless sources for Spark runner >

[jira] [Assigned] (BEAM-14335) Spotless sources for Spark runner

2022-04-20 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14335: -- Assignee: Moritz Mack > Spotless sources for Spark runner > -

[jira] [Created] (BEAM-14345) Hadoop version tests are failing for Spark 3

2022-04-21 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-14345: -- Summary: Hadoop version tests are failing for Spark 3 Key: BEAM-14345 URL: https://issues.apache.org/jira/browse/BEAM-14345 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-14345) Hadoop version tests are failing for Spark 3

2022-04-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-14345: --- Status: Open (was: Triage Needed) > Hadoop version tests are failing for Spark 3 > -

[jira] [Assigned] (BEAM-14345) Hadoop version tests are failing for Spark 3

2022-04-21 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-14345: -- Assignee: Moritz Mack > Hadoop version tests are failing for Spark 3 > ---

[jira] [Updated] (BEAM-13415) SqsIO.write should be implemented using batch API

2022-04-24 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13415: --- Labels: aws aws-sdk-v2 sqs (was: aws aws-sdk-v2 sqs stale-assigned) > SqsIO.write should be implemen

[jira] [Commented] (BEAM-10071) TableFieldSchema Conversion fails for beamschema

2021-10-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432960#comment-17432960 ] Moritz Mack commented on BEAM-10071: This was fixed in BEAM-10490, no NPEs are thrown

[jira] [Updated] (BEAM-10071) TableFieldSchema Conversion fails for beamschema

2021-10-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-10071: --- Resolution: Fixed Status: Resolved (was: Open) > TableFieldSchema Conversion fails for beams

[jira] [Assigned] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-22 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-8958: - Assignee: Moritz Mack > Use default credentials provider with BasicKinesisProvider >

[jira] [Commented] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-25 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17433647#comment-17433647 ] Moritz Mack commented on BEAM-8958: --- Current IO modules with AWS client providers using

[jira] [Comment Edited] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-25 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17433647#comment-17433647 ] Moritz Mack edited comment on BEAM-8958 at 10/25/21, 10:17 AM: -

[jira] [Commented] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-25 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17433743#comment-17433743 ] Moritz Mack commented on BEAM-8958: --- i've previously ignored the S3Options / AwsOptions

[jira] [Created] (BEAM-13116) Support AWS credentials provider for AWS IOs (SDK v1)

2021-10-26 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-13116: -- Summary: Support AWS credentials provider for AWS IOs (SDK v1) Key: BEAM-13116 URL: https://issues.apache.org/jira/browse/BEAM-13116 Project: Beam Issue Type: Im

[jira] [Work started] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-26 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8958 started by Moritz Mack. - > Use default credentials provider with BasicKinesisProvider >

[jira] [Work stopped] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8958 stopped by Moritz Mack. - > Use default credentials provider with BasicKinesisProvider >

[jira] [Commented] (BEAM-8958) Use default credentials provider with BasicKinesisProvider

2021-10-27 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434903#comment-17434903 ] Moritz Mack commented on BEAM-8958: --- Unifying AWS IO APIs on using pipeline options woul

[jira] [Assigned] (BEAM-13138) DynamoDBIOTest (aws2) is blocking forever

2021-10-28 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13138: -- Assignee: Moritz Mack > DynamoDBIOTest (aws2) is blocking forever > --

[jira] [Created] (BEAM-13138) DynamoDBIOTest (aws2) is blocking forever

2021-10-28 Thread Moritz Mack (Jira)
Moritz Mack created BEAM-13138: -- Summary: DynamoDBIOTest (aws2) is blocking forever Key: BEAM-13138 URL: https://issues.apache.org/jira/browse/BEAM-13138 Project: Beam Issue Type: Bug

[jira] [Work started] (BEAM-13138) DynamoDBIOTest (aws2) is blocking forever

2021-10-28 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-13138 started by Moritz Mack. -- > DynamoDBIOTest (aws2) is blocking forever > --

[jira] [Updated] (BEAM-13138) DynamoDBIOTest (aws2) is blocking forever

2021-10-28 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack updated BEAM-13138: --- Status: Open (was: Triage Needed) > DynamoDBIOTest (aws2) is blocking forever >

[jira] [Work stopped] (BEAM-13138) DynamoDBIOTest (aws2) is blocking forever

2021-10-28 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-13138 stopped by Moritz Mack. -- > DynamoDBIOTest (aws2) is blocking forever > --

[jira] [Assigned] (BEAM-11440) Run KinesisIOIT on Jenkins

2021-10-28 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-11440: -- Assignee: Moritz Mack > Run KinesisIOIT on Jenkins > -- > >

[jira] [Work started] (BEAM-11440) Run KinesisIOIT on Jenkins

2021-10-29 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11440 started by Moritz Mack. -- > Run KinesisIOIT on Jenkins > -- > > Key: B

[jira] [Work stopped] (BEAM-11440) Run KinesisIOIT on Jenkins

2021-10-29 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11440 stopped by Moritz Mack. -- > Run KinesisIOIT on Jenkins > -- > > Key: B

[jira] [Assigned] (BEAM-13147) Eliminate nullability errors from :sdks:java:io:aws(2) AwsModule

2021-10-29 Thread Moritz Mack (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Moritz Mack reassigned BEAM-13147: -- Assignee: Moritz Mack > Eliminate nullability errors from :sdks:java:io:aws(2) AwsModule > ---

  1   2   3   >