[jira] [Created] (FLINK-36523) DDB Streams connector treating LATEST as TRIM_HORIZON for some cases

2024-10-13 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36523: -- Summary: DDB Streams connector treating LATEST as TRIM_HORIZON for some cases Key: FLINK-36523 URL: https://issues.apache.org/jira/browse/FLINK-36523 Project: Flink

[jira] [Updated] (FLINK-36329) DDB Streams connector not retrying some SDK exceptions

2024-09-19 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36329: --- Issue Type: Bug (was: Improvement) > DDB Streams connector not retrying some SDK exceptions > -

[jira] [Created] (FLINK-36329) DDB Streams connector not retrying some SDK exceptions

2024-09-19 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36329: -- Summary: DDB Streams connector not retrying some SDK exceptions Key: FLINK-36329 URL: https://issues.apache.org/jira/browse/FLINK-36329 Project: Flink Issue Type

[jira] [Updated] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36328: --- Description: In DDB Flink connector, we are getting this warn message quite a lot:   "splitId: {}

[jira] [Created] (FLINK-36328) Making the log for child not found as debug

2024-09-19 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36328: -- Summary: Making the log for child not found as debug Key: FLINK-36328 URL: https://issues.apache.org/jira/browse/FLINK-36328 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-36296) Add incremental shard discovery for DDB Streams source

2024-09-17 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36296: -- Summary: Add incremental shard discovery for DDB Streams source Key: FLINK-36296 URL: https://issues.apache.org/jira/browse/FLINK-36296 Project: Flink Issue Type

[jira] [Closed] (FLINK-36239) DDB Streams Connector reprocessing due to DescribeStream inconsistencies for trimmed shards

2024-09-12 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta closed FLINK-36239. -- > DDB Streams Connector reprocessing due to DescribeStream inconsistencies for > trimmed shards > ---

[jira] [Created] (FLINK-36270) DDB Streams Connector performance issue due to splitsAvailableForAssignment function

2024-09-12 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36270: -- Summary: DDB Streams Connector performance issue due to splitsAvailableForAssignment function Key: FLINK-36270 URL: https://issues.apache.org/jira/browse/FLINK-36270 Proj

[jira] [Updated] (FLINK-36270) DDB Streams Connector performance issue due to splitsAvailableForAssignment function

2024-09-12 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36270: --- Description: In DDB Streams connector, while testing we found out that when we are spending a lot of

[jira] [Created] (FLINK-36215) Child shards are getting started with LATEST shard iterator even when parents are not expired

2024-09-04 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36215: -- Summary: Child shards are getting started with LATEST shard iterator even when parents are not expired Key: FLINK-36215 URL: https://issues.apache.org/jira/browse/FLINK-36215

[jira] [Updated] (FLINK-36206) Support flink-connector-aws-base to allow custom override configuration

2024-09-03 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36206: --- Component/s: Connectors / Kinesis (was: Connectors / Kafka) > Support flink-con

[jira] [Created] (FLINK-36206) Support flink-connector-aws-base to allow custom override configuration

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36206: -- Summary: Support flink-connector-aws-base to allow custom override configuration Key: FLINK-36206 URL: https://issues.apache.org/jira/browse/FLINK-36206 Project: Flink

[jira] [Created] (FLINK-36204) Fix dropping records when consuming from LATEST and having a restore from expired snapshot

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36204: -- Summary: Fix dropping records when consuming from LATEST and having a restore from expired snapshot Key: FLINK-36204 URL: https://issues.apache.org/jira/browse/FLINK-36204

[jira] [Created] (FLINK-36203) Have some way to control the polling frequency of GetRecords from SplitFetcher

2024-09-03 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36203: -- Summary: Have some way to control the polling frequency of GetRecords from SplitFetcher Key: FLINK-36203 URL: https://issues.apache.org/jira/browse/FLINK-36203 Project: F

[jira] [Updated] (FLINK-36195) Migrate DDB Streams specific retry configuration to flink-connector-base

2024-09-02 Thread Abhi Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhi Gupta updated FLINK-36195: --- Component/s: Connectors / DynamoDB (was: API / DataStream) > Migrate DDB Stream

[jira] [Created] (FLINK-36196) Have a UX for customer where customer just gives table name and gets the stream arn which is enabled

2024-09-02 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36196: -- Summary: Have a UX for customer where customer just gives table name and gets the stream arn which is enabled Key: FLINK-36196 URL: https://issues.apache.org/jira/browse/FLINK-36196

[jira] [Created] (FLINK-36195) Migrate DDB Streams specific retry configuration to flink-connector-base

2024-09-02 Thread Abhi Gupta (Jira)
Abhi Gupta created FLINK-36195: -- Summary: Migrate DDB Streams specific retry configuration to flink-connector-base Key: FLINK-36195 URL: https://issues.apache.org/jira/browse/FLINK-36195 Project: Flink