Flink Job Execution issue at Yarn

2022-05-18 Thread Anitha Thankappan
like the job running only on job manger. Please help on this. Thanks and Regards, Anitha Thankappan -- _This message contains information that may be privileged or confidential and is the property of the Quantiphi Inc and/or its affiliates_. It is intended only for the person to whom it is

How to distribute DataStream rows parallelly to executors without duplication

2022-05-16 Thread Anitha Thankappan
())* .name(TableConnectorUtils.generateRuntimeName(BigQueryTableSink.class, fieldNames)); ... } We want to implement parallelism for this data stream without duplication. Could you please help by guiding on the approach we need to use here. Thanks and Regards, Anitha Thankappan -- _This message

Re: Avro deserialization issue

2022-04-13 Thread Anitha Thankappan
.java:161) at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154) at org.apache.flink.formats.avro.AvroRowDataDeserializationSchema.deserialize(AvroRowDataDeserializationSchema.java:147) Thanks and Regards, Anitha Thankappan On Wed, Apr 13, 2022 at 9:16 PM Piotr Nowojski wrote: > Hey, > > Coul

Avro deserialization issue

2022-04-11 Thread Anitha Thankappan
(getRuntimeContext()) is not working. What could be the alternative for this in 1.11.0? Thanks and Regards, Anitha Thankappan -- _This message contains information that may be privileged or confidential and is the property of the Quantiphi Inc and/or its affiliates_. It is intended only for the person to

Re: Is there any way to get the ExecutionConfigurations in Dynamic factory class

2022-04-10 Thread Anitha Thankappan
, Anitha Thankappan On Fri, Apr 8, 2022 at 11:53 AM Qingsheng Ren wrote: > Hi Anitha, > > AFAIK DynamicTableSourceFactory doesn’t expose interface for getting > parallelism. Could you elaborate on why you need parallelism in table > factory? Maybe we could find other ways

Is there any way to get the ExecutionConfigurations in Dynamic factory class

2022-04-07 Thread Anitha Thankappan
at Factory class or Table source class level. Please help me on this. Thanks and Regards, Anitha Thankappan -- _This message contains information that may be privileged or confidential and is the property of the Quantiphi Inc and/or its affiliates_. It is intended only for the person to whom

Re: BIGDECIMAL data handling

2022-04-05 Thread Anitha Thankappan
, Anitha Thankappan On Tue, Apr 5, 2022 at 7:21 PM Martijn Visser wrote: > Hi Anitha, > > Looking at Bigquery's documentation, they're aliasing it as a BIGDECIMAL > [1]. According to Flink's documentation, you can create an unregistered > structured type as an user

BIGDECIMAL data handling

2022-04-05 Thread Anitha Thankappan
this. Thanks in Advance, Anitha Thankappan -- _This message contains information that may be privileged or confidential and is the property of the Quantiphi Inc and/or its affiliates_. It is intended only for the person to whom it is addressed. _If you are not the intended recipient, any r