I think the root cause might be the firewall between your local machine and
YARN cluster.
It seems that your local machine is only allowed to access some specific
ports from the YARN cluster(e.g. Yarn ResourceManager port).
You could verify that by telnet the running JobManager address(
10.0.11.57
Hi Experts,
I recently tried to run yarn-application mode on my yarn cluster, and I had
a problem related to configuring `execution.target`.
After reading the source code and doing some experiments, I found that
there should be some room of improvement for `FlinkYarnSessionCli` or
`AbstractYarnCli
I guess you only need file:///{os.getcwd()}/lib/flink-sql-avro-1.12.2.jar
. Could you remove
flink-avro-1.12.2.jar and avro-1.10.2.jar and try again?
Regards,
Dian
> 2021年4月24日 上午8:29，Edward Yang 写道：
>
> I've been trying to write to the avro format with pyflink 1.12.2 on ubuntu,
> I've test
does the default within behavior of flink cep handle out of order events
(relative to event time)? obviously, it'd be best if the event time was
guaranteed correct, but sometimes it's too difficult to do.
do people end up writing different patterns with some event orderings
reversed to capture th
ah it seems that one needs to use chill 0.7.6 in order to get it to work
with flink.
On Sat, Apr 24, 2021 at 1:18 PM Prashant Deva wrote:
> I am trying to use chill-protobuf to serialize protobuf messages.
> However, I am getting this exception:
>
>
> Caused by: java.lang.NoSuchMethodError: 'boo
I am trying to use chill-protobuf to serialize protobuf messages.
However, I am getting this exception:
Caused by: java.lang.NoSuchMethodError: 'boolean
com.twitter.chill.java.Java8ClosureRegistrar.areOnJava8 (
http://com.twitter.chill.java.java8closureregistrar.areonjava8/ ) ()'
at com.twitte
so i did register the type with Kryo and the ProtobufSerializer. However I am
still continuing to see the warnings. is this a bug in Flink?
env.config.registerTypeWithKryoSerializer(Trace.APITrace:: class.java (
http://class.java/ ) , ProtobufSerializer:: class.java ( http://class.java/ ) )
va
Why not use upserts? Wouldn't that solve the issue of duplicates and there
won't be a need to query database too?
On Sat, Apr 24, 2021, 8:12 PM David Anderson wrote:
> What are the other techniques for bootstrapping rocksdb state?
>
>
> Bootstrapping state involves somehow creating a snapshot (t
Hi Prashant,
I think the warn is given when calling
return TypeInformation.of(Trace.APITrace::class.java)
Currently flink does not have the native support
for the protobuf types yet[1], thus it would use a
generic serializer created by kryo.
This should not affect the rightness of the progra
>
> What are the other techniques for bootstrapping rocksdb state?
Bootstrapping state involves somehow creating a snapshot (typically a
savepoint, but a retained checkpoint can be a better choice in some cases)
containing the necessary state -- meaning that the state has the same
operator uid an
Oguzhan,
Note, the state size is very large and I have to feed the state from batch
> flow firstly. Thus I can not use the internal state like rocksdb.
How large is "very large"? Using RocksDB, several users have reported
working with jobs using many TBs of state.
And there are techniques for b
11 matches
Mail list logo
