Re: slow checkpoints

2019-11-15 Thread yuvraj singh
n't be done in expected time, you should fix the > back pressure problem first. There is a FLIP[1] that wants to fix this > issue. > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-76%3A+Unaligned+Checkpoints > Best, > Congxian > > > yuvraj singh <

slow checkpoints

2019-11-15 Thread yuvraj singh
Hi all , I am facing one issue , when i have high back pressure my checkpoints start failing . please let me know how to deal with this kind of situations . Thanks Yubraj Singh . [image: Mailtrack]

error in my job

2019-09-03 Thread yuvraj singh
Hi all , i am facing a problem in my flink job , i am getting given exception 2019-09-03 12:02:04,278 ERROR org.apache.flink.runtime.io.network.netty.PartitionRequestQueue - Encountered error while consuming partitions java.io.IOException: Connection reset by peer at sun.nio.ch.FileDi

error in flink

2019-06-04 Thread yuvraj singh
Hi all , i am having on problem , i was running a job then i submitted one more job on the same cluster then my old job start failing by saying 2019-06-04 15:12:11,593 ERROR org.apache.flink.yarn.YarnResourceManager - Could not start TaskManager in container. java.lang.OutOfMemoryError: unable to

error while querying state

2019-02-12 Thread yuvraj singh
Hi all , i am facing issue with QueryableStateClient i am getting this issue please help me Exception in thread "main" java.util.concurrent.ExecutionException: org.apache.flink.util.FlinkRuntimeException: java.io.EOFException at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture

Re: error with flink

2018-10-01 Thread yuvraj singh
i am using 1.6.0 On Mon, Oct 1, 2018 at 8:05 PM Hequn Cheng wrote: > Hi yuvraj, > > It seems a null key has been keyed by. Which Flink version do you use? And > could you show some user code related about keyBy or GroupBy? > > Best, Hequn > > On Mon, Oct 1, 2018

error with flink

2018-10-01 Thread yuvraj singh
Hi i am facing this problem with my flink job please help me with it . java.lang.Exception: An async function call terminated with an exception. Failing the AsyncWaitOperator. at org.apache.flink.streaming.api.operators.async.Emitter.output(Emitter.java:137) at org.apache.flin

Re: error with session window

2018-09-24 Thread yuvraj singh
gBy(FilteredGeoHashes::getCategory)); collector.collect(new CityWithGeoHashes(city, geoHashesPerCategory)); } }).name("city-geohashes-processor") .uid("city-geohashes-processor"); On Mon, Sep 24, 2018 at 4:56 PM yuv

error with session window

2018-09-24 Thread yuvraj singh
org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:311) at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202) Thanks Yuvraj Singh

Re: error closing kafka

2018-09-24 Thread yuvraj singh
i have one more question , is it possible , if i do keyby on the stream it will get portioned automatically , because i am getting all the data in the same partition in kafka. Thanks Yubraj Singh On Mon, Sep 24, 2018 at 12:34 PM yuvraj singh <19yuvrajsing...@gmail.com> wrote: > I am p

Re: error closing kafka

2018-09-24 Thread yuvraj singh
you trying to do , can you share some code ? > This is the reason for the exeption > Proceeding to force close the producer since pending requests could not be > completed within timeout 9223372036854775807 ms. > > > > On Mon, 24 Sep 2018, 9:23 yuvraj singh, <19yuvrajsing.

error closing kafka

2018-09-23 Thread yuvraj singh
Hi all , I am getting this error with flink 1.6.0 , please help me . 2018-09-23 07:15:08,846 ERROR org.apache.kafka.clients.producer.KafkaProducer - Interrupted while joining ioThread java.lang.InterruptedException at java.lang.Object.wait(Native Method) at

***UNCHECKED*** Re: Checkpointing not working

2018-09-18 Thread yuvraj singh
seen there is no back pressure . Thanks Yubraj Singh On Wed, Sep 19, 2018 at 12:07 PM Jörn Franke wrote: > What do the logfiles say? > > How does the source code looks like? > > Is it really needed to do checkpointing every 30 seconds? > > On 19. Sep 2018, at 08:25, yuvra

Checkpointing not working

2018-09-18 Thread yuvraj singh
Hi , I am doing checkpointing using s3 and rocksdb , i am doing checkpointing per 30 seconds and time out is 10 seconds . most of the time its failing by saying Failure Time: 11:53:17Cause: Checkpoint expired before completing . I increases the timeout as well still it not working for me . ple

error running flink job on yarn cluster

2018-08-21 Thread yuvraj singh
hi all , i am getting this error java.io.InvalidClassException: com.fasterxml.jackson.databind.ObjectMapper; local class incompatible: stream classdesc serialVersionUID = 1, local class serialVersionUID = 2 at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:616) at java.io.ObjectI

Re: getting error while running flink job on yarn cluster

2018-08-21 Thread yuvraj singh
[...] > > Best, > Gary > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/hadoop.html#configuring-flink-with-hadoop-classpaths > > On Tue, Aug 21, 2018 at 4:23 PM, yuvraj singh <19yuvrajsing...@gmail.com> > wrote: > >> Hi , >

Re: getting error while running flink job on yarn cluster

2018-08-21 Thread yuvraj singh
required dependencies for timeline server, which I think > could be a bug. > > Best Regards, > Paul Lam > > 在 2018年8月21日,22:23,yuvraj singh <19yuvrajsing...@gmail.com> 写道: > > Hi , > > i am getting a error while running a flink job on yarn cluster , it

getting error while running flink job on yarn cluster

2018-08-21 Thread yuvraj singh
Hi , i am getting a error while running a flink job on yarn cluster , its running fine when i run it on flink standalone cluster java.lang.NoClassDefFoundError: com/sun/jersey/core/util/FeaturesAndProperties at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineCla

Hive Integration

2018-08-13 Thread yuvraj singh
I want to know ,if FLink have support for hive . Thanks Yubraj Singh

Error with Cassandra

2018-08-13 Thread yuvraj singh
Hi , I am getting java.lang.NoClassDefFoundError: Could not initialize class com.datastax.driver.core.Cluster please help with it . my pom is 1.5.0 3.7.0 1.8 2.11 2.9.4 3.5.1 1.7.5 1.16.18 2.0.4.RELEASE 2.1.4.RELEASE UTF-8 3.11.3 3.5.1

Re: Rest API calls

2018-07-31 Thread yuvraj singh
ojects/flink/flink-docs-release-1.5/monitoring/rest_api.html#monitoring-rest-api > > Thanks, vino. > > 2018-08-01 3:29 GMT+08:00 yuvraj singh <19yuvrajsing...@gmail.com>: > >> Hi I have a use case where I need to call rest apis from a flink . I am >> not getting much c

Rest API calls

2018-07-31 Thread yuvraj singh
Hi I have a use case where I need to call rest apis from a flink . I am not getting much context form internet , please help me on this . Thanks