Re: some questions about flink packaging

it works. thanks very much. Flavio Pompermaier 于2019年7月10日周三 下午5:04写道： > Have you tried to follow the instruction to build Flink for Maven >= 3.4? > That is: > > mvn clean install -DskipTestscd flink-dist > mvn clean install > > > On Wed, Jul 10, 2019 at 10:34 AM M

Re: some questions about flink packaging

k-shaded >> >> Best, >> Flavio >> >> On Wed, Jul 10, 2019 at 10:21 AM Marvin777 >> wrote: >> >>> hi, all: >>> >>> The flink-dist package downloaded from the flink community does not have >>> the dependencies of Jackson an

some questions about flink packaging

hi, all: The flink-dist package downloaded from the flink community does not have the dependencies of Jackson and protobuf, like figure 1. But when I pull the code from github and compile and package it using the mvn clean package command, flink-dist has dependencies on Jackson and protobuf, like

sql program throw exception when new kafka with csv format

Register kafka message source with csv format, the error message is as follows: Exception in thread "main" org.apache.flink.table.api.NoMatchingTableFactoryException: Could not find a suitable table factory for 'org.apache.flink.table.factories.DeserializationSchemaFactory' in the classpath. Re

[Table API example] Table program cannot be compiled. This is a bug. Please file an issue

Hi all, I have a simple test for looking at Flink Table API and hit an exception reported as a bug. I wonder though if it is a missing something. BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 . Thanks Mavin. [image: image.png]

Re: Flink Task Allocation on Yarn

l the start and stop of TM, then I recommend you use > standalone mode and set the number of slots per node to 1. > > Thanks, vino. > > Marvin777 于2018年10月29日周一 上午10:18写道： > >> Hi all, >> >> In the mode of on yarn, a node may contain more than one container

Flink Task Allocation on Yarn

Hi all, In the mode of on yarn, a node may contain more than one container, is there a scheme for assigning tasks to different nodes. the version is 1.4.2 Thanks for your assistance.

Re: Flink Task Allocation on Nodes

Hi all, In the mode of on yarn, a node may contain more than one container, is there a scheme for assigning tasks to different nodes. the version is 1.4.2 Thanks for your assistance. Sayat Satybaldiyev 于2018年10月26日周五 下午3:50写道： > Thanks for the advice, Klein. Could you please share more detai

Re: Flink can't initialize operator state backend when starting from checkpoint

was wrong with > a serializer or a stateful serializer was used from multiple threads. > > Thanks, vino. > > Marvin777 于2018年9月21日周五 下午3:20写道： > >> Hi all, >> >> When Flink(1.4.2) job starts, it could find checkpoint files at HDFS, but >> exception occurs during deserializing: >> >> >> >> Do you have any insight on this? >> >> Thanks, >> Qingxiang Ma >> > >

Flink can't initialize operator state backend when starting from checkpoint

Hi all, When Flink(1.4.2) job starts, it could find checkpoint files at HDFS, but exception occurs during deserializing: [image: image.png] Do you have any insight on this? Thanks, Qingxiang Ma

Re: Flink CLI does not return after submitting yarn job in detached mode

Hi, Madhav, > ./flink-1.4.2/bin/flink run -m yarn-cluster *-yd* -yn 2 -yqu "default" > -ytm 2048 myjar.jar Modified to, ./flink-1.4.2/bin/flink run -m yarn-cluster -*d* -yn 2 -yqu "default" -ytm 2048 myjar.jar [image: image.png] madhav Kelkar 于2018年8月16日周四 上午5:01写道： > Hi there, > >

checkpoint always fails

Hi, all: flink job can run normally, but checkpoint always fails, like this: [image: image.png] [image: image.png] checkpoint configuration: [image: image.png] thanks.

RocksDB state backend Checkpointing Failed

Hi,all: Checkpoint always fails, like this: https://jira.apache.org/jira/browse/FLINK-9945 [image: image.png] thanks.

Re: Writing stream to Hadoop

I think you can look at this comment, thanks. * Part files can be in one of three states: {@code in-progress}, {@code pending} or {@code finished}. * The reason for this is how the sink works together with the checkpointing mechanism to provide exactly-once * semantics and fault-tolerance. The pa

Re: Can't send kafka message with timestamp

Hi, I think the problem is the SerializationSchema parameter. Best, QIngxiang Ma. 2018-04-26 20:59 GMT+08:00 Alexander Smirnov : > Hi, > > > I'm creating kafka producer with timestamps enabled following instructions at > https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/connecto

Re: Using RocksDB as State Backend over a Distributed File System

Hi, I'm agree with Stefan. I think you can look at this document, given here: Apache Flink 1.4 Documentation：Checkpointing Best, Qingxiang Ma. 2018-04-26 20:00 GMT+08:00 Stefan Richter : > Hi, > >

Re: How to monitor the latency?

As far as I know, as for using the latency metric, only the JMXReporter now. FLINK-7608 may be help you. 2018-02-07 11:40 GMT+08:00 FatMouse <934336...@qq.com>: > Hello: > > I hava set the LatencyTrackingInterval as 2000,but int the `Task Me

Re: some question about isChainable

use it's not incorrect to > check these. Also, in fact I think you could have "forward" with differing > parallelism in some earlier versions which would lead to some unexpected > results. Not sure if that is still possible now. > > > On 24. Jan 2018, at 09:50, Mar

some question about isChainable

Hi all: We all know that the conditions for chaining are 9, like this: [image: 内嵌图片 1] However, I have a question about 2, 3, 8 in the figure above. As far as I know, the operator cannot be null, and If the partitioner of the edge is forward, then their parallelism must be the same. Maybe I'm comp

Re: Using latency markers

t a new feature to > provide more functionality for user to use metric system. > > Regards, > Tony Wei > > 2017-12-26 18:23 GMT+08:00 Marvin777 : > >> Hi, >> >> I just want to say we're having the same issues. Using latency markers >> <http:

Re: Using latency markers

Hi all! I'm having the same issues. I get NaN in the Task metrics. The version is 1.3.1. Maybe I'm completely missing something... There are questions about FLINK-7692, it can Solve the problem above? What should I do in my version. Thanks! 2017-10-11 23:30 GMT+08:00 Aljoscha Krettek : > This

Re: The timing operation is similar to storm’s tick

thanks. 2017-12-11 17:51 GMT+08:00 Fabian Hueske : > Hi, > > I think you are looking for a ProcessFunction with timers [1]. > > Best, > Fabian > > [1] https://ci.apache.org/projects/flink/flink-docs- > release-1.3/dev/stream/process_function.html > > 20

The timing operation is similar to storm’s tick

hi, I'm new to apache Flink. I want to update the property value per minute via an HTTP request.I did this in storm using tick tuple. Does Flink have something similar which i can use in a flink operator? thanks.