Is it reasonable to use Flink in a local machine

Hi, My purpose is to generate data in a process and process those data in another process, something like stream processing, but all done in just one node, not cluster! The rate of generating data is 12000 sample per second. I want the processing phase to done in parallel, So as Flink use node CP

Re: Is it reasonable to use Flink in a local machine

Hi, Soheil You can set up several taskmanager processes in one node. I think it is reasonable to use Flink like this if you do not have enough machines. Generate data we can think it is source operator and you can set the parallelism for this operator. Process to those data we can think, like

Re: Simple stdout sink for testing Table API?

Thanks Hequn! -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink 1.5 Yarn Connection unexpectedly closed

Great to hear that you could solve your problem Garrett. What happens when you call `collect` is that Flink will send the job which has been defined up to this point to the cluster in order to execute it and it waits until it retrieved the result. Once the result has been obtained, the Flink progra

How to partition within same physical node in Flink

Hi, Need to partition by cameraWithCube.getCam() 1st using parallelCamTasks(passed in as args). Then within each partition, need to partition again by cameraWithCube.getTs() but need to make sure each of the 2nd partition by getTS() runs on the same physical node ? How do I achieve that ? DataS

Some doubts related to Rocksdb state backed and checkpointing!

Hi, We are using flink1.3.2 and trying to explore rocksdb state backend and checkpointing. Data source is Kafka and checkpointing enabled in Flink. We have few doubts regarding the same: - What is the exact difference between checkpoint and state backend? - Is the data stored in rocksdb che

Re: Some doubts related to Rocksdb state backed and checkpointing!

Hi，Ashwin > What is the exact difference between checkpoint and state backend? Ans: I can answer the first question you asked. Checkpoint is a mechanism that can make your program fault tolerant. Flink uses distributed snapshots implements checkpoint. But here is the question, where do I to s

Re: [DISCUSS] Flink 1.6 features

Hi, Community By the way, there is a very important feature I think it should be. Currently, the BucketingSink does not support when a bucket is ready for user use. This situation will be very obvious when flink work with offline end. We called that real time/offline integration in business. In

CEP: Different consuming strategies within a pattern

Hi, I'm trying to detect a sequence like A followed by B, C, D. i.e. there is no strict contiguity between A and B, but strict contiguity between B, C and D. Sample test case: https://gist.github.com/jainshailesh/57832683fb5137bd306e4844abd9ef86 testStrictFollowedByRelaxedContiguity passes, but

Re: Some doubts related to Rocksdb state backed and checkpointing!

Hi Ashwin, I think the questions here might be a bit general and that could make it a bit hard to offer the answer meet your expected exactly, could you please somehow bref outlined your user case here to accossiated with questions, that would definitely make it easier to offer a better help