Re: Flink 1.12

a#L53 > > <https://github.com/apache/flink/blob/5f7e0dc96547fdb2f82f903ee48bf43b47ca4ae0/flink-kubernetes/src/main/java/org/apache/flink/kubernetes/highavailability/KubernetesStateHandleStore.java#L53> > > > Best, > Yang > > Boris Lublinsky <mailto:boris.lublin...@lightbend.com&

Re: Flink 1.12

t; deployment. If the HA ConfigMaps > are deleted, then when you create a Flink cluster with the same cluster-id, > it could not recover from the latest > successful checkpoint automatically. > > Best, > Yang > > > > > Boris Lublinsky <mailto:boris.lublin...

Re: Flink 1.12

-1.12/deployment/ha/kubernetes_ha.html > > <https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/ha/kubernetes_ha.html> > > Best, > Yang > > Boris Lublinsky <mailto:boris.lublin...@lightbend.com>> 于2020年12月18日周五 上午7:16写道： > And K8 native

Re: Flink 1.12

orage. > > [1]. https://issues.apache.org/jira/browse/FLINK-20664 > <https://issues.apache.org/jira/browse/FLINK-20664> > [2]. > https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/ha/kubernetes_ha.html > > <https://ci.apache.org/projects/flink/

Re: Flink 1.12

will find > that the leader switches multiple times and your job also restarts multiple > times. I am not sure why you need to roll the JobManager deployment. We are > using deployment for JobManager in Flink just because we want the JobManager > to be launched once it crashed. Anothe

Re: Flink 1.12

why you need to roll the JobManager deployment. We are > using deployment for JobManager in Flink just because we want the JobManager > to be launched once it crashed. Another reason for multiple JobManagers is to > get a faster recovery. > > > Best, > Yang

Re: Flink 1.12

o (because it is already released!). We are not sure yet > whether we can get the PR accepted and defer further changes to 1.12.1 . > > On 12/15/2020 5:17 PM, Boris Lublinsky wrote: >> Thanks. >> Do you have ETA for docker images? >> >> >>> On Dec 1

Re: Flink 1.12

nfigure the 3 listed options; the > documentation also contains an example configuration > <https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/ha/kubernetes_ha.html#example-configuration>. > > On 12/14/2020 4:52 AM, Boris Lublinsky wrote: >> It is gr

Flink 1.12

It is great that Flink 1.12 is out. Several questions: 1. Is official Flink 1.12 distribution https://flink.apache.org/downloads.html specifies Scala versions, but not Java versions. Is it Java 8? 2. I do not see any 1.12 docker images here https://hub.d

Re: Native kubernetes setup

> > <https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/#local-file-system> > > Best, > Yang > > > Boris Lublinsky <mailto:boris.lublin...@lightbend.com>> 于2020年11月4日周三 上午2:42写道： > Thanks a lot, > This helped a lot. > A

Re: Native kubernetes setup

have > a shared base config, and specify the special options on the command-line > (see 2)). But if you truly need a separate file, then I don't think there is > another way than the one you described. > 4) yes, the configuration is stored as a config map. > > On 11/3/2020

Native kubernetes setup

Hi, I was trying to follow instructions https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/native_kubernetes.html but non e of them really worked. For session I tried: /Users/bori

Re: Flink checkpointing state

HA support of > k8s which targets for release-1.12. > > [1] https://issues.apache.org/jira/browse/FLINK-12884 > <https://issues.apache.org/jira/browse/FLINK-12884> > > Best > Yun Tang > > From: Boris Lublinsky > Sent: Tuesday, October 27, 2020 2:56 >

Flink checkpointing state

This is from Flink 1.8: "Job Manager keeps some state related to checkpointing in it’s memory. This state would be lost on Job Manager crashes, which is why this state is persisted in ZooKeeper. This means that even though there is no real need for the leader election and -discovery part of Fli

Re: Flink checkpointing with Azure block storage

ey" > ) > FileSystem.initialize(conf) // this ensures the AzureFS is initialized > and with correct creds > } > // other checkpoint config stuff > } > > -- Piyush > > > From: Boris Lublinsky > Date: Saturday, August 22, 2020 at 10:08 PM > To: Y

Re: Flink checkpointing with Azure block storage

;https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/azure.html#credentials-configuration> > > Best > Yun Tang > > From: Boris Lublinsky > Sent: Friday, August 21, 2020 7:18 > To: user > Subject: Re: Flink checkpointing with Azure block storage > >

Re: Flink checkpointing with Azure block storage

.EmbeddedLeaderService - Proposing leadership to contender akka://flink/user/rpc/jobmanager_3 > On Aug 20, 2020, at 5:14 PM, Boris Lublinsky > wrote: > > Is there somewhere a complete configuration example for such option?

Flink checkpointing with Azure block storage

Is there somewhere a complete configuration example for such option?

Re: Stateful functions Harness

connectors.html> > On Wed, May 27, 2020 at 1:08 PM Boris Lublinsky > mailto:boris.lublin...@lightbend.com>> wrote: > Thats not exactly the usage question that I am asking > When I am writing IO module I have to write Ingress and Egress spec. > You have an example for Kaf

Re: Stateful functions Harness

le/flink-connectors.html > > <https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.0/io-module/flink-connectors.html> > On Wed, May 27, 2020 at 1:08 PM Boris Lublinsky > mailto:boris.lublin...@lightbend.com>> wrote: > Thats not exactly the usage question th

Re: Stateful functions Harness

.withKafkaAddress(kafkaAddress) .withSerializer(classOf[GreetKafkaSerializer]) .build How is it going to look if I am using SourceSinkModule? Do I just specify stream names? Something else? > On May 27, 2020, at 11:29 AM, Tzu-Li (Gordon) Tai wrote: > > > > On Thu, May

Re: Stateful functions Harness

gt; On May 27, 2020, at 11:29 AM, Tzu-Li (Gordon) Tai wrote: > > > > On Thu, May 28, 2020, 12:19 AM Boris Lublinsky <mailto:boris.lublin...@lightbend.com>> wrote: > I think I figured this out. > The project seems to be missing > > resources > <https://gith

Re: Stateful functions Harness

e when you right click on the statefun-flink-harness-example > directory (in the IDE) --> Open Module Settings, and then under the "Sources" > / "Dependencies" tab? > Usually this should all be automatically setup correctly when importing the > project. > >

Re: Stateful functions Harness

such as the > parent first classloading config. > > Otherwise, if you would like to add your own configuration, use the > `withConfiguration` method on the `Harness` class. > > On Fri, May 22, 2020 at 7:19 AM Boris Lublinsky > mailto:boris.lublin...@lightbend.com>> w

Re: Stateful functions Harness

s? > The Harness should already have the required configurations, such as the > parent first classloading config. > > Otherwise, if you would like to add your own configuration, use the > `withConfiguration` method on the `Harness` class. > > On Fri, May 22, 2020 at 7:19 AM

Re: Stateful functions Harness

ed configurations, such as the > parent first classloading config. > > Otherwise, if you would like to add your own configuration, use the > `withConfiguration` method on the `Harness` class. > > On Fri, May 22, 2020 at 7:19 AM Boris Lublinsky > mailto:boris.lublin...@lightbend

Re: Stateful functions Harness

Also, where do I put flint-conf.yaml in Idea to add additional required config parameter: classloader.parent-first-patterns.additional: org.apache.flink.statefun;org.apache.kafka;com.google.protobuf > On May 21, 2020, at 12:22 PM, Boris Lublinsky > wrote: > > Hi, > I a

Stateful functions Harness

Hi, I am trying to run https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-greeter-example locally using https://github.com/apache/flink-statefun/tree/master/statefun-

Re: Controlling the amount of checkpoint files

So if you have externalized checkpoints, they are never purged? The issue is that if your state size is rather large, this seems to be the only option. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jun 15, 2019, at 3:39 AM, Robert Metzger wr

Re: Flink job server with HA

And it works now. My mistake Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jun 3, 2019, at 10:18 PM, Xintong Song wrote: > > If that is the case, then I would suggest you to check the following two > things: > 1. Is the HA mode conf

Re: Flink job server with HA

I am running on k8 Job master runs as a deployment of 1, so just killing a pod restarts it Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jun 3, 2019, at 9:46 PM, Xintong Song wrote: > > So here are my questions: > 1. What environmen

Re: Flink job server with HA

can see that checkpoints are stored correctly, but they are never accessed. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jun 3, 2019, at 9:23 PM, Xintong Song wrote: > > Hi Boris, > > I think what you described that putJobGraph is

Controlling the amount of checkpoint files

Is there a way to limit the amount of checkpoint file? The parameter that I set : state.checkpoints.num-retained: 5 does not seem to have any effect. Is there anything else I can set to prevent infinite growth of checkpointing info? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com

Flink job server with HA

Master, it finds no running jobs and is not trying to restore it. Am I missing something? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Building Flink distribution with Scala2.12

Thanks Martijn, this was it. It would be nice to have this in documentation. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On May 29, 2019, at 5:02 AM, Visser, M.J.H. (Martijn) > wrote: > > Hi Boris, > > I believe you have to ch

Building Flink distribution with Scala2.12

DskipTests Works fine Am I doing something wrong? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Job cluster and HA

previous one was restored? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On May 25, 2019, at 2:45 AM, bastien dine wrote: > > Hello Boris, > > I think you are confused by the name of the shell script "standalone-job.sh" > W

Job cluster and HA

job and bypassing checkpoint restore. Am I missing something here? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Checkpointing and save pointing

checkpointing location. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On May 10, 2019, at 2:47 AM, Fabian Hueske wrote: > > Hi Boris, > > Is your question is in the context of replacing Zookeeper by a different > service for highl

Checkpointing and save pointing

I am planning to use external volume for this. My understanding is that it needs to be mounted only to the job manager, not the task managers. Is this correct, or it needs to be mounted to both? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Queryable state support in Flink 1.9

Thanks thats it. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Apr 16, 2019, at 8:31 AM, Guowei Ma wrote: > > AbstractQueryableStateTestBase

Re: Queryable state support in Flink 1.9

Thanks Guowei The questions that I am asking is slightly different: 1. Does Mini cluster support queryable state? 2. If the answer is yes, how to set it up? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Apr 15, 2019, at 12:07 AM, Guowei Ma wr

Queryable state support in Flink 1.9

t works with the old FlinkLocalMiniCluster, but not with the MiniCluster Am I missing something? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: HA and zookeeper

-apache-flink-on-kubernetes/?gh_src=4n3gxh1 <https://jobs.zalando.com/tech/blog/running-apache-flink-on-kubernetes/?gh_src=4n3gxh1> Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Apr 8, 2019, at 10:29 AM, Fabian Hueske wrote: >

HA and zookeeper

For HA implementation, is zookeeper is used only for leader selection, or it also stores some data relevant for switching to backup server Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Jira issue Flink-11127

org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:884) at java.lang.Thread.run(Thread.java:748) Boris Lublinsky FDP Architect

Re: Starting Flink cluster and running a job

] [info] | | [info] | +-org.typelevel:machinist_2.11:0.6.1 [S] [info] | +-org.scala-lang:scala-reflect:2.11.12 [S] [info] | [info] +-org.typelevel:machinist_2.11:0.6.1 [S] [info] +-org.scala-lang:scala-reflect:2.11.12 [S] [info] Boris Lublinsky FDP Architect

Re: Jira issue Flink-11127

And Job manager service apiVersion: v1 kind: Service metadata: name: {{ template "fullname" . }}-jobmanager spec: ports: - name: rpc port: 6123 - name: blob port: 6124 - name: ui port: 8081 selector: app: {{ template "fullname" . }} component:

Re: Jira issue Flink-11127

Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Feb 21, 2019, at 2:05 AM, Konstantin Knauf > wrote: > > Hi Boris, > > the exact command depends on the docker-entrypoint.sh script and the image > you are using. For the exa

Re: Jira issue Flink-11127

r- Could not resolve ResourceManager address akka.tcp://flink@crabby-kudu-fdp-flink-jobmanager-service:6123/user/resourcemanager, retrying in 1 ms: Ask timed out on [ActorSelection[Anchor(akka.tcp://flink@crabby-kudu-fdp-flink-jobmanager-service:6123/), Path(/user/resourcemanager)

Re: Starting Flink cluster and running a job

ala" % flinkVersion % "provided" val flinkKafka= "org.apache.flink" %% "flink-connector-kafka" % flinkVersion exclude("org.slf4j", "slf4j-log4j12") I am using SBT I tried both connector-kafk

Re: Starting Flink cluster and running a job

atest kaffka-connector And Kafka-connector-011 Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Feb 19, 2019, at 7:02 PM, Ken Krugler wrote: > > Hi Boris, > > I haven’t seen this exact error, but I have seen similar errors caused by > mu

Re: Jira issue Flink-11127

.0.11.151 ip-10-0-11-151.us-west-2.compute.internal nslookup: can't resolve 'flink-taskmanager-0' / # So the name should be postfixed with the service name. How do I force it? I suspect I am missing config parameter Boris Lublinsky FDP Architect boris.lublin...@lightbend.com ht

Re: Starting Flink cluster and running a job

Thanks Ken, That was my first instinct as well, but.. To run on the cluster I am building an uber jar for which I am fixing Kafka clients jar version I am also fixing version of Kafka So I do not know where another version can get from Boris Lublinsky FDP Architect boris.lublin...@lightbend.com

Re: Jira issue Flink-11127

: exec: taskmanager -Dtaskmanager.host=10.131.0.97: not found Did I misunderstood your instructions? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Feb 19, 2019, at 4:33 AM, Konstantin Knauf > wrote: > > Hi Boris, > > the so

Re: Starting Flink cluster and running a job

estion? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Feb 19, 2019, at 4:50 AM, Konstantin Knauf > wrote: > > Hi Boris, > > without looking at the entrypoint in much detail, generally there should not > be a race cond

Starting Flink cluster and running a job

Following https://github.com/apache/flink/tree/release-1.7/flink-container/docker I have created an entry point, which looks like follows: #!/bin/sh #

Jira issue Flink-11127

e full chart Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Changes in Flink 1.6.2

It does, weird Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Nov 30, 2018, at 8:56 AM, Dawid Wysakowicz wrote: > > Hi Boris, > > I am not a scala expert, so I won't be able explain the root cause > completely, but it is b

Re: Changes in Flink 1.6.2

Dominik, Any feedback on this? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Nov 28, 2018, at 2:56 PM, Boris Lublinsky > wrote: > > Here is the code > > def executeLocal() : Un

Re: Changes in Flink 1.6.2

tln("[info] Job ID: " + env.getStreamGraph.getJobGraph.getJobID) Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Nov 28, 2018, at 2:47 PM, Dominik Wosiński wrote: > > Hey, > Could you show the message that You are getting? > Be

Changes in Flink 1.6.2

Prior to Flink version 1.6.2 including 1.6.1 env.getStreamGraph.getJobGraph was happily returning currently defined Graph, but in 1.6.2 this fails to compile with a pretty cryptic message AM I missing something? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https

Re: Usage of "onTime" in ProcessFunction

memory, so that I can ignore the late arrivals Now I can have several start requests for times 45, 50, and 52. If my trout is ten, I have timers for 55, 60 and 62. Will all of them fire at these time intervals assuming that timer’s processing time is 0? Boris Lublinsky FDP Architect

Usage of "onTime" in ProcessFunction

ctx.timerService.registerEventTimeTimer(currentTime + speculativeTimeout.value()) Basically the absolute cut off time. Is this the right usage? What is happening when I have more then on timer started? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Using Managed Keyed State

antics seems to be different. In my tests ValueState is associated with key, but it is not clear to me what List is associated it. I tried to test List[String] and ValueState[ModelBuffer[String]] and they behave very differently. Can you, please clarify the differences and usage patterns?

MapState Initializion

Any response to this? List State is created using checkpointedState = context.getOperatorStateStore.getListState (checkPointDescriptor) But there is no similar APIs for MapState Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > Begin forwarded mess

Re: Questions about managed operator state

Thanks Fabian, After I switched to var it compiles, but its not initialized. @transient private var currentModels : MapState[String, Model] = _ Assignes null to MapState. Do I create an empty hashMap there? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com

Questions about managed operator state

holder parameter private val newModels : MapState[String, Model] = _ Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Keyed State

? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 13, 2018, at 11:06 AM, Fabian Hueske wrote: > > Yes, that is correct. > You can treat keyed ValueState like a distributed hashmap and Flink routes > all state accesses to the entry

Re: Keyed State

Thanks Fabian Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 13, 2018, at 11:06 AM, Fabian Hueske wrote: > > Yes, that is correct. > You can treat keyed ValueState like a distributed hashmap and Flink routes > all state access

Keyed State

key is maintained by Flink and in my code I do not need to worry about a key value. In my code I can use ValueState and assume that Flink will keep track of it on per key fashion. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: user Digest 11 Jan 2018 11:24:06 -0000 Issue 2610

PI classes. If you > want to use the Java API you should not use > "org.apache.flink.streaming.api.scala.DataStream" but the Java one. I rewrote the class in Java. Thats why I am so confused Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Java types

between APIs? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 10, 2018, at 6:20 PM, Boris Lublinsky > wrote: > > I am trying to covert Scala code (which works fine) to Java > The sacral code is: > // create a Kafka consu

Java types

java? Now if this is an only way, Does this seems right? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Queryable State in Flink 1.4

Thanks This was it. It would help to have this in documentation along with `flink-queryable-state-client` Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 5, 2018, at 11:46 AM, Till Rohrmann wrote: > > Did you add the `flink-querya

Re: Queryable State in Flink 1.4

I also tried to comment out //config.setInteger(ConfigConstants.LOCAL_NUMBER_TASK_MANAGER, 2); Still no luck. Do you guys have a working example for queryable state for 1.4 somewhere? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 5, 2018,

Re: Queryable State in Flink 1.4

still shows nothing Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jan 5, 2018, at 6:33 AM, Till Rohrmann wrote: > > Hi Boris, > > if you start 2 TaskManagers on the same host, then you have to define a port > range for the KvState ser

Queryable State in Flink 1.4

It appears, that queryable state access significantly changed in 1.4 compared to 1.3.Documentation on the queryable state client https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/state/queryable_state.html#exampleStates that the client needs to connect to a proxy port.My implem

Re: Custom Kryo serializer

Thanks Chesney, Can you, please, point me to any example? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > On Jul 24, 2017, at 9:27 AM, Chesnay Schepler wrote: > > Copy of a mail i sent to the user mailing list only: > > Raw state can on

Custom Kryo serializer

Is there a chance, this can be answered? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > Begin forwarded message: > > From: Boris Lublinsky > Subject: Re: Custom Kryo serializer > Date: July 19, 2017 at 8:28:16 AM CDT > To: user@flin

Flink Beam runner

Current runner for Beam 2.0.0 is still on Scala version 2.10. Are there any plans (and dates) to provide runner for Scala 2.11 Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Re: Custom Kryo serializer

d sees only the raw bytes.” So I was assuming that I need to provide serializer for this. Am I missing something? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/ > > -- Forwarded message -- > From: Chesnay Schepler mailto:che

Custom Kryo serializer

messages at the output console, but I never hist a break point in serializer. Any suggestions? Boris Lublinsky FDP Architect boris.lublin...@lightbend.com https://www.lightbend.com/

Executing Flink server From IntelliJ

topped BLOB server at 0.0.0.0:54319 08:42:30,434 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /var/folders/3m/52z04fgs3hq88mzft9l0fsrmgn/T/flink-io-9ec461ff-086d-45cd-b69c-e9890217d8fc Process finished with exit code 0 Any

Re: user Digest 2 Feb 2017 14:54:03 -0000 Issue 1703

Is KafkaIO supported on Flink Runner? I see the code in Github, but it is not part of .4 libraries > On Feb 2, 2017, at 8:54 AM, user-digest-h...@flink.apache.org wrote: > > > Have a look at > https://github.com/apache/beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/ka

FlinkKafkaProducer usage

I am trying to write a quick sample of streaming word count using Beam APIs and FlinkBeamRunner. The problem that I am getting into is that apply("Write to Kafka", Write.to(UnboundedFlinkSink.of(kafkaSink))) Does not work in this way - it assumes bounded stream and mine is unbounded. I have not