Flink on Kubernetes (Minikube)

Dear all, I followed the instructions found here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/deployment/kubernetes.html Minikube version 0.31-01 Kubernetes version 1.10 Flink Docker image: flink:latest (1.7.0-scala_2.12) I ran the following commands: minikube start minikube

Re: Flink on Kubernetes (Minikube)

sed a hadoopless docker image, therefore it cannot find hadoop > dependencies. It is ok if you don't need to use any, the bolded messages > are just INFO, those are not errors. > > Best, > > Dawid > On 19/12/2018 12:58, Alexandru Gutan wrote: > > Dear all, > &

Re: Flink on Kubernetes (Minikube)

that it might be because of this minikube command > failed, but I am not a kubernetes expert. I cc Till who knows more on this. > > Best, > > Dawid > On 19/12/2018 14:16, Alexandru Gutan wrote: > > Thanks! > I'm using now the *flink:1.7.0-hadoop24-scala_2.12* image.

Re: Flink on Kubernetes (Minikube)

Got it working on the Google Cloud Platform Kubernetes service... More support for Minikube is needed. On Wed, 19 Dec 2018 at 13:44, Alexandru Gutan wrote: > I've found this in the archives: > http://mail-archives.apache.org/mod_mbox/flink-dev/201804.mbox/%3CCALbFKXr=rp9TYpD_J

Parallelism questions

Hi everyone! 1. Is there a way to increase the parallelism (e.g. through REST) of some operators in a job without re-deploying the job? I found this answer which mentions scaling at runtime on Yarn/Meso

Re: Parallelism questions

>> >> As for 1 I cc'ed Gary and Till who might better answer your question. >> >> [1] >> https://ci.apache.org/projects/flink/flink-docs-release-1.7/concepts/runtime.html#task-slots-and-resources >> >> Best, >> >> Dawid >> On 14/01/2019 1

Re: Re: How can I make HTTP requests from an Apache Flink program?

Hi Jacopo, Check this: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/stream/operators/asyncio.html Best, Alex On Tue, 15 Jan 2019 at 13:57, wrote: > Hi, > > > > I have a flink program which needs to process many messages and part of > this processing is to process the data us

Re: Parallelism questions

lelism which you have > defined for an operator. > > I agree that it should also be possible to rescale an individual operator. > There internal functionality is already implemented (see > JobMaster#rescaleOperators) but has not been exposed. > > Cheers, > Till > > On Tu

Setting flink-conf params in IDE

Hi everyone! Is there a way to set flink-conf.yaml params but when running from the IDE? What I'm trying to do is to setup JMX metrics: metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReportermetrics.reporter.jmx.port: 8789 Thanks!

Re: Table/SQL Kafka Sink Question

That's what I concluded as well after checking the docs and source code. I'm thinking to add another job using the Stream API (where it is possible), that will ingest the data resulted from by Table/SQL API job, and that will add the message key into Kafka. On 27 March 2018 at 12:55, Chesnay Sche

Re: Flink - Kafka Connector

You will be able to use it. Kafka 1.10 has backwards compatibility with v1.0, 0.11 and 0.10 connectors as far as I know. On 13 April 2018 at 15:12, Lehuede sebastien wrote: > Hi All, > > I'm very new in Flink (And on Streaming Application topic in general) so > sorry if for my newbie question. >

Re: Is Flink:1.5 Docker image broken?

Well those are unofficial, so you might raise a correspoinding issue on github (since the images are there) for that. On 31 May 2018 at 08:09, Chirag Dewan wrote: > Hi, > > flink:latest docker image doesn't seem to work. I am not able to access > the Flink Dashboard after deploying it on Kuberne

Flink AggregateFunction Help

Hello! I'm unable to see any results from .print() after performing an AggregateFunction over a timeWindow. I made a very detailed post on StackOverflow: https://stackoverflow.com/questions/45898849/flink-aggregatefunction Thank you!

Flink on DCOS on DigitalOcean

Dear all, Can somebody confirm to have successfully installed Flink on DCOS (running on DigitalOcean) ? I've raised an issue on StackOverflow but nobody has assisted me. I've described everything in detail here: https://stackoverflow.com/questions/45391980/error-installing-flink-in-dcos I depl