Re: TypeInfo issue with Avro SpecificRecord

2021-06-15 Thread Patrick Lucas
idered a bug, but I'll leave a comment on the above issue. -- Patrick Lucas On Mon, Jun 14, 2021 at 5:06 PM Patrick Lucas wrote: > Hi, > > I have read [1] when it comes to using Avro for serialization, but I'm > stuck with a mysterious exception when Flink is doing type resolut

TypeInfo issue with Avro SpecificRecord

2021-06-14 Thread Patrick Lucas
Hi, I have read [1] when it comes to using Avro for serialization, but I'm stuck with a mysterious exception when Flink is doing type resolution. (Flink 1.13.1) Basically, I'm able to use a SpecificRecord type in my source, but I am unable to use different SpecificRecord types later in the pipeli

Re: [ANNOUNCE] Apache Flink 1.8.0 released

2019-04-12 Thread Patrick Lucas
The Docker images for 1.8.0 are now available. Note that like Flink itself, starting with Flink 1.8 we are no longer providing images with bundled Hadoop. Users who need an image with bundled Hadoop should create their own, starting from the images published on Docker Hub and fetching the appropri

Re: Should multiple apache flink task managers have strong identity? Also, should I point their state.checkpoints.dir to the same HDFS?

2018-01-24 Thread Patrick Lucas
e same for all jobmanagers and taskmanagers. All members of the cluster need to be able to see all the data, and Flink ensures that things are written to the correct subpath. -- Patrick Lucas On Mon, Jan 22, 2018 at 7:23 PM, Felipe Cavalcanti wrote: > Hi, > > I'm deploying flin

Re: Docker and AWS taskmanager configuration

2017-11-21 Thread Patrick Lucas
kmanager—then they should all be able to discover, address, and communicate with each other with no problems. -- Patrick Lucas On Tue, Nov 21, 2017 at 6:44 AM, Colin Williams < colin.williams.seat...@gmail.com> wrote: > Hi, > > We noticed that we couldn't parallelize our flink

Re: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated for S3 access

2017-10-11 Thread Patrick Lucas
search for "javax.net.ssl.SSLPeerUnverifiedException aws" yielded a number of results—have you checked those out? -- Patrick Lucas On Wed, Oct 4, 2017 at 5:25 PM, Hao Sun wrote: > Here is what my docker file says: > > ENV FLINK_VERSION=1.3.2 \ > HADOOP_VERSION=27 \ &g

Re: TM get killed/disconnected after a while

2017-10-09 Thread Patrick Lucas
exited? -- Patrick Lucas On Fri, Oct 6, 2017 at 8:16 PM, Hao Sun wrote: > Hi, I am running Flink 1.3.2 on kubernetes, I am not sure why sometime one > of my TM is killed, is there a way to debug this? Thanks > > = Logs > > *2017-10-05

Re: Docker PID 1

2017-04-13 Thread Patrick Lucas
I concur with Nico. We're actively working on improving Flink-on-Docker, and this is a valid concern. -- Patrick Lucas On Tue, Apr 11, 2017 at 11:01 AM, Nico Kruber wrote: > Hi Kat, > yes, this looks like it may be an issue, please create the Jira ticket. > > Some background:

Re: deploying flink in AWS - some teething issues

2017-03-30 Thread Patrick Lucas
I think Log4j includes a Syslog appender—the log4j config included with Flink just logs to the logs/ dir, but you should just be able to modify it (log4j.properties) to suit your needs. -- Patrick Lucas On Thu, Mar 30, 2017 at 2:39 PM, Chakravarthy varaga < chakravarth...@gmail.com> wrote:

Re: deploying flink in AWS - some teething issues

2017-03-29 Thread Patrick Lucas
the job's metrics from outside the Flink cluster. -- Patrick Lucas On Wed, Mar 29, 2017 at 10:58 AM, Chakravarthy varaga < chakravarth...@gmail.com> wrote: > Hi, > > Any updates here? I'm sure many would have faced similar issues like > these, any help here is high