Cannot configure akka.ask.timeout

2018-07-13 Thread Lukas Kircher
Hello, I have problems setting configuration parameters for Akka in Flink 1.5.0. When I run a job I get the exception listed below which states that Akka timed out after 1ms. I tried to increase the timeout by following the Flink configuration documentation. Specifically I did the following

Re: Cannot configure akka.ask.timeout

2018-07-17 Thread Lukas Kircher
or to this. akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher8df05371-effc-468b-8a22-e2f364f65d6a#582308583 ]] after [1 ms] Best regards, Lukas > On 13. Jul 2018, at 12:24, Lukas Kircher wrote: > > Hello, > > I have problems setting con

Re: Cannot configure akka.ask.timeout

2018-07-20 Thread Lukas Kircher
om/apache/flink/blob/749dd29935f319b062051141e150eed7a1a5f298/flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java#L185> > > On Fri, Jul 13, 2018 at 12:24 PM, Lukas Kircher <mailto:lukaskirch...@gmail.com>> wrote: > Hello, > > I have problem

Recursive directory traversal with TextInputFormat

2016-12-07 Thread Lukas Kircher
Hi all, I am trying to read nested .csv files from a directory and want to switch from a custom SourceFunction I implemented to the TextInputFormat. I have two questions: 1) Somehow only the file in the root directory is processed, nested files are skipped. What am I missing? See the attachmen

Re: Recursive directory traversal with TextInputFormat

2016-12-07 Thread Lukas Kircher
is class also provides a > InflaterInputStreamFactory to read compressed data. > > Best, > Stefan > >> Am 07.12.2016 um 12:10 schrieb Lukas Kircher > <mailto:lukas.kirc...@uni-konstanz.de>>: >> >> Hi all, >> >> I am trying to read nested

Fwd: Continuous File monitoring not reading nested files

2017-01-09 Thread Lukas Kircher
Hi all, this is probably related to the problem that I reported in December. In case it helps you can find a self contained example below. I haven't looked deeply into the problem but it seems like the correct file splits are determined but somehow not processed. If I read from HDFS nested file

Re: Continuous File monitoring not reading nested files

2017-01-09 Thread Lukas Kircher
; If this also does not work, I think this could be a bug. You can open an >> issue for it and attach your sample code. >> >> Timo >> >> >> Am 09/01/17 um 13:47 schrieb Lukas Kircher: >>> Hi all, >>> >>> this is probably related

Akka configuration setting missing if RemoteEnvironment job is started from CLI

2017-11-16 Thread Lukas Kircher
Good morning, I have some problems using a Flink RemoteEnvironment in my Java application. If I run the following code [1] directly from the IDE it runs as expected. However, if I package a jar and run this from a CLI via `java -cp ...` I get the following error [2]. I want to use the RemoteEnv

Re: Akka configuration setting missing if RemoteEnvironment job is started from CLI

2017-11-17 Thread Lukas Kircher
public boolean filter(Integer value) throws Exception { return value == 4; } }) .print(); } } > On 16. Nov 2017, at 11:28, Lukas Kircher wrote: > > Good morning, > > I have some problems using a Flink RemoteEnvironment in my Java a

Problems reading Parquet input from HDFS

2017-04-24 Thread Lukas Kircher
Hello, I am trying to read Parquet files from HDFS and having problems. I use Avro for schema. Here is a basic example: public static void main(String[] args) throws Exception { ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); Job job = Job.getInstance(); H

Re: Problems reading Parquet input from HDFS

2017-04-25 Thread Lukas Kircher
flinktacular > <https://github.com/FelixNeutatz/parquet-flinktacular> > > Best, > Flavio > > On 24 Apr 2017 6:36 pm, "Jörn Franke" <mailto:jornfra...@gmail.com>> wrote: > Why not use a parquet only format? Not sure why you need an avtoparquetformat.

Re: Problems reading Parquet input from HDFS

2017-05-01 Thread Lukas Kircher
ample worked fine (we didn't test on the > cluster yet). > Let me know if it does help.. > > Best, > Flavio > > On Tue, Apr 25, 2017 at 1:53 PM, Lukas Kircher <mailto:lukas.kirc...@uni-konstanz.de>> wrote: > Thanks for your suggestions. > > @Flavio >