Hey Aaron,
thanks for reporting the issue.
You are right that the Exception is thrown during a shuffle. The receiver
initiates a TCP connection to receive all the data for the join. A failing
connect usually means that there respective TaskManager is not running.
Can you check whether all expe
Hello,
I have a process that works fine with flink 0.8.1 but I decided to test it
against 0.9.0-milestone-1. I have 12 task managers across 3 machines - so
it's a small setup.
The process fails with the following message. It appears that it's
attempting to do a shuffle in response to my join re
I use following dependencies and it works fine .
org.apache.flink
flink-java
0.9-SNAPSHOT
org.apache.flink
flink-clients
0.9-SNAPSHOT
org.apache.flink
flink-streaming-core
0.9-SNAPSHOT
org.apache.flink
flink-connector-kafka
0.9-SNAPSHOT
On Mon, Jun 22, 2015 at 10:07 PM, Hawin Jiang wrot
Hi Marton
if we received a huge data from kafka and wrote to HDFS immediately. We
should use buffer timeout based on your URL
I am not sure you have flume experience. Flume can be configured buffer
size and partition as well.
What is the partition.
For example:
I want to write 1 minute buffer
Hi Marton
I have to add whole pom.xml file or just only plugin as below.
I saw L286 to L296 are not correct information in pom.xml.
Thanks.
org.apache.maven.plugins maven-assembly-plugin 2.4 <
descriptorRefs> jar-with-dependencies
On Thu, Jun 11, 2015 at 1:43 AM, Márton Balassi
wrote:
Actually, the closure cleaner is supposed to take care of the "anonymous
inner class" situation.
Did you deactivate that one, by any chance?
On Mon, Jun 15, 2015 at 5:31 PM, Maximilian Alber <
alber.maximil...@gmail.com> wrote:
> Hi everyone!
> Thanks! It seems the variable that makes the proble
It sounds like what you want to do could also be done in the same way as
"addSource()" with a GenericInputFormat.
It would not look like a FileInputFormat to Flink, and the JobManager would
assign one generic meaningless split to each parallel instance.
Inside the input format, you could still in
The client produces logs as "sysout" messages and log messages.
You can suppress the "sysout" messages by setting
"env.getConfig().disableSysoutLogging()" in your program.
On Mon, Jun 22, 2015 at 10:55 AM, Juan Fumero <
juan.jose.fumero.alfo...@oracle.com> wrote:
> Hi Till,
>thanks for your
Hi Ventura!
Concerning (1) :
What would be good is to make the
"org.apache.flink.runtime.instance.InstanceConnectionInfo" in the
getruntimeContext()'s RuntimeContext object. In order to do that, we could
need to move that into the flink-core package. We could also rename it
simply to "ConnectionI
Hi Till,
thanks for your answer, yes I am referring to the client output. What
I want is either redirect *only* these logs or disable them.
I can not redirect the full output because I need my application output
(I am inside another compiler).
Thanks
Juan
On Fre, 2015-06-19 at 12:39 +,
10 matches
Mail list logo
