Yep, that was the problem.
Thanks!
On Mon, Apr 18, 2016 at 11:36 AM, Aljoscha Krettek
wrote:
> Hi,
> could it be that your state is very small? In that case the state is not
> actually stored in HDFS but on the job manager because writing it to HDFS
> and storing a handle to that in the JobMana
Hi,
could it be that your state is very small? In that case the state is not
actually stored in HDFS but on the job manager because writing it to HDFS
and storing a handle to that in the JobManager would be more expensive.
Cheers,
Aljoscha
On Mon, 18 Apr 2016 at 17:20 Jason Brelloch wrote:
> Hi
Hi everyone,
I am trying to set up flink with a hdfs state backend. I configured
state.backend and state.backend.fs.checkpointdir parameters in the
flink-conf.yaml. I run the flink task and the checkpoint directories are
created in hdfs, so it appears it can connect and talk to hdfs just fine.
U
