I have checkpoints setup against s3 using the hadoop plugin. (I'll
migrate to presto at some point) I've setup entropy injection per the
documentation with

state.checkpoints.dir: s3://my-bucket/_entropy_/my-job/checkpoints
s3.entropy.key: _entropy_

I'm seeing some behavior that I don't quite understand.

1. The folder s3://my-bucket/_entropy_/my-job/checkpoints/...
literally exists. Meaning that "_entropy_" has not been replaced. At
the same time there are also a bunch of folders where "_entropy_" has
been replaced. Is that to be expected? If so, would someone elaborate
on why this is happening?

2. Should the paths in the checkpoints history tab in the FlinkUI
display the path the key? With the current setup it is not.

Thanks,
Aeden

GitHub: https://github.com/aedenj
Linked In: http://www.linkedin.com/in/aedenjameson

Reply via email to