Good news!
Eliminating
bsEnv.setStateBackend(
new RocksDBStateBackend(
"s3://flink-jdbc-test_graph-minio_1/data/checkpoints:9000",
true
)
)
moving all configuration into FLINK_PROPERTIES and switching to http seemed
to do the trick!
Thanks for all the help!
On Wed, Sep 9, 2020 at 9
Thanks yall,
Yangze,
> I've tried to use MinIO as state backend and everything seems works well
For clarity, I'm using RocksDB state backend with Minio as state storage.
> s3.endpoint: http://localhost:9000
Also, I'm doing everything from docker-compose so localhost isn't going to
work in my case.
Hi Rex,
you could also check the end to end tests that use minio in flink's repo.
You definitely need to use an http endpoint.
The setup [1] uses also another way to specify the s3.path.style.access
(with dashes). I think we needed it especially for presto. It seems like
the settings differ a bit
Hi, Rex,
I've tried to use MinIO as state backend and everything seems works well.
Just sharing my configuration:
```
s3.access-key:
s3.secret-key:
s3.endpoint: http://localhost:9000
s3.path.style.access: true
state.checkpoints.dir: s3://flink/checkpoints
```
I think the problem might be caused b