Hi, First of all, what Flink versions are you using?
You are right it is a mistake in the documentation of the sink.bulk-flush.max-actions. It should say: Can be set to |'-1'| to disable it. I created a ticket[1] to track that. And as far as I can tell and I quickly checked that it should work. As for the sink.bulk-flush.max-size you should be able to disable it with a value of '0'. Could you share with us how do you use the connector? Could you also share the full stack trace for the exception you're getting? Are you creating the table with a CREATE statement? Best, Dawid [1] https://issues.apache.org/jira/browse/FLINK-20979 On 13/01/2021 20:10, Rex Fenley wrote: > Hello, > > It doesn't seem like we can disable max actions and max size for > Elasticsearch connector. > > Docs: > https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/elasticsearch.html#sink-bulk-flush-max-actions > > > sink.bulk-flush.max-actions > > optional 1000 Integer Maximum number of buffered > actions per bulk > request. Can be set to |'0'| to disable it. > > > sink.bulk-flush.max-size > > optional 2mb MemorySize Maximum size in memory of > buffered actions > per bulk request. Must be in MB granularity. Can be set to |'0'| to > disable it. > > Reality: > > org.apache.flink.client.program.ProgramInvocationException: The main > method caused an error: Max number of buffered actions must be larger > than 0. > > ES code looks like -1 is actually the value for disabling, but when I > use -1: > Caused by: java.lang.IllegalArgumentException: Could not parse value > '-1' for key 'sink.bulk-flush.max-size'. > > How can I disable these two settings? > > Thanks! > > -- > > Rex Fenley | Software Engineer - Mobile and Backend > > > Remind.com <https://www.remind.com/>| BLOG > <http://blog.remind.com/> | FOLLOW US > <https://twitter.com/remindhq> | LIKE US > <https://www.facebook.com/remindhq> >
signature.asc
Description: OpenPGP digital signature
