Hi,

Per SQL Lite doc (
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sqlclient/)
I see this:

> SQL Client Configuration
> You can configure the SQL client by setting the options below, or any
valid Flink configuration entry:

So any valid Flink configuration should work? For example,
execution.checkpointing.interval='10s' works despite not being listed there.


On Wed, Mar 16, 2022 at 3:07 PM Paul Lam <paullin3...@gmail.com> wrote:

> Hi,
>
> If I remember correctly, set operations supports only a limited set of
> configurations.
>
> Most of them are table options that are listed on table configuration [1]
> plus some pipeline options.
>
> State backend options are not likely one of them.
>
> [1]
> https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/config/
>
> Best,
> Paul Lam
>
> 2022年3月15日 19:21,dz902 <dz9...@gmail.com> 写道:
>
> Just tried editing flink-conf.yaml and it seems SQL Client does not
> respect that also. Is this an intended behavior?
>
> On Tue, Mar 15, 2022 at 7:14 PM dz902 <dz9...@gmail.com> wrote:
>
>> Hi,
>>
>> I'm using Flink 1.14 and was unable to set S3 as state backend. I tried
>> combination of:
>>
>> SET state.backend='filesystem';
>> SET state.checkpoints.dir='s3://xxx/checkpoints/';
>> SET state.backend.fs.checkpointdir='s3://xxx/checkpoints/';
>> SET state.checkpoint-storage='filesystem'
>>
>> As well as:
>>
>> SET state.backend='hashmap';
>>
>> Which covered both legacy 1.13 way to do it and 1.14 new way to do it.
>>
>> None worked. In the Web UI I see checkpoints being made to the Job
>> Manager continuously. Configuration reads:
>>
>> - Checkpoint Storage: JobManagerCheckpointStorage
>> - State Backend: HashMapStateBackend
>>
>> Is this a bug? Is there a way to set state backend to S3 using SQL Client?
>>
>> Thanks,
>> Dai
>>
>>
>>
>

Reply via email to