Re: Python statefun - Context update

2021-09-21 Thread Nicolaus Weidner
Hi Jérémy, objects are serialized when you store them in state. So when you retrieve run_state from state, it is deserialized and you have a fresh instance. Calling method_caller() then modifies this instance, but *not *the serialized version stored in state. In the second attempt you described, y

Re: Built-in functions to manipulate MULTISET type

2021-09-21 Thread Francesco Guardiani
Hi, for type strategies you can check out org.apache.flink.table.types.inference.InputTypeStrategies. They are pretty extensive and widely covers most use cases. In your case, this function probably requires the COMMON type strategy. If you want to roll out your own type inference, look at the org.

S3 access permission error

2021-09-21 Thread Dhiru
flink image I have added both s3 plugin FROM flink:1.11.3-scala_2.12-java11RUN mkdir ./plugins/flink-s3-fs-prestoRUN cp ./opt/flink-s3-fs-presto-1.11.3.jar  ./plugins/flink-s3-fs-presto/RUN mkdir ./plugins/flink-s3-fs-hadoopRUN cp ./opt/flink-s3-fs-hadoop-1.11.3.jar  ./plugins/flink-s3-fs-hadoop

Re: S3 access permission error

2021-09-21 Thread Dhiru
i see org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2326) plugin is not able to create folder , not sure if I need to change something Whereas when We are trying to pass from the local laptop and passing  aws credentails its able to create a folder and running as expected  On Wedn

Re: S3 access permission error

2021-09-21 Thread Yangze Guo
You might need to configure the access credential. [1] [1] https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/filesystems/s3/#configure-access-credentials Best, Yangze Guo On Wed, Sep 22, 2021 at 2:17 PM Dhiru wrote: > > > i see org.apache.hadoop.fs.FileSystem.mkdirs(FileSy