Thank you,
looks like shuffle() works
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi Fabian,
Thank you for your answer. I've updated the flink version to 1.12.4 but
unfortunately the problem still persists.
I'm running this job in local mode, so I have only following log:
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by
org.a
Hi Taras,
On first glance this looks like a bug to me. Can you try the latest 1.12
version (1.12.4)?
If the bug still persists can you share the full job manager and task manager
logs to
further debug this problem.
Best,
Fabian
> On 2. Jun 2021, at 13:22, Taras Moisiuk wrote:
>
> Update:
>
Update:
The job is working correctly if add an additional identity mapping step:
env.createInput(parquetInputFormat)
.map(record => record)
.sinkTo(FileSink.forBulkFormat...)
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi,
I'm trying to read parquet file with Flink 1.12.0 Scala API and save it as
another parquet file.
Now it's working correctly with ParquetRowInputFormat:
val inputPath: String = ...
val messageType: MessageType = ...
val parquetInputFormat = new ParquetRowInputFormat(new Path(inputPath),
mess
