[
https://issues.apache.org/jira/browse/FLINK-18130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jingsong Lee closed FLINK-18130.
--------------------------------
Resolution: Fixed
master: 603cd830073f95d1b48cf8fa6817100ac17e1eb3
release-1.11: ab6cf4083c84bf8c04564c74f6d9f9783adf5e21
> File name conflict for different jobs in filesystem/hive sink
> -------------------------------------------------------------
>
> Key: FLINK-18130
> URL: https://issues.apache.org/jira/browse/FLINK-18130
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, Connectors / Hive
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.11.0
>
>
> The sink of different jobs (or the same SQL runs multiple times) will produce
> the same file name, the rename will fail, and different file systems will
> produce different results:
> * HadoopFileSystem: ignore new data.
> * LocalFileSystem: overwrite old data.
> We can add UUID to prefix, make sure there is no conflict between jobs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
