Stephan Ewen created FLINK-2706:
-----------------------------------
Summary: Add support for streaming RollingFileSink to truncate /
append on UNIX file systems
Key: FLINK-2706
URL: https://issues.apache.org/jira/browse/FLINK-2706
Project: Flink
Issue Type: Improvement
Components: Streaming Connectors
Affects Versions: 0.10
Reporter: Stephan Ewen
Efficient exactly-once behavior needs the filesystem to support appending and
truncating files.
Since the UNIX file system API allows to append files and truncate files, we
can support perfect exactly-once behavior efficiently on all file systems that
expose a UNIX / POSIX-style interface (local FS, NFS, MapR FS).
Without this support, only Hadoop 2.7+ versions support proper exactly once
behavior.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
