Hi JingsongLee,
Fantastic! We'll look into it.
Thanks,
Qi
On Fri, Sep 6, 2019 at 10:52 AM JingsongLee wrote:
> Hi luoqi:
>
> With partition support[1], I want to introduce a FileFormatSink to
> cover streaming exactly-once and partition-related logic for flink
> file connectors and hive connec
Hi luoqi:
With partition support[1], I want to introduce a FileFormatSink to
cover streaming exactly-once and partition-related logic for flink
file connectors and hive connector. You can take a look.
[1]
https://docs.google.com/document/d/15R3vZ1R_pAHcvJkRx_CWleXgl08WL3k_ZpnWSdzP7GY/edit?usp=
Hi,
I'm not sure if there's one yet. Feel free to create one if not.
On Wed, Sep 4, 2019 at 11:28 PM Qi Luo wrote:
> Hi Bowen,
>
> Thank you for the information! Streaming write to Hive is a very common
> use case for our users. Is there any open issue for this to which we can
> try contributin
Hi Bowen,
Thank you for the information! Streaming write to Hive is a very common use
case for our users. Is there any open issue for this to which we can try
contributing?
+Yufei and Chang who are also interested in this.
Thanks,
Qi
On Thu, Sep 5, 2019 at 12:16 PM Bowen Li wrote:
> Hi Qi,
>
Hi Qi,
With 1.9 out of shelf, I'm afraid not. You can make HiveTableSink
implements AppendStreamTableSink (an empty interface for now) so it can be
picked up in streaming job. Also, streaming requires checkpointing, and
Hive sink doesn't do that yet. There might be other tweaks you need to make.
