Re: Hive storm streaming with s3 file system

> So transactional tables only work with hdfs. Thanks for the confirmation > Elliot. No, that's not what said. Streaming ingest into transactional tables requires strong filesystem consistency and a flush-to-remote operation (hflush). S3 supports neither of those things and HDFS is not the o

Re: Hive storm streaming with s3 file system

So transactional tables only work with hdfs. Thanks for the confirmation Elliot. On Tue, Jun 12, 2018 at 10:25 PM, Elliot West wrote: > I don't not believe that S3 is currently a supported filesystem for > transactional tables. I believe there are plans to make this so. > > On 12 June 2018 at 17

Re: Hive storm streaming with s3 file system

I don't not believe that S3 is currently a supported filesystem for transactional tables. I believe there are plans to make this so. On 12 June 2018 at 17:50, Abhishek Raj wrote: > Hi. I'm using HiveBolt from Apache Storm to stream >

Re: Hive storm streaming with s3 file system

Hi. I'm using HiveBolt from Apache Storm to stream data into a transactional hive table. It works great when the table is backed by hdfs, but starts throwing error when the location is