Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
Hi, Sagar There already has relative JIRAs for ORC and Parquet, you can take a look here: https://issues.apache.org/jira/browse/FLINK-9407 and https://issues.apache.org/jira/browse/FLINK-9411

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
Actually, I have been an idea, how about support hive on flink ? Since lots of business are written by hive sql. And users wants to transform map reduce to fink without changing the sql. Zhangminglei > 在 2018年6月17日,下午8:11,zhangminglei <18717838...@163.com> 写道: > > Hi, Sagar > > There alread

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread Will Du
Agree, two missing pieces I think could make Flink more competitive against Spark SQL/Stream and Kafka Stream 1. Flink over Hive or Flink SQL hive table source and sink 2. Flink ML on stream > On Jun 17, 2018, at 8:34 AM, zhangminglei <18717838...@163.com> wrote: > > Actually, I have been an id

Re: [DISCUSS] Flink 1.6 features

2018-06-17 Thread zhangminglei
But if we do hive on flink , I think it should be a very big project. > 在 2018年6月17日,下午9:36,Will Du 写道: > > Agree, two missing pieces I think could make Flink more competitive against > Spark SQL/Stream and Kafka Stream > 1. Flink over Hive or Flink SQL hive table source and sink > 2. Flink ML

BUILD FAILURE with AbstractStreamOperator

2018-06-17 Thread Thodoris Bitsakis
Hello, When i made the following class in my demo project: the build fails with "mvn clean package" : Can somebody ex

Docker Containers on YARN when using Flink on EMR

2018-06-17 Thread Vijay Balakrishnan
Hi, Trying to use Docker Containers to be launched from YARN when using Flink on EMR on Ubuntu. Can't seem to launch a Docker Container from YARN Resource Manager while starting up the ./flink-yarn-session or Submitting a Flink job ./bin/flink run ... Following the docs here: https://ci.apache.org/