[jira] [Created] (FLINK-12337) [TableSQL/Planner] InsertInto method should configure TableSink

Artsem Semianenka created FLINK-12337: - Summary: [TableSQL/Planner] InsertInto method should configure TableSink Key: FLINK-12337 URL: https://issues.apache.org/jira/browse/FLINK-12337 Project

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

GenericHiveMetastoreCatalog. > > I have some initial thoughts on the solution you described, but I'll wait > till a more complete google design doc comes up, since this discussion is > about engaging community interest. > > On Thu, Apr 18, 2019 at 8:39 AM Artsem Semianenka >

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Sorry guys I've attached the wrong link for Jira ticket in the previous email. This is the correct link : https://issues.apache.org/jira/browse/FLINK-12256 On Thu, 18 Apr 2019 at 18:29, Artsem Semianenka wrote: > Thank you guys so much! > > You provided me a lot of helpful infor

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

up with Dawid's point (2): are we suggesting > that > >>> different kafka topics (e.g. test-topic-prod, test-topic-non-prod, etc) > >>> considered as a "view" of a logical table with schema (e.g. > test-topic) ? > >>> > >>> Also, seems

[jira] [Created] (FLINK-12256) Implement KafkaReadableCatalog

Artsem Semianenka created FLINK-12256: - Summary: Implement KafkaReadableCatalog Key: FLINK-12256 URL: https://issues.apache.org/jira/browse/FLINK-12256 Project: Flink Issue Type: New

[jira] [Created] (FLINK-12252) Support not escaped table name for External Catalogs in INSERT SQL statement

Artsem Semianenka created FLINK-12252: - Summary: Support not escaped table name for External Catalogs in INSERT SQL statement Key: FLINK-12252 URL: https://issues.apache.org/jira/browse/FLINK-12252

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

://github.com/apache/flink/pull/8007 > > [3] > > https://docs.google.com/document/d/1Yaxp1UJUFW-peGLt8EIidwKIZEWrrA-pznWLuvaH39Y/edit#heading=h.egn858cgizao > > On 16/04/2019 17:35, Artsem Semianenka wrote: > > Hi guys! > > > > I'm working on External Catalog for Con

[DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Hi guys! I'm working on External Catalog for Confluent Kafka. The main idea to register the external catalog which provides the list of Kafka topics and execute SQL queries like : Select * form kafka.topic_name I'm going to receive the table schema from Confluent schema registry. The main disadva

[jira] [Created] (FLINK-12200) [Table API] Support UNNEST for MAP types

Artsem Semianenka created FLINK-12200: - Summary: [Table API] Support UNNEST for MAP types Key: FLINK-12200 URL: https://issues.apache.org/jira/browse/FLINK-12200 Project: Flink Issue

Contributor permission application

Hi guys, Could you please give me contributor permissions for Flink project? Here my Jira id: artsem.semianenka Best regards, Artsem

[jira] [Created] (FLINK-11302) FlinkS3FileSystem uses an incorrect path for temporary files.

Artsem Semianenka created FLINK-11302: - Summary: FlinkS3FileSystem uses an incorrect path for temporary files. Key: FLINK-11302 URL: https://issues.apache.org/jira/browse/FLINK-11302 Project

Re: Support Hadoop 2.6 for StreamingFileSink

Hi guys, I've created a ticket for that issue in Jira and proposed possible solution just to continue our discussion and develop a plan how to fix the issue. https://issues.apache.org/jira/browse/FLINK-10203 Cheers, Artsem On Tue, 21 Aug 2018 at 16:59, Artsem Semianenka wrote: >

[jira] [Created] (FLINK-10203) HadoopRecoverableWriter does not support Hadoop

Artsem Semianenka created FLINK-10203: - Summary: HadoopRecoverableWriter does not support Hadoop Key: FLINK-10203 URL: https://issues.apache.org/jira/browse/FLINK-10203 Project: Flink

Re: Support Hadoop 2.6 for StreamingFileSink

you do not need truncate, or the valid length file. > Given this, > you may only need to write a Recoverable stream that just does not > truncate. > > Would you like to try it out and see if it works for your usecase? > > Cheers, > Kostas > > On Aug 21, 2018, at 1:58 P

Re: Support Hadoop 2.6 for StreamingFileSink

xplicitly decided to not support the valid > file length files with the new StreamingFileSink because they are really > hard to handle for the user. I've pulled Klou into this conversation who is > more knowledgeable and can give you a bit more advice. > > Cheers, > Till > &

Re: Support Hadoop 2.6 for StreamingFileSink

LegacyHadoopRecoverableFsDataOutputStream in case if Hadoop version is lower then 2.7 . I will try to provide PR soon if no objections. I hope I am on the right way. On Mon, 20 Aug 2018 at 14:40, Artsem Semianenka wrote: > Hi guys ! > I have a question regarding new StreamingFileSink (introduced in 1.6 > version)

Support Hadoop 2.6 for StreamingFileSink

Hi guys ! I have a question regarding new StreamingFileSink (introduced in 1.6 version) . We use this sink to write data into Parquet format. But I faced with issue when trying to run job on Yarn cluster and save result to HDFS. In our case we use latest Cloudera distributive (CHD 5.15) and it cont