[jira] [Created] (FLINK-12219) Yarn application can't stop when flink job failed in per-job yarn cluste mode

lamber-ken created FLINK-12219: -- Summary: Yarn application can't stop when flink job failed in per-job yarn cluste mode Key: FLINK-12219 URL: https://issues.apache.org/jira/browse/FLINK-12219 Project: Fl

[jira] [Created] (FLINK-12220) Speculatively schedule execution for long tail task

BoWang created FLINK-12220: -- Summary: Speculatively schedule execution for long tail task Key: FLINK-12220 URL: https://issues.apache.org/jira/browse/FLINK-12220 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12221) Distinguish long tail task based on IOMetrics

BoWang created FLINK-12221: -- Summary: Distinguish long tail task based on IOMetrics Key: FLINK-12221 URL: https://issues.apache.org/jira/browse/FLINK-12221 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12222) No way to ship custom jars to yarn cluster in scala-shell

Jeff Zhang created FLINK-1: -- Summary: No way to ship custom jars to yarn cluster in scala-shell Key: FLINK-1 URL: https://issues.apache.org/jira/browse/FLINK-1 Project: Flink Issue T

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

Hi Stephan, Thanks for your suggestion and summarize. :) ==> The FLIP should probably reflect the full goal rather than the > first implementation step only, this would make sure everyone understands > what the final goal of the effort is. I totally agree that we can implement the function

[jira] [Created] (FLINK-12223) HeapMemorySegment.getArray should return null after being freed

Liya Fan created FLINK-12223: Summary: HeapMemorySegment.getArray should return null after being freed Key: FLINK-12223 URL: https://issues.apache.org/jira/browse/FLINK-12223 Project: Flink Issu

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Thank you, Dawid! This is very helpful information. I will keep a close eye on the updates of FLIP-30 and contribute whenever it possible. I guess I may create a Jira ticket for my proposal in which I describe the idea and attach intermediate pull request based on current API(just for initial discu

[jira] [Created] (FLINK-12224) Kafka 0.10 e2e test fails on Java 9

Chesnay Schepler created FLINK-12224: Summary: Kafka 0.10 e2e test fails on Java 9 Key: FLINK-12224 URL: https://issues.apache.org/jira/browse/FLINK-12224 Project: Flink Issue Type: Sub-t

Re: SQL CLI and JDBC

I think this problem sounds fixable. Having proper JDBC support through the SQL client would be really cool! Adding Timo and Shaoxuan here: Let's assume that the "collect()" call supports large results (I think we can get that support through the blob manager with some changes). What do you think

Re: SQL CLI and JDBC

Also +1 to support JDBC. Best, Kurt On Wed, Apr 17, 2019 at 7:38 PM Stephan Ewen wrote: > I think this problem sounds fixable. Having proper JDBC support through the > SQL client would be really cool! > > Adding Timo and Shaoxuan here: > > Let's assume that the "collect()" call supports large

[DISCUSS] Update our Roadmap

Hi everyone, We recently added a roadmap to our project website [1] and decided to update it after every release. Flink 1.8.0 was released a few days ago, so I think it we should check and remove from the roadmap what was achieved so far and add features / improvements that we plan for the future.

Re: [DISCUSS] Adaptive Parallelism of Job Vertex

Thanks Till for the comments. We will implement a new adaptive parallelism supported scheduler in the new schedule framework. Based on these schedule interfaces, we could do the work in parallel. On Tue, Apr 16, 2019 at 11:18 PM Till Rohrmann wrote: > Hi Bo Wang, > > thanks for proposing this de

[jira] [Created] (FLINK-12225) Simplify the interface of the PartFileWriter

Fokko Driesprong created FLINK-12225: Summary: Simplify the interface of the PartFileWriter Key: FLINK-12225 URL: https://issues.apache.org/jira/browse/FLINK-12225 Project: Flink Issue Ty

Contribute to Flink

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is moqi.

Re: [DISCUSS] Update our Roadmap

Hi Fabian, One thing missing is python api and python udf, we already discussed it in community, and it is very close to reach consensus. Fabian Hueske 于2019年4月17日周三 下午7:51写道： > Hi everyone, > > We recently added a roadmap to our project website [1] and decided to > update it after every relea

Re: SQL CLI and JDBC

+1 for supporting jdbc. One concern is that we need to provide a dedicated service to jdbc support. But sql-client is not designed to be a service IIUC, it doesn't expose any api for users, and it is designed to be used by single user, not for multiple users and concurrent usage. IMHO, we might ne

Re: SQL CLI and JDBC

> 在 2019年4月17日，下午9:14，Jeff Zhang 写道： > > +1 for supporting jdbc. One concern is that we need to provide a dedicated > service to jdbc support. But sql-client is not designed to be a service > IIUC, it doesn't expose any api for users, and it is designed to be used by > single user, not for mul

Re: [DISCUSS] Adaptive Parallelism of Job Vertex

I think this would be a good way to go. Please monitor FLINK-10429 [1] to see when the Scheduler interface is put into place. The sub tasks to add the interfaces should be added very soon. [1] https://issues.apache.org/jira/browse/FLINK-10429 Cheers, Till On Wed, Apr 17, 2019 at 1:54 PM Bo WANG

Request for JIRA Contributor Permission

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kyledong Thanks : )

[jira] [Created] (FLINK-12226) Add documentation about SUSPEND/TERMINATE

Kostas Kloudas created FLINK-12226: -- Summary: Add documentation about SUSPEND/TERMINATE Key: FLINK-12226 URL: https://issues.apache.org/jira/browse/FLINK-12226 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-12227) Introduce SchedulingStrategy interface

Gary Yao created FLINK-12227: Summary: Introduce SchedulingStrategy interface Key: FLINK-12227 URL: https://issues.apache.org/jira/browse/FLINK-12227 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12228) Implement Eager Scheduling Strategy

Gary Yao created FLINK-12228: Summary: Implement Eager Scheduling Strategy Key: FLINK-12228 URL: https://issues.apache.org/jira/browse/FLINK-12228 Project: Flink Issue Type: Sub-task Co

[jira] [Created] (FLINK-12229) Implement Lazy Scheduling Strategy

Gary Yao created FLINK-12229: Summary: Implement Lazy Scheduling Strategy Key: FLINK-12229 URL: https://issues.apache.org/jira/browse/FLINK-12229 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-12230) Remove getExecutionGraph() and getRestartStrategy() from JobMaster

Gary Yao created FLINK-12230: Summary: Remove getExecutionGraph() and getRestartStrategy() from JobMaster Key: FLINK-12230 URL: https://issues.apache.org/jira/browse/FLINK-12230 Project: Flink I

[jira] [Created] (FLINK-12231) Introduce Scheduler interface and adapt ExecutionGraph to it

Gary Yao created FLINK-12231: Summary: Introduce Scheduler interface and adapt ExecutionGraph to it Key: FLINK-12231 URL: https://issues.apache.org/jira/browse/FLINK-12231 Project: Flink Issue T

Re: [DISCUSS] Apache Flink at Season of Docs

Hi everyone, a few updates on our application: 1. As Aizhamal (Thanks!) has suggested I also added the information to submit during our application to the Google doc [1] and Fabian added a description for the SQL project idea (Thanks!). 2. I had a quick chat with Fabian offline and we concluded,

Re: [DISCUSS] Apache Flink at Season of Docs

Thanks Konstantin! I registered as a mentor and will have a look at the blog post. Best, Fabian Am Mi., 17. Apr. 2019 um 18:14 Uhr schrieb Konstantin Knauf < konstan...@ververica.com>: > Hi everyone, > > a few updates on our application: > > 1. As Aizhamal (Thanks!) has suggested I also added t

[jira] [Created] (FLINK-12232) Support database related operations in HiveCatalog

Bowen Li created FLINK-12232: Summary: Support database related operations in HiveCatalog Key: FLINK-12232 URL: https://issues.apache.org/jira/browse/FLINK-12232 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-12233) Support table related operations in HiveCatalog

Bowen Li created FLINK-12233: Summary: Support table related operations in HiveCatalog Key: FLINK-12233 URL: https://issues.apache.org/jira/browse/FLINK-12233 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12235) Support partition related operations in HiveCatalog

Bowen Li created FLINK-12235: Summary: Support partition related operations in HiveCatalog Key: FLINK-12235 URL: https://issues.apache.org/jira/browse/FLINK-12235 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-12234) Support viewrelated operations in HiveCatalog

Bowen Li created FLINK-12234: Summary: Support viewrelated operations in HiveCatalog Key: FLINK-12234 URL: https://issues.apache.org/jira/browse/FLINK-12234 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12236) Support function related operations in HiveCatalog

Bowen Li created FLINK-12236: Summary: Support function related operations in HiveCatalog Key: FLINK-12236 URL: https://issues.apache.org/jira/browse/FLINK-12236 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-12237) Support table stats related operations in HiveCatalog

Bowen Li created FLINK-12237: Summary: Support table stats related operations in HiveCatalog Key: FLINK-12237 URL: https://issues.apache.org/jira/browse/FLINK-12237 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-12238) Support database related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12238: Summary: Support database related operations in GenericHiveMetastoreCatalog Key: FLINK-12238 URL: https://issues.apache.org/jira/browse/FLINK-12238 Project: Flink I

[jira] [Created] (FLINK-12239) Support table related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12239: Summary: Support table related operations in GenericHiveMetastoreCatalog Key: FLINK-12239 URL: https://issues.apache.org/jira/browse/FLINK-12239 Project: Flink Issu

[jira] [Created] (FLINK-12240) Support view related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12240: Summary: Support view related operations in GenericHiveMetastoreCatalog Key: FLINK-12240 URL: https://issues.apache.org/jira/browse/FLINK-12240 Project: Flink Issue

[jira] [Created] (FLINK-12241) Support function related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12241: Summary: Support function related operations in GenericHiveMetastoreCatalog Key: FLINK-12241 URL: https://issues.apache.org/jira/browse/FLINK-12241 Project: Flink I

[jira] [Created] (FLINK-12243) Support table stats related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12243: Summary: Support table stats related operations in GenericHiveMetastoreCatalog Key: FLINK-12243 URL: https://issues.apache.org/jira/browse/FLINK-12243 Project: Flink

[jira] [Created] (FLINK-12242) Support partition related operations in GenericHiveMetastoreCatalog

Bowen Li created FLINK-12242: Summary: Support partition related operations in GenericHiveMetastoreCatalog Key: FLINK-12242 URL: https://issues.apache.org/jira/browse/FLINK-12242 Project: Flink

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Thanks Artsem for looking into this problem and Thanks Dawid for bringing up the discussion on FLIP-30. We've observe similar scenarios when we also would like to reuse the schema registry of both Kafka stream as well as the raw ingested kafka messages in datalake. FYI another more catalog-oriente

Re: Using guava ImmutableMap Serializer from magro/kyro-serializers

Thanks JingsongLee. You are right. I have registered all the implementation class and it worked. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Hi Rong, Thanks for pointing out the missing FLIPs in the FLIP main page. I added all the missing FLIP (incl. FLIP-14, FLIP-22, FLIP-29, FLIP-30, FLIP-31) to the page. I also include @xuef...@alibaba-inc.com and @Bowen Li into the thread who are familiar with the latest catalog design. Thank

Re: [DISCUSS] Apache Flink at Season of Docs

Thanks Konstantin! I registered as a mentor and have left comments on the blog pull request. Regards, Jark On Thu, 18 Apr 2019 at 00:36, Fabian Hueske wrote: > Thanks Konstantin! > > I registered as a mentor and will have a look at the blog post. > > Best, Fabian > > Am Mi., 17. Apr. 2019 um

Re: [DISCUSS] Apache Flink at Season of Docs

Thanks Konstantin! I registered as an alternative administrator, and have had left few comments at the blog post. Best, Jincheng Fabian Hueske 于2019年4月18日周四 上午12:36写道： > Thanks Konstantin! > > I registered as a mentor and will have a look at the blog post. > > Best, Fabian > > Am Mi., 17. Apr

[jira] [Created] (FLINK-12244) SynchronousCheckpointITCase hang up

vinoyang created FLINK-12244: Summary: SynchronousCheckpointITCase hang up Key: FLINK-12244 URL: https://issues.apache.org/jira/browse/FLINK-12244 Project: Flink Issue Type: Test Compon

[jira] [Created] (FLINK-12245) Transient slot allocation failure on job recovery

Hwanju Kim created FLINK-12245: -- Summary: Transient slot allocation failure on job recovery Key: FLINK-12245 URL: https://issues.apache.org/jira/browse/FLINK-12245 Project: Flink Issue Type: Bug

Re: [DISCUSS] [FLINK SQL] External catalog for Confluent Kafka

Hi, Thanks Artsem and Rong for bringing up the demand from user perspective. A Kafka/Confluent Schema Registry catalog would have a good use case in Flink. We actually mentioned the potential of Unified Catalog APIs for Kafka in our talk a couple weeks ago at Flink Forward SF [1], and glad to lear

[Discuss] Add JobListener (hook) in flink job lifecycle

Hi All, I created FLINK-12214 for adding JobListener (hook) in flink job lifecycle. Since this is a new public api for flink, so I'd like to discuss it more widely in community to get more feedback. The background and motivation is that I am int

[jira] [Created] (FLINK-12246) can't get any option from the jobConfiguration of JobGraph

lamber-ken created FLINK-12246: -- Summary: can't get any option from the jobConfiguration of JobGraph Key: FLINK-12246 URL: https://issues.apache.org/jira/browse/FLINK-12246 Project: Flink Issue

[jira] [Created] (FLINK-12247) fix NPE when writing an archive file to a FileSystem

lamber-ken created FLINK-12247: -- Summary: fix NPE when writing an archive file to a FileSystem Key: FLINK-12247 URL: https://issues.apache.org/jira/browse/FLINK-12247 Project: Flink Issue Type:

[jira] [Created] (FLINK-12248) Support e2e over window in blink batch

Jingsong Lee created FLINK-12248: Summary: Support e2e over window in blink batch Key: FLINK-12248 URL: https://issues.apache.org/jira/browse/FLINK-12248 Project: Flink Issue Type: New Featur

Re: [Discuss] Add JobListener (hook) in flink job lifecycle

Hi Jeff, I personally like this proposal. From the perspective of programmability, the JobListener can make the third program more appreciable. The scene where I need the listener is the Flink cube engine for Apache Kylin. In the case, the Flink job program is embedded into the Kylin's executable