SQL codegen bytecode beyond 64KB.

2019-01-09 Thread 563280...@qq.com
Hi all, I run a very long sql file . It occur a error like this: "Code of method "split$1931$(LDataStreamCalcRule$1933;)V" of class "DataStreamCalcRule$1933" grows beyond 64 KB" My Flink version is 1.6.3 Anyone could help me to resolve this issue, thanks! devin. 563280...@

SQL codegen bytecode beyond 64KB.

2019-01-09 Thread 563280...@qq.com
Hi all, I run a very long sql file . It occur a error like this: "Code of method "split$1931$(LDataStreamCalcRule$1933;)V" of class "DataStreamCalcRule$1933" grows beyond 64 KB" My Flink version is 1.6.3 Anyone could help me to resolve this issue, thanks! devin. 563280...@qq.com

[jira] [Created] (FLINK-11299) Decide the result partition type dynamically

2019-01-09 Thread shuai.xu (JIRA)
shuai.xu created FLINK-11299: Summary: Decide the result partition type dynamically Key: FLINK-11299 URL: https://issues.apache.org/jira/browse/FLINK-11299 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-11298) Scheduling job in the unit of concurrent groups

2019-01-09 Thread shuai.xu (JIRA)
shuai.xu created FLINK-11298: Summary: Scheduling job in the unit of concurrent groups Key: FLINK-11298 URL: https://issues.apache.org/jira/browse/FLINK-11298 Project: Flink Issue Type: Improveme

Re: [DISCUSS] Support Interactive Programming in Flink Table API

2019-01-09 Thread Becket Qin
Hi Piotr, 1. `env.getCacheService().releaseCacheFor(cachedT);` vs `cachedT.releaseCache();` It doesn't matter which signature we provide. To those who write the function, "releasing the cache" is not a "side effect", it is exactly what they wanted. Even if they know that they may be releasing some

[jira] [Created] (FLINK-11297) Add a doc link of jobmanager ha details

2019-01-09 Thread Yiqun Lin (JIRA)
Yiqun Lin created FLINK-11297: - Summary: Add a doc link of jobmanager ha details Key: FLINK-11297 URL: https://issues.apache.org/jira/browse/FLINK-11297 Project: Flink Issue Type: Improvement

Re: Request multiple subpartitions of one partition

2019-01-09 Thread zhijiang
Hi Chris, I think your requirement seems like this: 1. Determine the number of logic output partitions on upstream side. 2. Determine the number of logic input channels on downstream side. 3. Determine which input channel consumes corresponding output partition. I remembered Tez has similar mecha

[jira] [Created] (FLINK-11296) Support truncate in TableAPI

2019-01-09 Thread xuqianjin (JIRA)
xuqianjin created FLINK-11296: - Summary: Support truncate in TableAPI Key: FLINK-11296 URL: https://issues.apache.org/jira/browse/FLINK-11296 Project: Flink Issue Type: Improvement Affects Ve

[jira] [Created] (FLINK-11295) Rename configuration options of queryable state from query.x to queryable-state.x

2019-01-09 Thread BoWang (JIRA)
BoWang created FLINK-11295: -- Summary: Rename configuration options of queryable state from query.x to queryable-state.x Key: FLINK-11295 URL: https://issues.apache.org/jira/browse/FLINK-11295 Project: Flink

[jira] [Created] (FLINK-11294) Remove legacy JobInfo usage in valid tests

2019-01-09 Thread TisonKun (JIRA)
TisonKun created FLINK-11294: Summary: Remove legacy JobInfo usage in valid tests Key: FLINK-11294 URL: https://issues.apache.org/jira/browse/FLINK-11294 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Dropping flink-storm?

2019-01-09 Thread Till Rohrmann
With https://issues.apache.org/jira/browse/FLINK-10571, we will remove the Storm topologies from Flink and keep the wrappers for the moment. However, looking at the FlinkTopologyContext [1], it becomes quite obvious that Flink's compatibility with Storm is really limited. Almost all of the context

[jira] [Created] (FLINK-11293) KafkaITCase.testConcurrentProducerConsumerTopology times out on Travis

2019-01-09 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-11293: - Summary: KafkaITCase.testConcurrentProducerConsumerTopology times out on Travis Key: FLINK-11293 URL: https://issues.apache.org/jira/browse/FLINK-11293 Project: Fli

Request multiple subpartitions of one partition

2019-01-09 Thread Chris Miller
Hello, let's image we do a hash join of two DataSources. For the join operation we choose parallelism=5. This way Flink uses 5 TaskManagerRunners to do the join job. In particular, the DataSource tasks, EACH ARE CREATING 5 SUBPARTITIONS. Every worker, now requests ONE SUBPARTITION from both

Re: [DISCUSS] Support Interactive Programming in Flink Table API

2019-01-09 Thread Piotr Nowojski
Hi, I know that it still can have side effects and that’s why I wrote: > Something like this might be a better (not perfect, but just a bit better): My point was that this: void foo(Table t) { val cachedT = t.cache(); ... env.getCacheService().releaseCacheFor(cachedT); } Should communicate

[jira] [Created] (FLINK-11292) Document how to use the new CompositeTypeSerializerSnapshot

2019-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-11292: --- Summary: Document how to use the new CompositeTypeSerializerSnapshot Key: FLINK-11292 URL: https://issues.apache.org/jira/browse/FLINK-11292 Project: Fl

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2019-01-09 Thread Timo Walther
Hi Bowen, thanks for your feedback. We should not change the Google doc anymore but apply additional comments in the wiki page. I will also add a bit more explanation to some parts so that people know about certain design decisions. Regards, Timo Am 08.01.19 um 22:54 schrieb Bowen Li: Tha