Re: Towards a spec for robust streaming SQL, Part 1

2017-05-10 Thread Tyler Akidau
On Tue, May 9, 2017 at 3:06 PM Fabian Hueske wrote: > Hi Tyler, > > thank you very much for this excellent write-up and the super nice > visualizations! > You are discussing a lot of the things that we have been thinking about as > well from a different perspective. > IMO, yours and the Flink mod

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-10 Thread Renjie Liu
Hi, all: Will the FLIP 6 be included in release 1.3? On Wed, May 10, 2017 at 9:48 PM Gyula Fóra wrote: > Thanks you! :) > > Chesnay Schepler ezt írta (időpont: 2017. máj. 10., > Sze, 15:44): > > > I guess it is related to this one > > https://issues.apache.org/jira/browse/FLINK-6514 ? > > > > O

[jira] [Created] (FLINK-6532) Mesos version check

2017-05-10 Thread Eron Wright (JIRA)
Eron Wright created FLINK-6532: --- Summary: Mesos version check Key: FLINK-6532 URL: https://issues.apache.org/jira/browse/FLINK-6532 Project: Flink Issue Type: Improvement Components:

Re: [DISCUSS] Changing Flink's shading model

2017-05-10 Thread Stephan Ewen
@chesnay: I used ASM as an example in the proposal. Maybe I did not say that clearly. If we like that approach, we should deal with the other libraries (at least the frequently used ones) in the same way. I would imagine to have a project layout like that: flink-shaded-deps - flink-shaded-asm

Re: [DISCUSS] Changing Flink's shading model

2017-05-10 Thread Chesnay Schepler
I like the idea, thank you for bringing it up. Given that the raised problems aren't really ASM specific would it make sense to create one flink-shaded module that contains all frequently shaded libraries? (or maybe even all shaded dependencies by core modules) The proposal limits the scope of

[jira] [Created] (FLINK-6531) Deserialize checkpoint hooks with user classloader

2017-05-10 Thread Eron Wright (JIRA)
Eron Wright created FLINK-6531: --- Summary: Deserialize checkpoint hooks with user classloader Key: FLINK-6531 URL: https://issues.apache.org/jira/browse/FLINK-6531 Project: Flink Issue Type: Bu

[DISCUSS] Changing Flink's shading model

2017-05-10 Thread Stephan Ewen
Hi! This is a discussion about altering the way we handle dependencies and shading in Flink. I ran into quite a view problems trying to adjust / fix some shading issues during release validation. The issue is tracked under: https://issues.apache.org/jira/browse/FLINK-6529 Bring this discussion th

[jira] [Created] (FLINK-6530) Unclosed Response in DatadogHttpClient#validateApiKey()

2017-05-10 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6530: - Summary: Unclosed Response in DatadogHttpClient#validateApiKey() Key: FLINK-6530 URL: https://issues.apache.org/jira/browse/FLINK-6530 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6529) Rework the shading model in Flink

2017-05-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-6529: --- Summary: Rework the shading model in Flink Key: FLINK-6529 URL: https://issues.apache.org/jira/browse/FLINK-6529 Project: Flink Issue Type: Bug Compo

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-10 Thread Gyula Fóra
Thanks you! :) Chesnay Schepler ezt írta (időpont: 2017. máj. 10., Sze, 15:44): > I guess it is related to this one > https://issues.apache.org/jira/browse/FLINK-6514 ? > > On 10.05.2017 15:34, Gyula Fóra wrote: > > Hi, > > > > I tried to run an application on 1.3 but I keep getting the followin

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-10 Thread Chesnay Schepler
I guess it is related to this one https://issues.apache.org/jira/browse/FLINK-6514 ? On 10.05.2017 15:34, Gyula Fóra wrote: Hi, I tried to run an application on 1.3 but I keep getting the following error: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.security.Use

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-10 Thread Gyula Fóra
Hi, I tried to run an application on 1.3 but I keep getting the following error: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.security.UserGroupInformation at org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:45) at org.apache.flink.ru

[jira] [Created] (FLINK-6528) Refactor BlobLibraryCacheManager <=> BlobServer/Cache <=> BlobStore hierarchy

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6528: Summary: Refactor BlobLibraryCacheManager <=> BlobServer/Cache <=> BlobStore hierarchy Key: FLINK-6528 URL: https://issues.apache.org/jira/browse/FLINK-6528 Project:

[jira] [Created] (FLINK-6527) OperatorSubtaskState has empty implementations of (un)/registerSharedStates

2017-05-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6527: - Summary: OperatorSubtaskState has empty implementations of (un)/registerSharedStates Key: FLINK-6527 URL: https://issues.apache.org/jira/browse/FLINK-6527 Project:

[jira] [Created] (FLINK-6526) BlobStore files might become orphans in case of recovery

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6526: Summary: BlobStore files might become orphans in case of recovery Key: FLINK-6526 URL: https://issues.apache.org/jira/browse/FLINK-6526 Project: Flink Issue

[jira] [Created] (FLINK-6525) Transferred TM log/stdout files are never removed from BlobStore

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6525: Summary: Transferred TM log/stdout files are never removed from BlobStore Key: FLINK-6525 URL: https://issues.apache.org/jira/browse/FLINK-6525 Project: Flink

[jira] [Created] (FLINK-6524) Make server address of BlobCache configurable

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6524: Summary: Make server address of BlobCache configurable Key: FLINK-6524 URL: https://issues.apache.org/jira/browse/FLINK-6524 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-6523) Improve lifecycle management of created BlobCaches in TaskManagerLogHandler and JobClient

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6523: Summary: Improve lifecycle management of created BlobCaches in TaskManagerLogHandler and JobClient Key: FLINK-6523 URL: https://issues.apache.org/jira/browse/FLINK-6523

[jira] [Created] (FLINK-6522) Add ZooKeeper cleanup logic to ZooKeeperHaServices

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6522: Summary: Add ZooKeeper cleanup logic to ZooKeeperHaServices Key: FLINK-6522 URL: https://issues.apache.org/jira/browse/FLINK-6522 Project: Flink Issue Type:

[jira] [Created] (FLINK-6521) Add per job cleanup methods to HighAvailabilityServices

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6521: Summary: Add per job cleanup methods to HighAvailabilityServices Key: FLINK-6521 URL: https://issues.apache.org/jira/browse/FLINK-6521 Project: Flink Issue T

Re: assignment request: FLINK-1750 (CCA for MLLib)

2017-05-10 Thread Chesnay Schepler
Please comment directly in the JIRA. Before an issue can be assigned to you we require your JIRA username. On 10.05.2017 12:24, Alex De Castro wrote: https://issues.apache.org/jira/browse/FLINK-1750?jql=project%20%3D%20FLINK%20AND%20issuetype%20%3D%20%22New%20Feature%22%20AND%20status%20%3

assignment request: FLINK-1750 (CCA for MLLib)

2017-05-10 Thread Alex De Castro
https://issues.apache.org/jira/browse/FLINK-1750?jql=project%20%3D%20FLINK%20AND%20issuetype%20%3D%20%22New%20Feature%22%20AND%20status%20%3D%20Open%20AND%20text%20~%20%22machine%20learning%2C%22%20AND%20assignee%20in%20(EMPTY)

[jira] [Created] (FLINK-6520) FlinkKafkaConsumer09+ does not overwrite props to not auto commit offsets when commit mode is OffsetCommitMode.ON_CHECKPOINTS

2017-05-10 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6520: -- Summary: FlinkKafkaConsumer09+ does not overwrite props to not auto commit offsets when commit mode is OffsetCommitMode.ON_CHECKPOINTS Key: FLINK-6520 URL: https://iss

[jira] [Created] (FLINK-6519) Integrate BlobStore in HighAvailabilityServices lifecycle management

2017-05-10 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6519: Summary: Integrate BlobStore in HighAvailabilityServices lifecycle management Key: FLINK-6519 URL: https://issues.apache.org/jira/browse/FLINK-6519 Project: Flink

[jira] [Created] (FLINK-6518) Migrate BlobServer configuration options

2017-05-10 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-6518: --- Summary: Migrate BlobServer configuration options Key: FLINK-6518 URL: https://issues.apache.org/jira/browse/FLINK-6518 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-6517) Support multiple consecutive windows

2017-05-10 Thread Timo Walther (JIRA)
Timo Walther created FLINK-6517: --- Summary: Support multiple consecutive windows Key: FLINK-6517 URL: https://issues.apache.org/jira/browse/FLINK-6517 Project: Flink Issue Type: Bug Co