Re: Something wrong with travis?

I met this problem again at https://api.travis-ci.com/v3/job/220732163/log.txt . Is there any place we could ask for help to contact tarvis or any clues we could use to figure out this? Best Yun Tang From: Yun Tang Sent: Monday, June 24, 2019 14:22 To: dev@flink

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

Hi Biao, Thanks for working on FLINK-9900. The ticket is already assigned to you now. Cheers, Gordon On Tue, Jul 30, 2019 at 2:31 PM Biao Liu wrote: > Hi Gordon, > > Thanks for updating progress. > > Currently I'm working on FLINK-9900. I need a committer to assign the > ticket to me. > > Tzu-

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

Hi Gordon, Thanks for updating progress. Currently I'm working on FLINK-9900. I need a committer to assign the ticket to me. Tzu-Li (Gordon) Tai 于2019年7月30日 周二13:01写道： > Hi all, > > There are quite a few instabilities in our builds right now (master + > release-1.9), some of which are directed

Re: Use sql to access the flink state

Hi, I don't think there were any discussions recently in the community on accessing Flink working / runtime state using SQL. However, there were some other discussions for this on persisted state in savepoints or checkpoints, mainly through the use of the recently merged State Processor API [1].

[jira] [Created] (FLINK-13490) Fix return null in JDBCUtils::getFieldFromResultSet

Caizhi Weng created FLINK-13490: --- Summary: Fix return null in JDBCUtils::getFieldFromResultSet Key: FLINK-13490 URL: https://issues.apache.org/jira/browse/FLINK-13490 Project: Flink Issue Type:

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

Hi all, There are quite a few instabilities in our builds right now (master + release-1.9), some of which are directed or suspiciously related to the 1.9 release. I'll categorize the instabilities into ones which we were already tracking in the 1.9 Burndown Kanban board [1] prior to this email, a

Re: [DISCUSS] Removing the flink-mapr-fs module

We've also experienced some issues with our internal JFrog artifactory. I am suspecting some sort of mirroring problem but somehow it only occur to the mapr-fs module. So +1 to remove. On Mon, Jul 29, 2019 at 12:47 PM Stephan Ewen wrote: > It should be fairly straightforward to rewrite the code

[jira] [Created] (FLINK-13489) Heavy deployment end-to-end test fails on Travis with TM heartbeat timeout

Tzu-Li (Gordon) Tai created FLINK-13489: --- Summary: Heavy deployment end-to-end test fails on Travis with TM heartbeat timeout Key: FLINK-13489 URL: https://issues.apache.org/jira/browse/FLINK-13489

[jira] [Created] (FLINK-13488) flink-python fails to build on Travis due to PackagesNotFoundError

Tzu-Li (Gordon) Tai created FLINK-13488: --- Summary: flink-python fails to build on Travis due to PackagesNotFoundError Key: FLINK-13488 URL: https://issues.apache.org/jira/browse/FLINK-13488 Proj

[jira] [Created] (FLINK-13487) TaskExecutorPartitionLifecycleTest.testPartitionReleaseAfterReleaseCall failed on Travis

Tzu-Li (Gordon) Tai created FLINK-13487: --- Summary: TaskExecutorPartitionLifecycleTest.testPartitionReleaseAfterReleaseCall failed on Travis Key: FLINK-13487 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-13486) AsyncDataStreamITCase.testOrderedWaitUsingAnonymousFunction instable on Travis

Tzu-Li (Gordon) Tai created FLINK-13486: --- Summary: AsyncDataStreamITCase.testOrderedWaitUsingAnonymousFunction instable on Travis Key: FLINK-13486 URL: https://issues.apache.org/jira/browse/FLINK-13486

[jira] [Created] (FLINK-13485) Translate "Table API Example Walkthrough" page into Chinese

Jark Wu created FLINK-13485: --- Summary: Translate "Table API Example Walkthrough" page into Chinese Key: FLINK-13485 URL: https://issues.apache.org/jira/browse/FLINK-13485 Project: Flink Issue Type

[jira] [Created] (FLINK-13484) ConnectedComponents end-to-end test instable with NoResourceAvailableException

Tzu-Li (Gordon) Tai created FLINK-13484: --- Summary: ConnectedComponents end-to-end test instable with NoResourceAvailableException Key: FLINK-13484 URL: https://issues.apache.org/jira/browse/FLINK-13484

[jira] [Created] (FLINK-13483) PrestoS3FileSystemITCase.testDirectoryListing fails on Travis

Tzu-Li (Gordon) Tai created FLINK-13483: --- Summary: PrestoS3FileSystemITCase.testDirectoryListing fails on Travis Key: FLINK-13483 URL: https://issues.apache.org/jira/browse/FLINK-13483 Project:

[jira] [Created] (FLINK-13482) How can I cleanly shutdown streaming jobs in local mode?

Donghui Xu created FLINK-13482: -- Summary: How can I cleanly shutdown streaming jobs in local mode? Key: FLINK-13482 URL: https://issues.apache.org/jira/browse/FLINK-13482 Project: Flink Issue Ty

[jira] [Created] (FLINK-13481) allow user launch job on yarn from SQL Client command line

Hongtao Zhang created FLINK-13481: - Summary: allow user launch job on yarn from SQL Client command line Key: FLINK-13481 URL: https://issues.apache.org/jira/browse/FLINK-13481 Project: Flink

Re: flink-connector-hive uses third-party repositories

Hi Martijn: I looked through this problem and found javax.jms:jms:jar:1.1 can be founded in https://mvnrepository.com/artifact/javax.jms/jms . javax.jms:jms:jar:1.1 is imported by HiveRunner with test scope while another org.pentaho:pen

Re: [DISCUSS] ARM support for Flink

Hi Stephan, Maybe I misled you in the previous email. We don't need to migrate CI completely, travis-ci is still there working for X86 arch. What we need to do is to add another CI tool for ARM arch. There are some ways to do it. As I wrote on https://issues.apache.org/jira/browse/FLINK-13199

[jira] [Created] (FLINK-13480) Export SlotManager status at debug mode.

Guowei Ma created FLINK-13480: - Summary: Export SlotManager status at debug mode. Key: FLINK-13480 URL: https://issues.apache.org/jira/browse/FLINK-13480 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13479) Cassandra POJO Sink - Prepared Statement query does not have deterministic ordering of columns - causing prepared statement cache overflow

Ronak Thakrar created FLINK-13479: - Summary: Cassandra POJO Sink - Prepared Statement query does not have deterministic ordering of columns - causing prepared statement cache overflow Key: FLINK-13479 URL: https:

Re: [DISCUSS] Removing the flink-mapr-fs module

It should be fairly straightforward to rewrite the code to not have a MapR dependency. Only one class from the MapR dependency is ever referenced, and we could dynamically load that class. That way we can drop the dependency without dropping the support. On Mon, Jul 29, 2019 at 5:33 PM Aljoscha K

Re: blink planner issue

Hi Jark, Jingsong, Timo: I read the FLINK-12848, the root cause of this issue should be 'cache the RowTypeInfo in seenTypes'. In my opinion, RowType should be compared with type. BTW, I don't understand why it need cache the composite type. Could you please explain the following comments, thanks.

Re: [DISCUSS] Removing the flink-mapr-fs module

Just FYI, the MapRFileSystem does have some additional code on our (Hadoop)FileSystem class, so it might not be straightforward to use MapR with our vanilla HadoopFileSystem. (Still staying that we should remove it, though). Aljoscha > On 29. Jul 2019, at 15:16, Simon Su wrote: > > +1 to rem

[jira] [Created] (FLINK-13478) Decouple two different release strategies in BoundedBlockingSubpartition

zhijiang created FLINK-13478: Summary: Decouple two different release strategies in BoundedBlockingSubpartition Key: FLINK-13478 URL: https://issues.apache.org/jira/browse/FLINK-13478 Project: Flink

Re: [DISSCUSS] Tolerate temporarily suspended ZooKeeper connections

Hi Till, Thanks for your explanation. Let's pick up this thread in 1.10 developing. Best, tison. Till Rohrmann 于2019年7月29日周一 下午9:12写道： > Hi Tison, > > I would consider this a new feature and as such it won't be possible to > include it in the 1.9.0 release since the feature freeze has been pa

[jira] [Created] (FLINK-13477) Containerized TaskManager killed because of lack of memory overhead

Benoit Hanotte created FLINK-13477: -- Summary: Containerized TaskManager killed because of lack of memory overhead Key: FLINK-13477 URL: https://issues.apache.org/jira/browse/FLINK-13477 Project: Flin

[jira] [Created] (FLINK-13476) Release partitions for FINISHED or FAILED tasks if they are cancelled

Till Rohrmann created FLINK-13476: - Summary: Release partitions for FINISHED or FAILED tasks if they are cancelled Key: FLINK-13476 URL: https://issues.apache.org/jira/browse/FLINK-13476 Project: Flin

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it. Thanks, SImon On 07/29/2019 21:00，Till Rohrmann wrote： +1 to remove it. On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen wrote: +1 to remove it One should still be able to use MapR in the same way as any other vendor Hadoop distribution. On Mon, Jul 29, 2019 at 12:22 PM Jingso

Re: [DISSCUSS] Tolerate temporarily suspended ZooKeeper connections

Hi Tison, I would consider this a new feature and as such it won't be possible to include it in the 1.9.0 release since the feature freeze has been passed. We might target 1.10, though. Cheers, Till On Mon, Jul 29, 2019 at 3:01 AM Zili Chen wrote: > Hi committers, > > Now that we have an ongoi

[jira] [Created] (FLINK-13475) Reduce dependency on third-party maven repositories

Till Rohrmann created FLINK-13475: - Summary: Reduce dependency on third-party maven repositories Key: FLINK-13475 URL: https://issues.apache.org/jira/browse/FLINK-13475 Project: Flink Issue T

Re: flink-connector-hive uses third-party repositories

Thanks a lot for raising this issue Martijn. I've pulled in Rui who works on the flink-connector-hive module and Kurt. @Kurt and @Rui, do you think it's doable to decrease the dependency on third party repositories? In any case, I've create a JIRA issue for it [1]. [1] https://issues.apache.org/j

Re: [DISCUSS] Publish the PyFlink into PyPI

Sounds good to me. Thanks for driving this discussion. Cheers, Till On Mon, Jul 29, 2019 at 9:24 AM jincheng sun wrote: > Yes Till, I think you are correct that we should make sure that the > published Flink Python API cannot be arbitrarily deleted. > > So, It seems that our current consensus i

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it. On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen wrote: > +1 to remove it > > One should still be able to use MapR in the same way as any other vendor > Hadoop distribution. > > On Mon, Jul 29, 2019 at 12:22 PM JingsongLee > wrote: > > > +1 for removing it. We never run mvn clean t

Re: Flink Kafka Issues

Hi Ramya, I am a little confused in the situation here. Is the following what you saw: 1. The Kafka topic A has a traffic drop from 22:00 UTC to 00:30 UTC. 2. Your Flink job (say job 1) reads from Topic A, but it has a high fetch rate with an abnormally high CPU consumption during the period ment

[jira] [Created] (FLINK-13474) NoSuchMethodError when registering DataStream

Mateusz Jarzyna created FLINK-13474: --- Summary: NoSuchMethodError when registering DataStream Key: FLINK-13474 URL: https://issues.apache.org/jira/browse/FLINK-13474 Project: Flink Issue Typ

[jira] [Created] (FLINK-13473) Add GroupWindowed FlatAggregate support to stream Table API(blink planner), i.e, align with flink planner

sunjincheng created FLINK-13473: --- Summary: Add GroupWindowed FlatAggregate support to stream Table API(blink planner), i.e, align with flink planner Key: FLINK-13473 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-13472) taskmanager.jvm-exit-on-oom doesn't work reliably with YARN

Pawel Bartoszek created FLINK-13472: --- Summary: taskmanager.jvm-exit-on-oom doesn't work reliably with YARN Key: FLINK-13472 URL: https://issues.apache.org/jira/browse/FLINK-13472 Project: Flink

[jira] [Created] (FLINK-13471) Add FlatAggregate support to stream Table API(blink planner)

sunjincheng created FLINK-13471: --- Summary: Add FlatAggregate support to stream Table API(blink planner) Key: FLINK-13471 URL: https://issues.apache.org/jira/browse/FLINK-13471 Project: Flink I

[jira] [Created] (FLINK-13470) Enhancements to Flink Table API for blink planner

sunjincheng created FLINK-13470: --- Summary: Enhancements to Flink Table API for blink planner Key: FLINK-13470 URL: https://issues.apache.org/jira/browse/FLINK-13470 Project: Flink Issue Type:

Re: [DISCUSS] Flink project bylaws

Hi Becket, Thanks a lot for pushing this forward and addressing the feedback. I'm very happy with the current state of the bylaws. +1 to wait until Friday before starting a vote. Best, Fabian Am Mo., 29. Juli 2019 um 13:47 Uhr schrieb Becket Qin : > Hi Everyone, > > Thanks for all the discussio

Re: [DISCUSS] Flink project bylaws

Hi Everyone, Thanks for all the discussion and feedback. It seems that we have almost reached consensus. I'll leave the discussion thread open until this Friday. If there is no more concerns raised, I'll start a voting thread after that. Thanks, Jiangjie (Becket) Qin On Fri, Jul 26, 2019 at 6:

[jira] [Created] (FLINK-13469) Resource used by StateMapSnapshot can not be released if snapshot fails

PengFei Li created FLINK-13469: -- Summary: Resource used by StateMapSnapshot can not be released if snapshot fails Key: FLINK-13469 URL: https://issues.apache.org/jira/browse/FLINK-13469 Project: Flink

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it One should still be able to use MapR in the same way as any other vendor Hadoop distribution. On Mon, Jul 29, 2019 at 12:22 PM JingsongLee wrote: > +1 for removing it. We never run mvn clean test success in China with > mapr-fs... > Best, Jingsong Lee > > > -

[jira] [Created] (FLINK-13468) No create methon in StreamTableEnvironment

Mateusz Jarzyna created FLINK-13468: --- Summary: No create methon in StreamTableEnvironment Key: FLINK-13468 URL: https://issues.apache.org/jira/browse/FLINK-13468 Project: Flink Issue Type:

[jira] [Created] (FLINK-13467) Bump ASM to 7.1

Chesnay Schepler created FLINK-13467: Summary: Bump ASM to 7.1 Key: FLINK-13467 URL: https://issues.apache.org/jira/browse/FLINK-13467 Project: Flink Issue Type: Sub-task Compon

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it. We never run mvn clean test success in China with mapr-fs... Best, Jingsong Lee -- From:Biao Liu Send Time:2019年7月29日(星期一) 12:05 To:dev Subject:Re: [DISCUSS] Removing the flink-mapr-fs module +1 for removing it

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it. Actually I encountered this issue several times. I thought it might be blocked by firewall of China :( BTW, I think it should be included in release notes. On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek wrote: > If we remove it, that would mean it’s not supported in Flin

Re: [DISCUSS] ARM support for Flink

I don't think it is feasible for Flink to migrate CI completely. Is there a way to add ARM tests on an external CI in addition? @Chesnay what do you think? On Fri, Jul 12, 2019 at 4:45 AM Xiyuan Wang wrote: > Hi Stephan > yeah, we should add an ARM CI first. But Travis CI doesn't support ARM

[jira] [Created] (FLINK-13466) Rename Batch/StreamTableSourceFactory methods for avoiding name clashes

Timo Walther created FLINK-13466: Summary: Rename Batch/StreamTableSourceFactory methods for avoiding name clashes Key: FLINK-13466 URL: https://issues.apache.org/jira/browse/FLINK-13466 Project: Flin

[jira] [Created] (FLINK-13465) Bump javassist to 3.24.0-GA

Chesnay Schepler created FLINK-13465: Summary: Bump javassist to 3.24.0-GA Key: FLINK-13465 URL: https://issues.apache.org/jira/browse/FLINK-13465 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13464) Bump powermock to 2.0.2

Chesnay Schepler created FLINK-13464: Summary: Bump powermock to 2.0.2 Key: FLINK-13464 URL: https://issues.apache.org/jira/browse/FLINK-13464 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Removing the flink-mapr-fs module

If we remove it, that would mean it’s not supported in Flink 1.9.0, yes. Or we only remove it in Flink 1.10.0. Aljoscha > On 29. Jul 2019, at 11:35, Biao Liu wrote: > > Hi Aljoscha, > > Does it mean the MapRFileSystem is no longer supported since 1.9.0? > > On Mon, Jul 29, 2019 at 5:19 PM Uf

Re: [DISCUSS] Removing the flink-mapr-fs module

Hi Aljoscha, Does it mean the MapRFileSystem is no longer supported since 1.9.0? On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi wrote: > +1 > > > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang wrote: > > > +1 to remove it. > > > > Aljoscha Krettek 于2019年7月29日周一 下午5:01写道： > > > > > Hi, > > > > > > B

Re: [DISCUSS] Support computed column for Flink SQL

Hi Danny, Thanks for bringing this. I agree with Timo. We can have a thorough discussion once 1.9 release is published. And the computed column support & implementation might be good to be discussed with "table source and sink concept"[1]. Whatever, I left some my initial thoughts in the doc. Bes

flink-connector-hive uses third-party repositories

Hi all, While trying to get the latest Flink master compiled within a corporate environment, I've noticed that the flink-connector-hive keeps failing. It appears that it uses dependencies which are not located in Maven Central, but on third-party repositories like Conjar. Examples are the org.p

[jira] [Created] (FLINK-13463) SQL VALUES might fail for Blink planner

Timo Walther created FLINK-13463: Summary: SQL VALUES might fail for Blink planner Key: FLINK-13463 URL: https://issues.apache.org/jira/browse/FLINK-13463 Project: Flink Issue Type: Bug

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang wrote: > +1 to remove it. > > Aljoscha Krettek 于2019年7月29日周一 下午5:01写道： > > > Hi, > > > > Because of recent problems in the dependencies of that module [1] I would > > suggest that we remove it. If people are using it, they can use the one > > from

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it. Aljoscha Krettek 于2019年7月29日周一 下午5:01写道： > Hi, > > Because of recent problems in the dependencies of that module [1] I would > suggest that we remove it. If people are using it, they can use the one > from Flink 1.8. > > What do you think about it? It would a) solve the dependen

[DISCUSS] Removing the flink-mapr-fs module

Hi, Because of recent problems in the dependencies of that module [1] I would suggest that we remove it. If people are using it, they can use the one from Flink 1.8. What do you think about it? It would a) solve the dependency problem and b) make our build a tiny smidgen more lightweight. Alj

Re: flink-mapr-fs failed in travis

I’m seeing the same issue when building this locally. I’ll start a DISCUSS thread so see about just removing the flink-mapr-fs module. Aljoscha > On 24. Jul 2019, at 05:00, JingsongLee > wrote: > > Sorry, > "It looks like it's been compiled all the time." > should be: "It looks like it can

Re: [DISCUSS] Support computed column for Flink SQL

Hi Danny, thanks for working on this issue and writing down the concept suggestion. We are currently still in the progress of finalizing the 1.9 release. Having proper streaming DDL support will definitely be part of Flink 1.10. I will take a look at the whole DDL efforts very soon once the 1

[jira] [Created] (FLINK-13462) Add table api examples into flink-quickstart

Jeff Zhang created FLINK-13462: -- Summary: Add table api examples into flink-quickstart Key: FLINK-13462 URL: https://issues.apache.org/jira/browse/FLINK-13462 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-13461) Distinguish between temporary tables and persisted tables

Dawid Wysakowicz created FLINK-13461: Summary: Distinguish between temporary tables and persisted tables Key: FLINK-13461 URL: https://issues.apache.org/jira/browse/FLINK-13461 Project: Flink

[jira] [Created] (FLINK-13460) Rework SerializedThrowableTest to not use Unsafe.defineClass()

Chesnay Schepler created FLINK-13460: Summary: Rework SerializedThrowableTest to not use Unsafe.defineClass() Key: FLINK-13460 URL: https://issues.apache.org/jira/browse/FLINK-13460 Project: Flink

[jira] [Created] (FLINK-13459) Violation of the order queue messages from RabbitMQ.

Dmitry Kharlashko created FLINK-13459: - Summary: Violation of the order queue messages from RabbitMQ. Key: FLINK-13459 URL: https://issues.apache.org/jira/browse/FLINK-13459 Project: Flink

Re: [DISCUSS] Publish the PyFlink into PyPI

Yes Till, I think you are correct that we should make sure that the published Flink Python API cannot be arbitrarily deleted. So, It seems that our current consensus is: 1. Should we re publish the PyFlink into PyPI --> YES 2. PyPI Project Name ---> apache-flink 3. How to handle Scala_2.11 and Sc

[jira] [Created] (FLINK-13458) ThreadLocalCache clashes for Blink planner

Timo Walther created FLINK-13458: Summary: ThreadLocalCache clashes for Blink planner Key: FLINK-13458 URL: https://issues.apache.org/jira/browse/FLINK-13458 Project: Flink Issue Type: Sub-ta