Thanks a lot for putting this together, Dian! Definitely +1 for this!
It is great to make sure that the resources used by the Python process are
managed properly by Flink’s resource management framework.
Also, thanks to the guys that working on the unified memory management
framework.
Best, Hequn
Zhenghua Gao created FLINK-14925:
Summary: the return type of TO_TIMESTAMP should be Timestamp(9)
instead of Timestamp(3)
Key: FLINK-14925
URL: https://issues.apache.org/jira/browse/FLINK-14925
Projec
Hi Dawid,
I don't have other concerns now. Thanks for the explanation.
Best,
Jark
On Thu, 21 Nov 2019 at 18:13, Kurt Young wrote:
> Hi all,
>
> After some offline discussion with Dawid, I changed my mind. We still agree
> on that
> we should only support reading from tables with primary key, f
Leonard Xu created FLINK-14924:
--
Summary: CsvTableSource can not config empty column as null
Key: FLINK-14924
URL: https://issues.apache.org/jira/browse/FLINK-14924
Project: Flink
Issue Type: Bu
Yu Li created FLINK-14923:
-
Summary: Add performance e2e test suite for shuffle service
Key: FLINK-14923
URL: https://issues.apache.org/jira/browse/FLINK-14923
Project: Flink
Issue Type: Bug
Yu Li created FLINK-14922:
-
Summary: Add performance e2e test suite for state backend
Key: FLINK-14922
URL: https://issues.apache.org/jira/browse/FLINK-14922
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14921:
-
Summary: Add more metrics for performance end to end benchmark
Key: FLINK-14921
URL: https://issues.apache.org/jira/browse/FLINK-14921
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14920:
-
Summary: Set up environment to run performance e2e tests
Key: FLINK-14920
URL: https://issues.apache.org/jira/browse/FLINK-14920
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14919:
-
Summary: Add performance e2e test suite for basic operations
Key: FLINK-14919
URL: https://issues.apache.org/jira/browse/FLINK-14919
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14918:
-
Summary: Add performance e2e test module and scripts
Key: FLINK-14918
URL: https://issues.apache.org/jira/browse/FLINK-14918
Project: Flink
Issue Type: Sub-task
Yu Li created FLINK-14917:
-
Summary: Add end to end performance testing framework
Key: FLINK-14917
URL: https://issues.apache.org/jira/browse/FLINK-14917
Project: Flink
Issue Type: New Feature
Hi All,
Since the voting time has passed and we've reached a consensus on the
further discussions [1], I'm concluding the vote now.
Result:
- 6 x +1 (binding)
- 9 x +1 (non-binding)
- 0 x -1
- 0 x +/-0
Since there're enough binding votes and no disapproval, the vote has passed
and FLIP-8
Hi Gyula,
I did not meant to say the MetricsReporter code should stay with the metric
storage, e.g. Kafka. I am trying to argue that metric reporter is a plugin
less related to Flink, but more related to a specific user environment. If
we include such plugins into Flink, as time goes, the user env
Zili Chen created FLINK-14916:
-
Summary: Asynchronously deploy cluster in
AbstractJobClusterExecutor#execute
Key: FLINK-14916
URL: https://issues.apache.org/jira/browse/FLINK-14916
Project: Flink
Zili Chen created FLINK-14915:
-
Summary: SchedulingStrategyFactory#createInstance might not need
to know JobGraph
Key: FLINK-14915
URL: https://issues.apache.org/jira/browse/FLINK-14915
Project: Flink
Bowen Li created FLINK-14914:
Summary: refactor CatalogFunction interface and impls to add
language field
Key: FLINK-14914
URL: https://issues.apache.org/jira/browse/FLINK-14914
Project: Flink
I
Bowen Li created FLINK-14913:
Summary: refactor CatalogFunction interface and impls by removing
properties map
Key: FLINK-14913
URL: https://issues.apache.org/jira/browse/FLINK-14913
Project: Flink
Bowen Li created FLINK-14912:
Summary: register,drop, and alter catalog functions from DDL to
FunctionCatalog
Key: FLINK-14912
URL: https://issues.apache.org/jira/browse/FLINK-14912
Project: Flink
Bowen Li created FLINK-14911:
Summary: register temp catalog functions created by DDL to
FunctionCatalog
Key: FLINK-14911
URL: https://issues.apache.org/jira/browse/FLINK-14911
Project: Flink
Is
William Cheng created FLINK-14910:
-
Summary: disableAutoGeneratedUIDs fails on keyBy
Key: FLINK-14910
URL: https://issues.apache.org/jira/browse/FLINK-14910
Project: Flink
Issue Type: Bug
Zhu Zhu created FLINK-14909:
---
Summary: Let tasks in a batch get scheduled in topological order
and subtaskIndex ascending pattern
Key: FLINK-14909
URL: https://issues.apache.org/jira/browse/FLINK-14909
Proj
Thanks Aihua for the explanation.
The proposal looks good to me then.
Thanks,
Zhu Zhu
aihua li 于2019年11月21日周四 下午3:59写道：
> Thanks for the comments Zhu Zhu!
>
> > 1. How do we measure the job throughput? By measuring the job execution
> > time on a finite input data set, or measuring the QPS when
Dawid Wysakowicz created FLINK-14908:
Summary: Distributing CacheFiles through DFS does not work
Key: FLINK-14908
URL: https://issues.apache.org/jira/browse/FLINK-14908
Project: Flink
Iss
Konstantin Knauf created FLINK-14907:
Summary: Support to Configure Azure Storage Key via Environment
Variable
Key: FLINK-14907
URL: https://issues.apache.org/jira/browse/FLINK-14907
Project: Flin
Zhenqiu Huang created FLINK-14906:
-
Summary: Add function related method in CatalogManager
Key: FLINK-14906
URL: https://issues.apache.org/jira/browse/FLINK-14906
Project: Flink
Issue Type: S
+1 (binding)
Best,
Gary
On Thu, Nov 21, 2019 at 7:55 AM Zhu Zhu wrote:
> Thanks Yu for this proposal.
> +1(non-binding) for the overall design.
>
> I have 2 questions about the result check though. Posted in the discussion
> ML thread.
>
> Thanks,
> Zhu Zhu
>
> Becket Qin 于2019年11月21日周四 上午11:5
Chesnay Schepler created FLINK-14905:
Summary: Unify packaging process
Key: FLINK-14905
URL: https://issues.apache.org/jira/browse/FLINK-14905
Project: Flink
Issue Type: Sub-task
Timo Walther created FLINK-14904:
Summary: Rename ANY type to RAW type
Key: FLINK-14904
URL: https://issues.apache.org/jira/browse/FLINK-14904
Project: Flink
Issue Type: Sub-task
Co
Timo Walther created FLINK-14903:
Summary: Relax structured types constraints
Key: FLINK-14903
URL: https://issues.apache.org/jira/browse/FLINK-14903
Project: Flink
Issue Type: Sub-task
hailong wang created FLINK-14902:
Summary: JDBCTableSource support AsyncLookupFunction
Key: FLINK-14902
URL: https://issues.apache.org/jira/browse/FLINK-14902
Project: Flink
Issue Type: Impro
Andrey Zagrebin created FLINK-14901:
---
Summary: Throw Error in MemoryUtils if there is problem with using
system classes over reflection
Key: FLINK-14901
URL: https://issues.apache.org/jira/browse/FLINK-14901
Thank you very much. It works for me.
> 在 2019年11月14日，下午1:06，Biao Liu 写道：
>
> Hi,
>
> I have encountered the same issue when setting up a dev environment.
>
> It seems that the my Intellij (2019.2.1) unexpectedly activates java11
> profile of maven. It doesn't match the Java compiler (JDK8). I
Leonard Xu created FLINK-14900:
--
Summary: output contains null value when a is null where a <>
'String'
Key: FLINK-14900
URL: https://issues.apache.org/jira/browse/FLINK-14900
Project: Flink
godfrey he created FLINK-14899:
--
Summary: can not be translated to StreamExecDeduplicate when
PROCTIME is defined in query
Key: FLINK-14899
URL: https://issues.apache.org/jira/browse/FLINK-14899
Project:
Andrey Zagrebin created FLINK-14898:
---
Summary: Enable background cleanup of state with TTL by default
Key: FLINK-14898
URL: https://issues.apache.org/jira/browse/FLINK-14898
Project: Flink
Rui Li created FLINK-14897:
--
Summary: HiveTableOutputFormat fails to finalize on master
Key: FLINK-14897
URL: https://issues.apache.org/jira/browse/FLINK-14897
Project: Flink
Issue Type: Bug
+1 (binding)
* built master against flink-shaded 9.0 and jackson 2.10.1 (via
https://repository.apache.org/content/repositories/orgapacheflink-1275)
- code: https://github.com/uce/flink/tree/flink-shaded-9.0
- travis: https://travis-ci.org/uce/flink/builds/615013399
* ran examples against web
Michel Davit created FLINK-14896:
Summary: Kinesis connector doesn't shade jackson dependency
Key: FLINK-14896
URL: https://issues.apache.org/jira/browse/FLINK-14896
Project: Flink
Issue Type
Leonard Xu created FLINK-14895:
--
Summary: same rank in rollup row with group row that all group key
are null
Key: FLINK-14895
URL: https://issues.apache.org/jira/browse/FLINK-14895
Project: Flink
Gary Yao created FLINK-14894:
Summary: HybridOffHeapUnsafeMemorySegmentTest#testByteBufferWrap
failed on Travis
Key: FLINK-14894
URL: https://issues.apache.org/jira/browse/FLINK-14894
Project: Flink
hailong wang created FLINK-14893:
Summary: Using Child ClassLoader to load class when Parent
ClassLoader couldn't load in ParentFirstPatterns
Key: FLINK-14893
URL: https://issues.apache.org/jira/browse/FLINK-148
Congxian Qiu(klion26) created FLINK-14892:
-
Summary: Add description for checkpoint directory layout
Key: FLINK-14892
URL: https://issues.apache.org/jira/browse/FLINK-14892
Project: Flink
Dian Fu created FLINK-14891:
---
Summary: PythonScalarFunctionOperator should be chained with
upstream operators by default
Key: FLINK-14891
URL: https://issues.apache.org/jira/browse/FLINK-14891
Project: Flin
Hi
thanks for your explanation, what you want is to disable periodic
checkpoint in some time duration, and at other times the periodic
checkpoint is doing as normal. Currently, Flink does not support this, as
you've created an issue for this, we can track this in the issue side. for
now, if you re
Jun Qin created FLINK-14890:
---
Summary: TestHarness for KeyedBroadcastProcessFunction
Key: FLINK-14890
URL: https://issues.apache.org/jira/browse/FLINK-14890
Project: Flink
Issue Type: Improvement
Hello everyone,
Flink 1.9 shipped with a new UI, with the old one being kept around as a
backup in case something wasn't working as expected.
Currently there are no issues indicating any significant problems
(exclusive to the new UI), so I wanted to check what people think about
dropping the
Zhenghua Gao created FLINK-14889:
Summary: TIMESTAMPADD/TIMESTAMPDIFF with microsecond/nanosecond
unit lost precision
Key: FLINK-14889
URL: https://issues.apache.org/jira/browse/FLINK-14889
Project: F
Dian Fu created FLINK-14888:
---
Summary: Move the Python SqlDialect to module table
Key: FLINK-14888
URL: https://issues.apache.org/jira/browse/FLINK-14888
Project: Flink
Issue Type: Task
C
So this probably doesn't belong in this thread, but here goes:
When you think of the metric system as source and reporters and sinks,
one has to consider what he source emits:
Either:
a) events for added/removed metrics
b) periodically emit the values of all metrics, with the plethora of
addi
Hi all,
After some offline discussion with Dawid, I changed my mind. We still agree
on that
we should only support reading from tables with primary key, forbid writing
to such table.
But the enforce flag should be introduced with primary key, and probably
should be
`NOR ENFORCE` be default. The p
Kurt Young created FLINK-14887:
--
Summary: Provide a dedicated test class for SqlDateTimeUtils
Key: FLINK-14887
URL: https://issues.apache.org/jira/browse/FLINK-14887
Project: Flink
Issue Type: I
Hi,
I agree with Dawid that we should either fully accept FLIPs or don’t accept
them and split them off into smaller parts when necessary. This happened for
the configuration FLIP-54 [1], where we couldn’t find consensus on the bigger
issue and then created FLIP-77 [2]. This makes it clear what
+1 (non-binding)
- verified the signature and checksum
- checked the maven central artifices
- checked "release-9.0-rc1" source code
- verified website pull request listing the new release
Best,
Jingsong Lee
On Thu, Nov 21, 2019 at 5:28 PM Dian Fu wrote:
> +1 (non-binding)
>
> - verified the s
+1 (non-binding)
- verified the signature and checksum
- checked the maven central artifices
Regards,
Dian
On Wed, Nov 20, 2019 at 8:47 PM tison wrote:
> +1 (non-binding)
>
> Best,
> tison.
>
>
> Aljoscha Krettek 于2019年11月20日周三 下午6:58写道：
>
> > +1 (binding)
> >
> > Best,
> > Aljoscha
> >
> >
Hi Yun and Congxian,
I would actually want checkpoint to avoid being triggered on a certain
time. It still remains as system mechanism just avoid being triggered at a
certain range of time.
Waiting for the checkpoint to timeout still waste CPU&disk IO resources
since it was being triggered. I would
Leonard Xu created FLINK-14886:
--
Summary: Wrong result in scalar query using blink planner
Key: FLINK-14886
URL: https://issues.apache.org/jira/browse/FLINK-14886
Project: Flink
Issue Type: Bug
Zili Chen created FLINK-14885:
-
Summary: YarnClusterDescriptor should not know about detached
option
Key: FLINK-14885
URL: https://issues.apache.org/jira/browse/FLINK-14885
Project: Flink
Issue
Hi Shuwen
Conceptually, checkpoints in Flink behaves more like a system mechanism to
achieve fault tolerance and transparent for users. On the other hand, savepoint
in Flink behaves more like a user control behavior, can savepoint not satisfy
your demands for crontab?
Best
Yun Tang
From: Cong
Hi all,
According to our previous discussion in [1], I'd like to bring up a vote to set
up a secur...@flink.apache.org mailing list.
The vote will be open for at least 72 hours (excluding weekend). I'll try to
close it by 2019-11-26 18:00 UTC, unless there is an objection or not enough
votes.
Thanks for the comments Zhu Zhu!
> 1. How do we measure the job throughput? By measuring the job execution
> time on a finite input data set, or measuring the QPS when the job has
> reached a stable state?
>I ask this because that, with LazyFromSource schedule mode, tasks are
> launched gradua
61 matches
Mail list logo
