+1
On Thu, Apr 23, 2020 at 4:10 PM Stephan Ewen wrote:
> Hi all!
>
> I want to bring up a discussion about when we want to do the feature freeze
> for 1.11.
>
> When kicking off the release cycle, we tentatively set the date to end of
> April, which would be in one week.
>
> I can say from the f
+1 for extending the feature freeze until May 15th.
Best,
Zhijiang
--
From:Danny Chan
Send Time:2020 Apr. 24 (Fri.) 10:51
To:dev
Subject:Re: [DISCUSS] Exact feature freeze date
+1 for extending the feature freeze until May 15th.
Lu Niu created FLINK-17364:
--
Summary: Support StreamingFileSink in PrestoS3FileSystem
Key: FLINK-17364
URL: https://issues.apache.org/jira/browse/FLINK-17364
Project: Flink
Issue Type: Improvement
robert created FLINK-17363:
--
Summary: Asynchronous association dimension table timeout
Key: FLINK-17363
URL: https://issues.apache.org/jira/browse/FLINK-17363
Project: Flink
Issue Type: Bug
+1 for extending the feature freeze until May 15th.
Best,
Danny Chan
在 2020年4月24日 +0800 AM9:51，Yangze Guo ，写道：
> +1
>
> Best,
> Yangze Guo
>
> On Fri, Apr 24, 2020 at 9:49 AM Dian Fu wrote:
> >
> > +1
> >
> > Regards,
> > Dian
> >
> > > 在 2020年4月24日，上午9:47，Leonard Xu 写道：
> > >
> > > + 1 for the
Hi everyone,
I'm happy to announce that we have unanimously approved this release.
There are 9 approving votes, 4 of which are binding:
* Robert (binding)
* Ufuk (binding)
* Dawid (binding)
* Jincheng (binding)
* Yu
* ZhuZhu
* Fabian
* Leonard Xu
* Dian
There are no disapproving votes.
Thanks e
Thanks Jincheng for the help. :)
Thanks,
Dian
> 在 2020年4月24日，上午9:49，jincheng sun 写道：
>
> +1（binding）
>
> with the check of built form the source and run some test case.
>
> BTW： I added you(dianfu) as a PyPI maintainer of Apache Flink.
>
> Best,
> Jincheng
>
>
> Dawid Wysakowicz 于2020年4月
+1
Best,
Yangze Guo
On Fri, Apr 24, 2020 at 9:49 AM Dian Fu wrote:
>
> +1
>
> Regards,
> Dian
>
> > 在 2020年4月24日，上午9:47，Leonard Xu 写道：
> >
> > + 1 for the feature freeze date
> >
> > Best,
> > Leonard Xu
> >
> >
> >> 在 2020年4月24日，09:32，Jingsong Li 写道：
> >>
> >> +1
> >>
> >> Best,
> >> Jingsong
Hi all,
Thanks a lot for checking and voting for this release! I’ll summarize the
result in another email.
Thanks,
Dian
> 在 2020年4月23日，下午7:43，Dawid Wysakowicz 写道：
>
> +1 (binding)
>
> - verified checksums and signatures
>
> - verified no binary artifacts in source release
>
> - reviewed th
Kurt Young created FLINK-17362:
--
Summary: Improve table examples to reflect latest status
Key: FLINK-17362
URL: https://issues.apache.org/jira/browse/FLINK-17362
Project: Flink
Issue Type: Impro
+1（binding）
with the check of built form the source and run some test case.
BTW： I added you(dianfu) as a PyPI maintainer of Apache Flink.
Best,
Jincheng
Dawid Wysakowicz 于2020年4月23日周四 下午7:43写道：
> +1 (binding)
>
> - verified checksums and signatures
>
> - verified no binary artifacts in sour
+1
Regards,
Dian
> 在 2020年4月24日，上午9:47，Leonard Xu 写道：
>
> + 1 for the feature freeze date
>
> Best,
> Leonard Xu
>
>
>> 在 2020年4月24日，09:32，Jingsong Li 写道：
>>
>> +1
>>
>> Best,
>> Jingsong Lee
>>
>> On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote:
>>
>>> +1 for extending the code freeze d
+ 1 for the feature freeze date
Best,
Leonard Xu
> 在 2020年4月24日，09:32，Jingsong Li 写道：
>
> +1
>
> Best,
> Jingsong Lee
>
> On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote:
>
>> +1 for extending the code freeze date.
>> FLIP-119 could benefit from it.
>> May 15th sounds reasonable.
>>
>> Tha
+1
Best,
Jingsong Lee
On Fri, Apr 24, 2020 at 2:27 AM Zhu Zhu wrote:
> +1 for extending the code freeze date.
> FLIP-119 could benefit from it.
> May 15th sounds reasonable.
>
> Thanks,
> Zhu Zhu
>
> Jark Wu 于2020年4月24日周五 上午12:01写道：
>
> > +1
> >
> > Thanks,
> > Jark
> >
> > On Thu, 23 Apr 2020
Hi Xuannan,
Thanks for picking up the FLIP. It looks good to me overall. Some quick
comments / questions below:
1. Do we also need changes in the Java API?
2. What are the cases that users may want to retry reading the intermediate
result? It seems that once the intermediate result has gone, it w
Flavio Pompermaier created FLINK-17361:
--
Summary: Support creating of a JDBC table using a custom query
Key: FLINK-17361
URL: https://issues.apache.org/jira/browse/FLINK-17361
Project: Flink
Flavio Pompermaier created FLINK-17360:
--
Summary: Support custom partitioners in JDBCReadOptions
Key: FLINK-17360
URL: https://issues.apache.org/jira/browse/FLINK-17360
Project: Flink
I
Prem Santosh created FLINK-17359:
Summary: Entropy key is not resolved if flink-s3-fs-hadoop is
added as a plugin
Key: FLINK-17359
URL: https://issues.apache.org/jira/browse/FLINK-17359
Project: Flink
Flavio Pompermaier created FLINK-17358:
--
Summary: JDBCTableSource support FiltertableTableSource
Key: FLINK-17358
URL: https://issues.apache.org/jira/browse/FLINK-17358
Project: Flink
Is
Flavio Pompermaier created FLINK-17357:
--
Summary: add "DROP catalog" DDL to blink planner
Key: FLINK-17357
URL: https://issues.apache.org/jira/browse/FLINK-17357
Project: Flink
Issue Typ
Flavio Pompermaier created FLINK-17356:
--
Summary: Properly set constraints (PK and UNIQUE)
Key: FLINK-17356
URL: https://issues.apache.org/jira/browse/FLINK-17356
Project: Flink
Issue Ty
Teng Fei Liao created FLINK-17355:
-
Summary: Exactly once kafka checkpointing sensitive to single node
failures
Key: FLINK-17355
URL: https://issues.apache.org/jira/browse/FLINK-17355
Project: Flink
+1 for extending the code freeze date.
FLIP-119 could benefit from it.
May 15th sounds reasonable.
Thanks,
Zhu Zhu
Jark Wu 于2020年4月24日周五 上午12:01写道：
> +1
>
> Thanks,
> Jark
>
> On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote:
>
> > +1
> > From our side we can also benefit from the extending of
+1
Thanks,
Jark
On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote:
> +1
> From our side we can also benefit from the extending of feature freeze, for
> pluggable slot allocation, GPU support and perjob mode on Kubernetes
> deployment.
>
> Thank you~
>
> Xintong Song
>
>
>
> On Thu, Apr 23, 2020
Benchao Li created FLINK-17354:
--
Summary: Introduce range sort for batch sort operator in blink
Key: FLINK-17354
URL: https://issues.apache.org/jira/browse/FLINK-17354
Project: Flink
Issue Type:
Seth Wiesman created FLINK-17353:
Summary: Broken links in Flink docs master
Key: FLINK-17353
URL: https://issues.apache.org/jira/browse/FLINK-17353
Project: Flink
Issue Type: Bug
C
+1
>From our side we can also benefit from the extending of feature freeze, for
pluggable slot allocation, GPU support and perjob mode on Kubernetes
deployment.
Thank you~
Xintong Song
On Thu, Apr 23, 2020 at 10:31 PM Timo Walther wrote:
> From the SQL side, I'm sure that FLIP-95 and FLIP-1
From the SQL side, I'm sure that FLIP-95 and FLIP-105 could benefit
from extending the feature freeze.
Thanks,
Timo
On 23.04.20 16:11, Aljoscha Krettek wrote:
+1
Aljoscha
On 23.04.20 15:23, Till Rohrmann wrote:
+1 for extending the feature freeze until May 15th.
Cheers,
Till
On Thu, Apr 2
Definitely +1! I'm always game for decreasing the API surface if it
doesn't decrease functionality.
Aljoscha
On 23.04.20 14:18, DONG, Weike wrote:
Hi Stephan,
+1 for the removal, as there are so many deprecated methods scattered
around, making APIs a little bit messy and confusing.
Best,
Wei
+1
Aljoscha
On 23.04.20 15:23, Till Rohrmann wrote:
+1 for extending the feature freeze until May 15th.
Cheers,
Till
On Thu, Apr 23, 2020 at 1:00 PM Piotr Nowojski wrote:
Hi Stephan,
As release manager I’ve seen that quite a bit of features could use of the
extra couple of weeks. This als
Hi, Manish.
If you would like to contribute to Flink, please read the "How to
Contribute" section on the website [1]. This thread has a different scope.
Feel free to reach out (in a separate thread) if you have any questions.
Marta
[1] https://flink.apache.org/contributing/how-to-contribute.htm
Hi,
I would also like to contribute to documentation and unit testing.
Please let me know.
Manish
On Thu, Apr 23, 2020 at 7:08 PM Marta Paes Moreira wrote:
>
> Thanks for the feedback!
>
> So far, the projects on the table are:
>
>1. Improving the Table API/SQL documentation.
>2. Improv
Thanks for the feedback!
So far, the projects on the table are:
1. Improving the Table API/SQL documentation.
2. Improving the documentation about Deployments.
3. Restructuring and standardizing the documentation about Connectors.
4. Finishing the Chinese translation.
I think 2. woul
+1 for extending the feature freeze until May 15th.
Cheers,
Till
On Thu, Apr 23, 2020 at 1:00 PM Piotr Nowojski wrote:
> Hi Stephan,
>
> As release manager I’ve seen that quite a bit of features could use of the
> extra couple of weeks. This also includes some features that I’m involved
> with,
David Anderson created FLINK-17352:
--
Summary: All doc links w/ site.baseurl & link tag are broken
Key: FLINK-17352
URL: https://issues.apache.org/jira/browse/FLINK-17352
Project: Flink
Issue
Hi!
Sorry for being a bit late to the party.
One very important thing to consider for "serialization under checkpoint
lock or not" is:
- If you do it under checkpoint lock, things are automatically correct.
Checkpoint barriers go between original records that correspond to offsets
in the source
Piotr Nowojski created FLINK-17351:
--
Summary: CheckpointCoordinator and CheckpointFailureManager
ignores checkpoint timeouts
Key: FLINK-17351
URL: https://issues.apache.org/jira/browse/FLINK-17351
Pr
Piotr Nowojski created FLINK-17350:
--
Summary: StreamTask should always fail immediately on failures in
synchronous part of a checkpoint
Key: FLINK-17350
URL: https://issues.apache.org/jira/browse/FLINK-17350
Aljoscha Krettek created FLINK-17349:
Summary: Reduce runtime of LocalExecutorITCase
Key: FLINK-17349
URL: https://issues.apache.org/jira/browse/FLINK-17349
Project: Flink
Issue Type: Imp
Hi Stephan,
+1 for the removal, as there are so many deprecated methods scattered
around, making APIs a little bit messy and confusing.
Best,
Weike
Stephan Ewen 于2020年4月23日 周四下午8:07写道：
> Hi all!
>
> There are a bunch of deprecated methods for state access:
>
> - RuntimeContext.getFoldingState
Hi all!
There are a bunch of deprecated methods for state access:
- RuntimeContext.getFoldingState(...)
- OperatorStateStore.getSerializableListState(...)
- OperatorStateStore.getOperatorState(...)
All of them have been deprecated for around three years now. All have good
alternatives.
T
Theo Diefenthal created FLINK-17348:
---
Summary: Expose metric group to ascendingTimestampExtractor
Key: FLINK-17348
URL: https://issues.apache.org/jira/browse/FLINK-17348
Project: Flink
Issu
Hi Manish!
Glad to hear that you're willing to contribute! All of our current tasks
are on the JIRA issue list (
https://issues.apache.org/jira/projects/FLINK/issues). Feel free to pick
what you like and start discussing and coding.
Manish G 于2020年4月23日周四 下午7:35写道：
> Hi All,
>
> I have just joi
+1 (binding)
- verified checksums and signatures
- verified no binary artifacts in source release
- reviewed the website PR
- built from source
- checked diff of source release between 1.9.2 for changes in licenses
and dependencies
- started standalone cluster and run StreamSQLExample
Best,
Hi All,
I have just joined the dev list.
I would like to contribute in my capacity as a programmer.
Please let me know if I can be helpful to any of the current task.
Manish
Hello everyone,
Currently, all development in docker-flink occurs on the master branch,
for all releases at once. The master branch also serves as a publishing
area for our docker files.
This means that all versions share the same generators, templates (i.e.,
production code that we plugin i
Hi,
Yes, you are correct. Flink does use a minSplitSize to determine the
splits. I missed that part.
Also this is the part I do not intend to change.
In this I would focus on essentially:
- "is splittable" is decided per file --> Similar to Hadoop: Both a codec
and fileformat get a "isSplittable"
Hi Stephan,
As release manager I’ve seen that quite a bit of features could use of the
extra couple of weeks. This also includes some features that I’m involved with,
like FLIP-76, or limiting the in-flight buffers.
+1 From my side for extending the feature freeze until May 15th.
Piotrek
> O
dianfu commented on issue #329:
URL: https://github.com/apache/flink-web/pull/329#issuecomment-618330787
@carp84 @uce Thanks a lot for the review. I will update the post date and
release date before merging this PR.
This is
Yadong Xie created FLINK-17347:
--
Summary: upgrade to latest angular version
Key: FLINK-17347
URL: https://issues.apache.org/jira/browse/FLINK-17347
Project: Flink
Issue Type: Improvement
+1 (binding)
- checked release notes ✅
- verified sums and hashes ✅
- verified no binary artifacts in source release ✅
- reviewed website PR ✅
- built from source ✅
- built an internal Flink distribution based on the 1.9.3-rc1 commit ✅
- built internal jobs against the staging repo ✅
- deployed th
This would only work so long as all Hadoop APIs do not directly expose
any transitive non-hadoop dependency.
Otherwise the user code classloader might search for this transitive
dependency in lib instead of the hadoop classpath (and possibly not find
it).
On 23/04/2020 11:34, Stephan Ewen wrot
True, connectors built on Hadoop make this a bit more complex. That is also
the reason why Hadoop is on the "parent first" patterns.
Maybe this is a bit of a wild thought, but what would happen if we had a
"first class" notion of a Hadoop Classloader in the system, and the user
code classloader wo
Hi Niels,
Thanks for start this discussion. Share some thought about your
questions/proposals.
> Judge whether splittable for each individual file
Looks good to me.
> BZIP2 support splittable
Looks good to me.
> the Flink implementation is controlled by the number of splits
Can you check again?
Hi all
We need add some custom labels on MetricReporter.
We can add groupingKey to PrometheusPushGatewayReporter in version 1.10, but
not in PrometheusReporter.
Can we add several methods to the interface MetricReporter to support?
Best Regards
jinhai...@gmail.com
Chesnay Schepler created FLINK-17346:
Summary: Deduplicate process setup in docker tests
Key: FLINK-17346
URL: https://issues.apache.org/jira/browse/FLINK-17346
Project: Flink
Issue Type:
Wei Zhong created FLINK-17345:
-
Summary: Support registering and getting Python UDF in HiveCatalog
Key: FLINK-17345
URL: https://issues.apache.org/jira/browse/FLINK-17345
Project: Flink
Issue Typ
Andrey Zagrebin created FLINK-17344:
---
Summary: RecordWriterTest.testIdleTime possibly deadlocks on Travis
Key: FLINK-17344
URL: https://issues.apache.org/jira/browse/FLINK-17344
Project: Flink
+1 (binding)
- for license documentation, I checked the diff between 1.9.2 and 1.9.3:
https://github.com/apache/flink/compare/release-1.9.2...release-1.9.3-rc1
- Kafka dependency changed from 0.10.2.1 to 0.10.2.2 --> License doc was
updated in PR https://github.com/apache/flink/pull/11617/files
although, if you can load the HADOOP_CLASSPATH as a plugin, then you can
also load it in the user-code classloader.
On 23/04/2020 10:50, Chesnay Schepler wrote:
@Stephan I'm not aware of anyone having tried that; possibly since we
have various connectors that require hadoop (hadoop-compat, hive
@Stephan I'm not aware of anyone having tried that; possibly since we
have various connectors that require hadoop (hadoop-compat, hive,
orc/parquet/hbase, hadoop inputformats). This would require connectors
to be loaded as plugins (or having access to the plugin classloader) to
be feasible.
O
Benchao Li created FLINK-17343:
--
Summary: Add doc for retraction behavior for all operators
Key: FLINK-17343
URL: https://issues.apache.org/jira/browse/FLINK-17343
Project: Flink
Issue Type: Imp
Roman Khachatryan created FLINK-17342:
-
Summary: Schedule savepoint if max-inflight-checkpoints limit is
reached isntead of forcing (in UC mode)
Key: FLINK-17342
URL: https://issues.apache.org/jira/browse/FLIN
huweihua created FLINK-17341:
Summary: freeSlot in TaskExecutor.closeJobManagerConnection cause
ConcurrentModificationException
Key: FLINK-17341
URL: https://issues.apache.org/jira/browse/FLINK-17341
Proj
Kurt Young created FLINK-17340:
--
Summary: Update docs which related to default planner changes
Key: FLINK-17340
URL: https://issues.apache.org/jira/browse/FLINK-17340
Project: Flink
Issue Type:
Kurt Young created FLINK-17339:
--
Summary: Change default planner to blink and update test cases in
both planners
Key: FLINK-17339
URL: https://issues.apache.org/jira/browse/FLINK-17339
Project: Flink
Hi,
I wanted to spend some time on this idea I asked about a year ago.
So I had a look at the actual code and found this where the file splits are
calculated
https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/api/common/io/FileInputFormat.java#L601
What I rea
Hi all!
I want to bring up a discussion about when we want to do the feature freeze
for 1.11.
When kicking off the release cycle, we tentatively set the date to end of
April, which would be in one week.
I can say from the features I am involved with (FLIP-27, FLIP-115,
reviewing some state backe
Hi all!
+1 for the simplification of dropping hadoop-shaded
Have we ever investigated how much work it would be to load the
HADOOP_CLASSPATH through the plugin loader? Then Hadoop's crazy dependency
footprint would not spoil the main classpath.
- HDFS might be very simple, because file system
Hey all,
I wanted to remind everybody that we've started this nice initiative with
the "Flink Engine Room" / dev blog.
It would be great if we could start filling it with more content.
In my opinion, the blog posts can be fairly unpolished, as it's more
important to share the knowledge than to ma
FYI: I have moved the Flink PR and master builds from my personal Azure
account to a PMC controlled account:
https://dev.azure.com/apache-flink/apache-flink/_build
On Fri, Apr 17, 2020 at 8:28 PM Robert Metzger wrote:
> Thanks a lot for bringing up this topic again.
> The reason why I was hesita
Robert Metzger created FLINK-17338:
--
Summary: LocalExecutorITCase.testBatchQueryCancel test timeout
Key: FLINK-17338
URL: https://issues.apache.org/jira/browse/FLINK-17338
Project: Flink
Iss
Jark Wu created FLINK-17337:
---
Summary: Send UPDATE messages instead of INSERT and DELETE in
streaming join operator
Key: FLINK-17337
URL: https://issues.apache.org/jira/browse/FLINK-17337
Project: Flink
Robert Metzger created FLINK-17336:
--
Summary: MVN exited with EXIT CODE: 143. in "libraries" test job
Key: FLINK-17336
URL: https://issues.apache.org/jira/browse/FLINK-17336
Project: Flink
I
74 matches
Mail list logo
