Tzu-Li (Gordon) Tai created FLINK-21276:
---
Summary: flink-statefun/statefun-sdk-java should mention Protobuf
in NOTICE and bundle its license
Key: FLINK-21276
URL: https://issues.apache.org/jira/browse/FLINK-
Hi everyone,
Regarding "table.planner" and "table.execution-mode"
If we define that those two options are just used to initialize the
TableEnvironment, +1 for introducing table options instead of sql-client
options.
Regarding "the sql client, we will maintain two parsers", I want to give
more inp
Hello,
I will work with some users to get data on that.
Thanks, Joe
> On 03.02.2021, at 14:58, Stephan Ewen wrote:
>
> Hi all!
>
> A quick thought on this thread: We see a typical stalemate here, as in so
> many discussions recently.
> One developer prefers it this way, another one another wa
Guowei Ma created FLINK-21275:
-
Summary: DataStreamTests::test_key_by_on_connect_stream Fail
Key: FLINK-21275
URL: https://issues.apache.org/jira/browse/FLINK-21275
Project: Flink
Issue Type: Bug
Wang Jichao created FLINK-21274:
---
Summary: At per-job mode，when the upload speed of the HDFS file
system is slow, the task exits abnormally, and the task archive file upload
fails.
Key: FLINK-21274
URL: https://iss
Yangze Guo created FLINK-21273:
--
Summary: Remove unused ExecutionVertexSchedulingRequirements
Key: FLINK-21273
URL: https://issues.apache.org/jira/browse/FLINK-21273
Project: Flink
Issue Type: B
Guowei Ma created FLINK-21272:
-
Summary: Resuming Savepoint (rocks, scale down, rocks timers)
end-to-end test' Fail
Key: FLINK-21272
URL: https://issues.apache.org/jira/browse/FLINK-21272
Project: Flink
Hi Xintong,
Thanks for the backgrounds!
I understand the impractical of operator level specifications and the value
of group level specifications. Just not that confident about “Coupling
between operator chaining / slot sharing”, seems to me, it requires more
knowledge than “Expose operator chain
Hi Jingsong, Godfrey and Jark,
I have updated the FLIP to incorporate your suggestions. Please let me know
if you have further comments. Thank you.
On Wed, Feb 3, 2021 at 4:51 PM Rui Li wrote:
> Thanks Godfrey & Jark for your comments!
>
> Since both of you mentioned the naming of the parser fa
Edit: The voting time of FLIP-156[1] has passed.
Best,
Yangze Guo
On Thu, Feb 4, 2021 at 1:25 PM Yangze Guo wrote:
>
> Hi all,
>
> The voting time for changing the Public API of FLIP-156[1] has passed.
> I'm closing the vote now.
>
> There were five +1 votes, 4 of which are binding:
>
> - Xinton
Hi all,
The voting time for changing the Public API of FLIP-156[1] has passed.
I'm closing the vote now.
There were five +1 votes, 4 of which are binding:
- Xintong Song (binding)
- Till (binding)
- Chesnay (binding)
- Yang Wang (non-binding)
- Zhu Zhu (binding)
There were no -1 votes.
Thus, F
Hi Kezhu,
Maybe let me share some backgrounds first.
- We at Alibaba have been using fine-grained resource management for
many years, with Blink (an internal version of Flink).
- We have been trying to contribute this feature to Apache Flink since
many years ago. However, we haven't s
Huang Xingbo created FLINK-21271:
Summary: DataStreamTests.test_key_by_on_connect_stream test failed
with "ArrayIndexOutOfBoundsException" in py35
Key: FLINK-21271
URL: https://issues.apache.org/jira/browse/FLINK-
Yangze Guo created FLINK-21270:
--
Summary: Generate the slot request respect to the resource
specification of SlotSharingGroup if present
Key: FLINK-21270
URL: https://issues.apache.org/jira/browse/FLINK-21270
Yangze Guo created FLINK-21269:
--
Summary: Introduce runtime interfaces for specifying SSG-based
resource requirements
Key: FLINK-21269
URL: https://issues.apache.org/jira/browse/FLINK-21269
Project: Flin
Frost Wong created FLINK-21268:
--
Summary: Logs view can't scoll in Firefox
Key: FLINK-21268
URL: https://issues.apache.org/jira/browse/FLINK-21268
Project: Flink
Issue Type: Bug
Compon
Yangze Guo created FLINK-21267:
--
Summary: FLIP-156: Runtime Interfaces for Fine-Grained Resource
Requirements
Key: FLINK-21267
URL: https://issues.apache.org/jira/browse/FLINK-21267
Project: Flink
chenkaiyin created FLINK-21266:
--
Summary: The POST request caused a JSON serialization error
Key: FLINK-21266
URL: https://issues.apache.org/jira/browse/FLINK-21266
Project: Flink
Issue Type: Bu
Thanks for initiating this discussion and creating the proposal!
I would like to contribute to this effort. Has there been related activity
since the FLIP was created?
If not, I would like to start work on a PoC to validate the design.
Questions/comments:
There could be more use cases for a hyb
Hi guys,
Regarding #3 and #4, I agree SHOW JARS is more consistent with other
commands than LIST JARS. I don't have a strong opinion about REMOVE vs
DELETE though.
While flink doesn't need to follow hive syntax, as far as I know, most
users who are requesting these features are previously hive us
Hi Partha,
PyFlink DataStream API is a newly introduced feature in Flink 1.12.
Currently, some basic operations (map/flat_map/filter/key_by/process, etc),
timer and state access operations are supported. We are also continuously
improving and enriching these APIs. Looking forward to your feedback!
Jark Wu created FLINK-21265:
---
Summary: SQLClientSchemaRegistryITCase.testReading failed with
DockerClientException unauthorized
Key: FLINK-21265
URL: https://issues.apache.org/jira/browse/FLINK-21265
Projec
tonychan created FLINK-21264:
Summary: at yarn-per-job mode, tm stopped ,the jm dont relase
resource,its also running
Key: FLINK-21264
URL: https://issues.apache.org/jira/browse/FLINK-21264
Project: Flink
Hello Folks,
We have some pipelines that contain multiple hops of Flink jobs with Kafka
transport layer in between. Data is finally written to analytical stores.
We want to measure e-2-e from the first source all the way to the last
sink(that writes to the analytical stores) and possibly also at o
Hi Becket,
I was looking into picking an item to work on and I came across this open
PR for the BinarizerMapper:
https://issues.apache.org/jira/browse/FLINK-13669
https://github.com/apache/flink/pull/9406
Could you please help me understand what is required for this to be merged?
Can I help?
Th
Lu Niu created FLINK-21263:
--
Summary: Job hangs under backpressure
Key: FLINK-21263
URL: https://issues.apache.org/jira/browse/FLINK-21263
Project: Flink
Issue Type: Bug
Affects Versions: 1.11.0
Till Rohrmann created FLINK-21262:
-
Summary: Remove SlotPool.suspend
Key: FLINK-21262
URL: https://issues.apache.org/jira/browse/FLINK-21262
Project: Flink
Issue Type: Bug
Component
Thanks for the summary. LGTM.
On Wed, 3 Feb 2021 at 20:25, Rui Li wrote:
> Thanks Jane for the summary. Looks good to me.
>
> On Wed, Feb 3, 2021 at 7:53 PM Jane Chan wrote:
>
> > Hi @Jark, @Timo, I've updated the comments, and please have a look when
> > you're free.
> >
> > Best,
> > Jane
> >
Hi everyone,
some feedback regarding the open questions. Maybe we can discuss the
`TableEnvironment.executeMultiSql` story offline to determine how we
proceed with this in the near future.
1) "whether the table environment has the ability to update itself"
Maybe there was some misunderstandi
Thank you all for reviewing and voting on the FLIP!
It has been accepted!
On Wed, Feb 3, 2021 at 4:58 AM Yu Li wrote:
> +1 (binding)
>
> Thanks for the efforts Robert!
>
> Best Regards,
> Yu
>
>
> On Mon, 1 Feb 2021 at 17:19, Matthias Pohl wrote:
>
> > Thanks Robert and congratulations on your
Hi all!
A quick thought on this thread: We see a typical stalemate here, as in so
many discussions recently.
One developer prefers it this way, another one another way. Both have
pro/con arguments, it takes a lot of time from everyone, still there is
little progress in the discussion.
Ultimately,
Hmm, maybe it was deleted again. I received an email notification yesterday.
On Wed, Feb 3, 2021 at 11:57 AM Xintong Song wrote:
> @Till,
> Did I overlook anything? I don't find Galen's post on the old PR.
>
> Thank you~
>
> Xintong Song
>
>
>
> On Wed, Feb 3, 2021 at 6:10 PM Till Rohrmann wrot
Jark Wu created FLINK-21261:
---
Summary: Improve digest of physical Expand node
Key: FLINK-21261
URL: https://issues.apache.org/jira/browse/FLINK-21261
Project: Flink
Issue Type: Improvement
Thanks Jane for the summary. Looks good to me.
On Wed, Feb 3, 2021 at 7:53 PM Jane Chan wrote:
> Hi @Jark, @Timo, I've updated the comments, and please have a look when
> you're free.
>
> Best,
> Jane
>
> On Wed, Feb 3, 2021 at 7:14 PM Jane Chan wrote:
>
> >
> > Reply @Timo
> >
> >> Remove the
Hi,
Can anyone suggest if PyFlink Data Stream APIs (available from Flink 1.12) are
being properly tested and used in any production environment/use-case without
any issue and gives expected performance?
Hi @Jark, @Timo, I've updated the comments, and please have a look when
you're free.
Best,
Jane
On Wed, Feb 3, 2021 at 7:14 PM Jane Chan wrote:
>
> Reply @Timo
>
>> Remove the `used` column for SHOW MODULES. It will always show true.
>>
> Good catch. It's a copy-paste typo, and I forgot to remo
Hi Till,
Based on what I understood, if not wrong, the door is not closed after SSG
resource specifying. So, hope it could be useful in potential future
improvement.
Best,
Kezhu Wang
On February 3, 2021 at 18:07:21, Till Rohrmann (trohrm...@apache.org) wrote:
Thanks for sharing your thoughts K
Hi, Yangze and Xintong, thank you for replies.
I indeed make assumptions, I list them here in order:
1. There is only task/LogicalSlot level resource specification in runtime.
And it comes from api side and is respected in runtime.
2. Current operator level resource specification in client side is
Reply @Timo
> Remove the `used` column for SHOW MODULES. It will always show true.
>
Good catch. It's a copy-paste typo, and I forgot to remove that column.
How about creating a POJO (static inner class of ModuleManager) called
> `ModuleEntry` or similar.
>
+1 for better encapsulation.
Reply @Ja
Robert Metzger created FLINK-21260:
--
Summary: Add DeclarativeScheduler / Finished state
Key: FLINK-21260
URL: https://issues.apache.org/jira/browse/FLINK-21260
Project: Flink
Issue Type: Sub
Robert Metzger created FLINK-21259:
--
Summary: Add DeclarativeScheduler / Failing state
Key: FLINK-21259
URL: https://issues.apache.org/jira/browse/FLINK-21259
Project: Flink
Issue Type: Sub-
Robert Metzger created FLINK-21258:
--
Summary: Add DeclarativeScheduler / Canceling state
Key: FLINK-21258
URL: https://issues.apache.org/jira/browse/FLINK-21258
Project: Flink
Issue Type: Su
Robert Metzger created FLINK-21257:
--
Summary: Add DeclarativeScheduler / Restarting state
Key: FLINK-21257
URL: https://issues.apache.org/jira/browse/FLINK-21257
Project: Flink
Issue Type: S
Robert Metzger created FLINK-21256:
--
Summary: Add DeclarativeScheduler / Executing state
Key: FLINK-21256
URL: https://issues.apache.org/jira/browse/FLINK-21256
Project: Flink
Issue Type: Su
Robert Metzger created FLINK-21255:
--
Summary: Add DeclarativeScheduler / WaitingForResources state
Key: FLINK-21255
URL: https://issues.apache.org/jira/browse/FLINK-21255
Project: Flink
Issu
Robert Metzger created FLINK-21254:
--
Summary: Add DeclarativeScheduler / Created state
Key: FLINK-21254
URL: https://issues.apache.org/jira/browse/FLINK-21254
Project: Flink
Issue Type: Sub
@Till,
Did I overlook anything? I don't find Galen's post on the old PR.
Thank you~
Xintong Song
On Wed, Feb 3, 2021 at 6:10 PM Till Rohrmann wrote:
> @Galen, I've just seen that you posted your ideas on the old Github PR. I
> think it would be better to post it on the JIRA ticket [1].
>
> [
A minor comment on `useModules(List names)`,
would be better to use varargs here to a more fluent API: `useModules("a",
"b", "c")`.
Besides, do we also need to add these new methods (useModules,
listFullModules) to
TableEnvironment?
Best,
Jark
On Wed, 3 Feb 2021 at 18:36, Timo Walther wrote:
>
Thanks for the nice summary Jane. The summary looks great. Some minor
feedback:
- Remove the `used` column for SHOW MODULES. It will always show true.
- `List> listFullModules()` is a very long
signature. And `Pair` should be avoided in code because it is not very
descriptive. How about creat
Hi everyone,
I did a summary on the Jira issue page [1] since the discussion has
achieved a consensus. If there is anything missed or not corrected, please
let me know.
[1] https://issues.apache.org/jira/browse/FLINK-21045#
Best,
Jane
On Wed, Feb 3, 2021 at 1:33 PM Jark Wu wrote:
> Hi Jan
@Galen, I've just seen that you posted your ideas on the old Github PR. I
think it would be better to post it on the JIRA ticket [1].
[1] https://issues.apache.org/jira/browse/FLINK-11838
Cheers,
Till
On Tue, Feb 2, 2021 at 12:02 PM Xintong Song wrote:
> Hi Galen,
>
> Thanks for offering the c
Thanks for sharing your thoughts Kezhu. I like your ideas of how
per-operator and SSG requirements can be combined. I've also thought about
defining a default resource profile for all tasks which have no resources
configured. That way all operators would have resources assigned if the
user chooses
Andy created FLINK-21253:
Summary: Support grouping set/cube/rollup syntax in WindowAggregate
Key: FLINK-21253
URL: https://issues.apache.org/jira/browse/FLINK-21253
Project: Flink
Issue Type: New Fe
Chesnay Schepler created FLINK-21252:
Summary: Scala quickstarts should specify -target jvm version
Key: FLINK-21252
URL: https://issues.apache.org/jira/browse/FLINK-21252
Project: Flink
Paul Lin created FLINK-21251:
Summary: Last valid checkpoint metadata lost after job exits
restart loop
Key: FLINK-21251
URL: https://issues.apache.org/jira/browse/FLINK-21251
Project: Flink
Iss
Fangliang Liu created FLINK-21250:
-
Summary: Failure to finalize checkpoint due to
org.apache.hadoop.fs.FileAlreadyExistsException:
/user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata
for client xxx.xx.xx.xxx already ex
Thanks Godfrey & Jark for your comments!
Since both of you mentioned the naming of the parser factory, I'll answer
this question first.
I only intend to introduce the pluggable Parser for blink planner. So
the BlinkParserFactory will be added to the flink-table-planner-blink
module. We already ha
lidesheng created FLINK-21249:
-
Summary: TableEnvironment does not support create method with
remote nvironment
Key: FLINK-21249
URL: https://issues.apache.org/jira/browse/FLINK-21249
Project: Flink
Ceyhan Kasap created FLINK-21248:
Summary: Checkpoint problem
Key: FLINK-21248
URL: https://issues.apache.org/jira/browse/FLINK-21248
Project: Flink
Issue Type: Bug
Components: Runt
+1 (binding)
Thanks,
Zhu
Yang Wang 于2021年2月2日周二 下午7:11写道：
> +1 (non-binding)
>
> Best,
> Yang
>
> Chesnay Schepler 于2021年2月2日周二 下午5:50写道：
>
> > +1
> >
> > On 2/2/2021 10:11 AM, Till Rohrmann wrote:
> > > +1 (binding)
> > >
> > > Cheers,
> > > Till
> > >
> > > On Mon, Feb 1, 2021 at 5:38 AM Xin
60 matches
Mail list logo
