+1 for releasing 1.17.1
Best,
Jingsong
On Thu, May 11, 2023 at 1:29 PM Gyula Fóra wrote:
>
> +1 for the release
>
> Gyula
>
> On Thu, 11 May 2023 at 05:35, Yun Tang wrote:
>
> > +1 for release flink-1.17.1
> >
> > The blocker issue might cause silent incorrect data, it's better to have a
> > fi
+1 for releasing 1.16.2
Best,
Jingsong
On Thu, May 11, 2023 at 1:28 PM Gyula Fóra wrote:
>
> +1 for the release
>
> Gyula
>
> On Thu, 11 May 2023 at 05:08, weijie guo wrote:
>
> > [1]
> >
> > https://issues.apache.org/jira/browse/FLINK-31092?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%20
Hi Mang,
Thanks for starting this FLIP.
I have some doubts about the `TwoPhaseCatalogTable`. Generally, our
Flink design places execution in the TableFactory or directly in the
Catalog, so introducing an executable table makes me feel a bit
strange. (Spark is this style, but Flink may not be)
An
Thanks Ron for the proposal.
Do you have some benchmark results for the performance improvement? I
am more concerned about the improvement on Flink than the data in
other papers.
Best,
Jingsong
On Mon, May 29, 2023 at 2:16 PM liu ron wrote:
>
> Hi, dev
>
> I'd like to start a discussion about F
Thanks Yuxia for the proposal.
> CALL [catalog_name.][database_name.]procedure_name ([ expression [,
> expression]* ] )
The expression can be a function call. Does this need to be a function
call? Do you have some example?
> Procedure returns T[]
Procedure looks like a TableFunction, do you co
rting only Calc&HashJoin&HashAgg operator. In
> some queries, we even get more than 30% gain, it looks like an effective
> way.
>
> Best,
> Ron
>
> Jingsong Li 于2023年5月29日周一 14:33写道：
>
> > Thanks Ron for the proposal.
> >
> > Do you have some
+1, the fallback looks weird now, it is outdated.
But, it is good to provide an option. I don't know if there are some
users who depend on this fallback.
Best,
Jingsong
On Tue, May 30, 2023 at 1:47 PM Rui Li wrote:
>
> +1, the fallback was just intended as a temporary workaround to run
> catal
e
> amount of data, I think we can change to return type from T[] to Iterable
>
> [1]: https://iceberg.apache.org/docs/latest/spark-procedures/#migrate
> [2]:
> https://github.com/apache/iceberg/blob/601c5af9b6abded79dabeba177331310d5487f43/spark/v3.2/spark/src/main/java/org/apache/spar
Thanks Feng,
Just naming, maybe `createCatalog` in TableEnv, I can see many
functions are converted to createxxx from registerxxx.
On Fri, Jun 2, 2023 at 11:04 AM Feng Jin wrote:
>
> Hi jark, thanks for your suggestion.
>
> > 1. How to register the CatalogStore for Table API? I think the
> Catal
ides, if there is a complete test graph with all TPC-DS queries, the
> > > effect of this FLIP will be more intuitive.
> > >
> > > Best,
> > > Jark
> > >
> > >
> > >
> > > On Wed, 31 May 2023 at 14:27, liu ron w
+1 (binding)
- checked NOTICE and LICENSE
- Verified signatures and hashes
- Build and compile the source code locally
- No unexpected binaries in the source release
Something can be improved:
- NOTICE file can be updated to 2014-2023 from 2014-2022.
Best,
Jingsong
On Tue, Jun 6, 2023 at 3:59
+1
On Wed, Jun 7, 2023 at 3:03 PM Benchao Li wrote:
>
> +1, binding
>
> Jark Wu 于2023年6月7日周三 14:44写道：
>
> > +1 (binding)
> >
> > Best,
> > Jark
> >
> > > 2023年6月7日 14:20，liu ron 写道：
> > >
> > > Hi everyone,
> > >
> > > Thanks for all the feedback about FLIP-315: Support Operator Fusion
> > Code
e.org/confluence/display/FLINK/FLIP-305%3A+Support+atomic+for+CREATE+TABLE+AS+SELECT%28CTAS%29+statement
>
>
> --
>
> Best regards,
>
> Mang Zhang
>
>
>
> At 2023-05-12 13:02:14, "Jingsong Li" wrote:
> >Hi Mang,
> >
> >Thanks for start
+1
On Mon, Jun 12, 2023 at 10:32 PM Rui Fan <1996fan...@gmail.com> wrote:
>
> +1 (binding)
>
> Best,
> Rui Fan
>
> On Mon, Jun 12, 2023 at 22:20 Benchao Li wrote:
>
> > +1 (binding)
> >
> > yuxia 于2023年6月12日周一 17:58写道：
> >
> > > Hi everyone,
> > > Thanks for all the feedback about FLIP-311: Supp
+1
On Mon, Jun 12, 2023 at 10:25 PM Rui Fan <1996fan...@gmail.com> wrote:
>
> +1 (binding)
>
> Best,
> Rui Fan
>
> On Mon, Jun 12, 2023 at 19:58 liu ron wrote:
>
> > +1 (no-binding)
> >
> > Best,
> > Ron
> >
> > Jing Ge 于2023年6月12日周一 19:33写道：
> >
> > > +1(binding) Thanks!
> > >
> > > Best regard
+1 for this.
Actually, this is a headache for Flink SQL too.
There is certainly a lot of updated data (CDC changelog) in real
stream processing, The semantics here is the need to ensure the order
between keys, and different keys can be handled in disorder.
I'm very happy that the community has a
Thanks Becket and all for your discussion.
> 1. We say this FLIP is enforced starting release 2.0. For current 1.x APIs,
we provide a migration period with best effort, while allowing exceptions
for immediate removal in 2.0. That means we will still try with best effort
to get the ProcessFuncion A
Looks good to me!
Thanks Dong, Yunfeng and all for your discussion and design.
Best,
Jingsong
On Tue, Jun 27, 2023 at 3:35 PM Jark Wu wrote:
>
> Thank you Dong for driving this FLIP.
>
> The new design looks good to me!
>
> Best,
> Jark
>
> > 2023年6月27日 14:38，Dong Lin 写道：
> >
> > Thank you Leo
+1 binding
On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote:
>
> Hi all,
>
> We would like to start the vote for FLIP-309: Support using larger
> checkpointing interval when source is processing backlog [1]. This FLIP was
> discussed in this thread [2].
>
> Flink 1.18 release will feature freeze o
> do we have any plan to offer a lighter Source API to decrease the connector
> development cost?
I remember mentioning it many times, but no contributor did it. ToT
Best,
Jingsong
On Tue, Jul 4, 2023 at 11:01 AM Leonard Xu wrote:
>
> +1 to deprecate.
> +1 for David’s points.
>
> I’ve one rela
+1 binding
On Tue, Jul 4, 2023 at 10:40 AM Zhu Zhu wrote:
>
> +1 (binding)
>
> Thanks,
> Zhu
>
> ConradJam 于2023年7月3日周一 22:39写道：
> >
> > +1 (no-binding)
> >
> > Matthias Pohl 于2023年7月3日周一 22:33写道：
> >
> > > Thanks, Becket
> > >
> > > +1 (binding)
> > >
> > > On Mon, Jul 3, 2023 at 10:44 AM Jing
Congratulations!
Thank you! All of the Flink community!
Best,
Jingsong
On Tue, Jul 4, 2023 at 1:24 PM tison wrote:
>
> Congrats and with honor :D
>
> Best,
> tison.
>
>
> Mang Zhang 于2023年7月4日周二 11:08写道：
>
> > Congratulations!--
> >
> > Best regards,
> > Mang Zhang
> >
> >
> >
> >
> >
> > 在 20
+1
On Mon, Jul 10, 2023 at 10:46 AM Yuan Mei wrote:
>
> +1 (binding)
>
> Thanks for driving this!
>
> Best
> Yuan
>
> On Mon, Jul 10, 2023 at 10:26 AM Jark Wu wrote:
>
> > +1 (binding)
> >
> > Thanks for driving this. Looking forward to starting the 2.0 works.
> >
> > Best,
> > Jark
> >
> > On
It's exciting to finally have someone to refactor the Flink website.
Thanks Deepthi.
To Xintong,
> maintain two sets of website designs at the same time
If our website is not so complex, and new webui can be full feature
coverage, there would be no need to maintain two sets of web.
To Jing
+1
+1 to Leonard and Galen and Jing.
About Source and Sink.
We're still missing quite a bit of work, including functionality,
including ease of use, including bug fixes, and I'm not sure we'll be
completely done by 2.0.
Until that's done, we won't be in a position to clean up the old APIs.
Best,
Jin
+1 binding
Thanks Dong for continuous driving.
Best,
Jingsong
On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote:
>
> +1 (binding)
>
> Best,
> Jark
>
> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski wrote:
>
> > +1 (binding)
> >
> > Piotrek
> >
> > wt., 18 lip 2023 o 08:51 Jing Ge napisał(a):
> >
>
+1
On Thu, Jul 20, 2023 at 12:31 PM Jane Chan wrote:
>
> Hi, devs,
>
> I would like to start a discussion on FLIP-346: Deprecate ManagedTable
> related APIs[1].
>
> These APIs were initially designed for Flink Table Store, which has
> joined the Apache Incubator as a separate project called Apach
Hi, everyone
On behalf of the PMC, I'm very happy to announce Yong Fang (Shammon)
(zjur...@gmail.com) as a new Flink Committer.
Yong is an old flinker, he has been contributing to Flink since 2017.
He actively participated in dev discussions and answered many
questions on the user mailing list.
+1 binding
Thanks all for your work!
Best,
Jingsong
On Thu, Jul 27, 2023 at 10:52 AM Jark Wu wrote:
>
> +1 (binding)
>
> Thanks Xintong for driving this. Thanks all for finalizing the
> SourceFunction conclusion.
>
> Best,
> Jark
>
> On Wed, 26 Jul 2023 at 22:28, Alexander Fedulov
> wrote:
>
>
Hi thanks all for your discussion.
What is inputIndex in NestedFieldReferenceExpression?
I know inputIndex has special usage in FieldReferenceExpression, but
it is only for Join operators, and it is only for SQL optimization. It
looks like there is no requirement for Nested.
Best,
Jingsong
On M
So if NestedFieldReferenceExpression doesn't need inputIndex, is there
a need to introduce a base class `ReferenceExpression`?
Best,
Jingsong
On Mon, Aug 28, 2023 at 2:09 PM Jingsong Li wrote:
>
> Hi thanks all for your discussion.
>
> What is inputIndex in NestedFieldReference
+1
On Wed, Sep 6, 2023 at 1:18 PM Becket Qin wrote:
>
> Thanks for pushing the FLIP through.
>
> +1 on the updated FLIP wiki.
>
> Cheers,
>
> Jiangjie (Becket) Qin
>
> On Wed, Sep 6, 2023 at 1:12 PM Venkatakrishnan Sowrirajan
> wrote:
>
> > Based on the recent discussions in the thread [DISCUSS]
Hi marton,
Thanks for driving. +1
There is a PR to remove legacy Paimon
https://github.com/apache/flink-web/pull/665 , but it hasn't been
updated for a long time.
Best,
Jingsong
On Tue, Oct 17, 2023 at 4:28 PM Márton Balassi wrote:
>
> Hi Flink & Paimon devs,
>
> The Flink webpage documentatio
+1 (binding)
- verified signatures & hash
- built from source code succeeded
- started SQL Client, used Paimon connector to write and read, the
result is expected
Best,
Jingsong
On Tue, Oct 24, 2023 at 12:15 PM Yuxin Tan wrote:
>
> +1(non-binding)
>
> - Verified checksum
> - Build from source c
+1 for this FLIP.
BTW, I think we can add an option for projection push down too.
Yes, we can do all things in the connector, but a common
implementation helps a lot! And can introduce an unify option!
Best,
Jingsong
On Wed, Oct 25, 2023 at 10:07 AM Jark Wu wrote:
>
> Thank you for updating Ji
Very thanks Timo for starting this discussion.
Big +1 for this.
The design looks good to me!
We can add some documentation for connector developers. For example:
for sink, If there needs some keyby, please finish the keyby by the
connector itself. SupportsBucketing is just a marker interface.
B
Hi David,
Thanks for driving this.
I think https://issues.apache.org/jira/browse/FLINK-33365 should be a blocker.
Best,
Jingsong
On Thu, Oct 26, 2023 at 11:43 PM David Radley wrote:
>
> Hi,
> I propose that we do a 3.2 release of flink-sql-connector-jdbc so that there
> is a version matching
Congratulations!
Thanks Jing and other release managers and all contributors.
Best,
Jingsong
On Fri, Oct 27, 2023 at 1:52 PM Zakelly Lan wrote:
>
> Congratulations and thank you all!
>
>
> Best,
> Zakelly
>
> On Fri, Oct 27, 2023 at 12:39 PM Jark Wu wrote:
> >
> > Congratulations and thanks re
+1
On Tue, Nov 7, 2023 at 5:56 AM Jim Hughes wrote:
>
> Hi all,
>
> +1 (non-binding)
>
> Cheers,
>
> Jim
>
> On Mon, Nov 6, 2023 at 6:39 AM Timo Walther wrote:
>
> > Hi everyone,
> >
> > I'd like to start a vote on FLIP-376: Add DISTRIBUTED BY clause[1] which
> > has been discussed in this threa
+1 thanks Yun
1.17.2 is really important.
Best,
Jingsong
On Tue, Nov 7, 2023 at 9:32 AM Danny Cranmer wrote:
>
> +1, thanks for picking this up.
>
> I am happy to help out with the bits you need PMC support for.
>
> Thanks,
> Danny
>
> On Tue, Nov 7, 2023 at 4:03 AM Yun Tang wrote:
>
> > Hi @
+1 for this
On Mon, Nov 27, 2023 at 10:26 AM Yun Tang wrote:
>
> Hi, Di.Wu
>
> Thanks for creating this discussion. The Apache Doris community might have
> the most active contributors in ASF this year, and since I also contributed
> to doris-flink-connector before, I'm very glad to see this co
+1 binding
On Mon, Dec 4, 2023 at 10:33 PM Etienne Chauchot wrote:
>
> Correct,
>
> I forgot that in the bylaws, committer vote is binding for FLIPs thanks
> for the reminder.
>
> Best
>
> Etienne
>
> Le 30/11/2023 à 10:43, Leonard Xu a écrit :
> > +1(binding)
> >
> > Btw, @Etienne, IIRC, your vo
Wow, Cool, Nice
CDC is playing an increasingly important role.
+1
Best,
Jingsong
On Thu, Dec 7, 2023 at 11:25 AM Leonard Xu wrote:
>
> Dear Flink devs,
>
> As you may have heard, we at Alibaba (Ververica) are planning to donate CDC
> Connectors for the Apache Flink project[1] to the Apache Fl
Congratulations!
Best,
Jingsong
On Wed, Jan 3, 2024 at 10:28 AM Benchao Li wrote:
>
> Congratulations, Alex!
>
> Yuepeng Pan 于2024年1月3日周三 10:10写道：
> >
> > Congrats, Alex!
> >
> > Best,
> > Yuepeng Pan
> > At 2024-01-02 20:15:08, "Maximilian Michels" wrote:
> > >Happy New Year everyone,
> > >
>
+1
On Tue, Jan 9, 2024 at 3:23 PM Yuan Mei wrote:
>
> +1 binding
>
>
>
> On Tue, Jan 9, 2024 at 3:21 PM Yuan Mei wrote:
>
> > +1
> >
> > Best,
> > Yuan
> >
> > On Tue, Jan 9, 2024 at 3:06 PM tison wrote:
> >
> >> +1 non-binding
> >>
> >> Best,
> >> tison.
> >>
> >> Leonard Xu 于2024年1月9日周二 15:0
+1
On Wed, Jan 10, 2024 at 11:24 AM Xuyang wrote:
>
> +1(non-binding)--
>
> Best！
> Xuyang
>
>
>
>
>
> 在 2024-01-08 00:34:55，"Feng Jin" 写道：
> >Hi Alexey
> >
> >Thank you for the reminder, the link has been updated.
> >
> >Best,
> >Feng Jin
> >
> >On Sat, Jan 6, 2024 at 12:55 AM Alexey Le
Hi all,
This is a relatively large optimization that may pose a significant
risk of bugs, so I like to keep it from being enabled by default for
now.
Best,
Jingsong
On Fri, Jan 12, 2024 at 3:01 PM shuai xu wrote:
>
> Suppose we currently have a job that joins two CDC sources after
> de-duplica
Hi Dian,
+1 for this, thanks driving.
Documentation looks very good. I can imagine a huge performance improvement
and better integration to other Python libraries.
A few thoughts:
- About data split: "python.fn-execution.arrow.batch.size", can we unify it
with "python.fn-execution.bundle.size"?
-
Hi Jeff,
For FLINK-15935 [1],
I try to think of it as a non blocker. But it's really an important issue.
The problem is the class loading order. We want to load the class in the
blink-planner.jar, but actually load the class in the flink-planner.jar.
First of all, the order of class loading
t;> variables. I prefer to keep it this way for a while, and see if there're
>> real concerns/complaints from user feedbacks.
>>
>> Please also note the Hive jars are not the only ones needed to integrate
>> with Hive, users have to make sure flink-connector-hiv
> you can cover a lot of versions.
>
> Would it make sense to add these to flink-shaded (with proper dependency
> exclusions of unnecessary dependencies) and offer them as a download,
> similar as we offer pre-shaded Hadoop downloads?
>
> Best,
> Stephan
>
>
> On Thu, Fe
w, could you also attach a JIRA issue with the changes described
> in
> > > it,
> > > >>> so that users can find the issue through the mailing list in the
> > > future.
> > > >>>
> > > >>> Best,
> > > >>> Jark
> >
ded by Arrow, we can gain them
> > > automatically using Arrow.
> > > 3. Good point! As all the classes of Python module is written in Java
> and
> > > it's not suggested to introduce new Scala classes, so I guess it's not
> > easy
> > > to do so
Hi,
+1 (non-binding) Thanks for driving this, Gary & Yu.
There is an unfriendly error here: "OutOfMemoryError: Direct buffer memory"
in FileChannelBoundedData$FileBufferReader.
It forces our batch users to configure
"taskmanager.memory.task.off-heap.size" in production jobs. And users are
hard
t; >> - Can we only configure one parameter and calculate another
> > automatically? For example, if we just want to "pipeline", "bundle.size"
> is
> > twice as much as "batch.size", is this work?
> >
> > I don't think th
Hi Dawid,
Thanks for driving.
- adding $ in scala api looks good to me.
- Just a question, what should be expected to java.lang.Object? literal
object or expression? So the Object is the grammatical sugar of literal?
Best,
Jingsong Lee
On Mon, Feb 10, 2020 at 9:40 PM Timo Walther wrote:
> +1
rk Wu 写道：
> >>
> >> +1 for this.
> >>
> >> I have some minor comments:
> >> - I'm +1 to use $ in both Java and Scala API.
> >> - I'm +1 to use lit(), Spark also provides lit() function to create a
> >> literal value.
&
Congratulations! Great work.
Best,
Jingsong Lee
On Wed, Feb 12, 2020 at 11:05 PM Leonard Xu wrote:
> Great news！
> Thanks everyone involved !
> Thanks Gary and Yu for being the release manager !
>
> Best,
> Leonard Xu
>
> 在 2020年2月12日，23:02，Stephan Ewen 写道：
>
> Congrats to us all.
>
> A big pi
+1 (non-binding)
Thanks Dian for driving.
Best,
Jingsong Lee
On Thu, Feb 13, 2020 at 11:45 AM jincheng sun
wrote:
> +1 (binding)
>
> Best,
> Jincheng
>
>
> Dian Fu 于2020年2月12日周三 下午1:31写道：
>
> > Hi all,
> >
> > I'd like to start the vote of FLIP-97[1] which is discussed and reached
> > consensu
Hi Godfrey,
Thanks for updating. +1 sketchy.
I have no idea to change "sqlQuery" to "fromQuery", I think "sqlQuery" is
OK, It's not that confusing with return values.
Can we change the "DmlBatch" to "Inserts"? I don't see any other needs.
"Dml" seems a little weird.
It is better to support "Ins
> other statement in a single batch. If that happens, the name
> "Inserts"
> > > will
> > > > be weird.
> > > >
> > > > Best,
> > > > Kurt
> > > >
> > > >
> > > > On Thu, Feb 13, 2020 at 4:03 PM J
Thank for the great work,
In 1.10, I have modified and reviewed some documents. In that process,
sometimes there is some confusion, how to write is the standard. How to
write is correct to the users.
Docs style now tells me. Learned a lot.
Best,
Jingsong Lee
On Sat, Feb 15, 2020 at 10:00 PM Dian
Thanks for bringing this discussion.
+1 to peforming this big change as early as possible.
You solved my question, why we need "_root_". Yes, I don't like this import
too.
And it is very strange that expressionDsl is in api, but can only work in
api.scala. (Because scala extends ImplicitExpressi
Hi all, thanks for launching this discussion.
About eliminating Google Docs. I agree with Zhijiang, I share my concern
about it.
If the FLIP Driver is a Flink newer or the FLIP is very big and
complicated. His/Her design maybe need change many many things, in this
situation, Google doc is good to
Thanks Stephan for the kicking off.
Thanks Piotr and Zhijiang for volunteering.
+1 for aiming with the feature freeze date for end of April.
We should return to the quick release model. (3 months)
Best,
Jingsong Lee
On Thu, Feb 20, 2020 at 6:04 PM Zhu Zhu wrote:
> Thanks Piotr and Zhijiang for
Hi Caizhi, thanks for starting this discussion.
There is a FLIP-71 [1] to describe the whole story of view.
Sql-cli now implements a wrong way, and a separate way, which should be
deprecated and unified to TableEnvironment.
> Shall we make it clear and support create table / create temporary tab
hink we need a new VOTE for this, I just want to make this
> discussion more publicly.
> What do you think?
>
> Best,
> Jark
>
> On Wed, 5 Feb 2020 at 16:05, Rui Li wrote:
>
> > +1, thanks for the efforts.
> >
> > On Wed, Feb 5, 2020 at 4:00 PM Jingson
Thanks everyone~
It's my pleasure to be part of the community. I hope I can make a better
contribution in future.
Best,
Jingsong Lee
On Fri, Feb 21, 2020 at 2:48 PM Hequn Cheng wrote:
> Congratulations Jingsong! Well deserved.
>
> Best,
> Hequn
>
> On Fri, Feb 21, 2020 at 2:42 PM Yang Wang wr
Thanks all for your discussion.
Hi Dawid,
+1 to apply the logic of parsing a SQL timestamp literal.
I don't fully understand the matrix your list. Should this be the semantics
of SQL cast?
Do you mean this is implicit cast in JSON parser?
I doubt that because these implicit casts are not support
in a topic.
>
> Best,
> Jark
>
> On Wed, 26 Feb 2020 at 22:20, Jingsong Li wrote:
>
>> Thanks all for your discussion.
>>
>> Hi Dawid,
>>
>> +1 to apply the logic of parsing a SQL timestamp literal.
>>
>> I don't fully understand the
+1 for this proposal. I have a lot of desired topics in table and batch.
I also second Seth and Stephan 's comment separate this in a clear way.
Have concerns that maybe easy to confuse new users.
If I am a beginner and find a bunch of deep documents, I need to further
distinguish which is effecti
Thanks Dawid for starting this discussion.
I like the "LIKE".
1.For "INHERITS", I think this is a good feature too, yes, ALTER TABLE will
propagate any changes in column data definitions and check constraints down
the inheritance hierarchy. A inherits B, A and B share every things, they
have the
Thanks Bowen for involving.
> why you proposed segregating hive versions into the 5 ranges above? &
what different Hive features are supported in the 5 ranges?
For only higher client dependencies version support lower hive metastore
versions:
- Hive 1.0.0 - 1.2.2, thrift change is OK, only hive d
1.0.0 - 1.2.2, the module name can be "flink-connector-hive-1.0"
> rather than "flink-connector-hive-1.2"
>
>
> On Wed, Mar 4, 2020 at 10:20 PM Jingsong Li
> wrote:
>
> > Thanks Bowen for involving.
> >
> > > why you proposed segregating
Thanks for deep investigation.
+1 to disable "Squash and merge" button now.
But I think this is a very serious problem, It affects too many GitHub
workers. Github should deal with it quickly?
Best,
Jingsong Lee
On Thu, Mar 5, 2020 at 7:21 PM Xingbo Huang wrote:
> Hi Jark,
>
> Thanks for bringi
h
> >>>>> in
> >>>>>> the repository(according to github rules).
> >>>>>>
> >>>>>> If we only left "merge and commits" button, it will
> >>>>>> against requiring
> >> a
>
a name including the
> lowest Hive version it supports.
>
> What do you think?
>
>
>
> On Wed, Mar 4, 2020 at 11:14 PM Jingsong Li
> wrote:
>
> > Hi Bowen, thanks for your reply.
> >
> > > will there be a base module like "flink-connector-hive-base
Hi Danny, +1 for table hints, thanks for driving.
I took a look to FLIP, most of content are talking about query hints. It is
hard to discussion and voting. So +1 to split it as Jark said.
Another thing is configuration that suitable to config with table hints:
"connector.path" and "connector.top
Thanks for driving. Yu. +1 for starting the 1.10.1 release.
Some issues are very important, Users are looking forward to them.
Best,
Jingsong Lee
On Wed, Mar 11, 2020 at 2:52 PM Yangze Guo wrote:
> Thanks for driving this release, Yu!
>
> +1 for starting the 1.10.1 release cycle.
>
> Best,
> Y
Hi Robert,
+1 to drop it but maybe not 1.11.
ORC has not been supported on StreamingFileSink. I have seen lots of users
run ORC in the bucketing sink.
Best,
Jingsong Lee
On Fri, Mar 13, 2020 at 1:11 AM Seth Wiesman wrote:
> Sorry, I meant FLIP-46.
>
> Seth
>
> On Thu, Mar 12, 2020 at 11:52 AM
Hi everyone,
I'd like to start a discussion about FLIP-115 Filesystem connector in Table
[1].
This FLIP will bring:
- Introduce Filesystem table factory in table, support
csv/parquet/orc/json/avro formats.
- Introduce streaming filesystem/hive sink in table
CC to user mail list, if you have any u
s for FLIP-115. It is really useful feature for platform developers
> > who manage hundreds of Flink to Hive jobs in production.
>
> > I think we need add 'connector.sink.username' for UserGroupInformation when
> > data is written to HDFS
> >
> >
> > 在 2020/3
Thanks Flavio for driving. Personally I am +1 for integrating HBase tables.
I start a new topic for discussion. It is related but not the core of this
FLIP.
In the FLIP, I can see:
- Does HBase support the concept of partitions..? I don't think so..
- Does HBase support functions? I don't think so
e
On Mon, Mar 16, 2020 at 12:01 PM Jingsong Li wrote:
> Thanks Piotr and Yun for involving.
>
> Hi Piotr and Yun, for implementation,
>
> FLINK-14254 [1] introduce batch sink table world, it deals with partitions
> thing, metastore thing and etc.. And it just reuse
wn set of limitations, quirks and features.
> Especially that we have on our long term roadmap and wish list to unify
> such kind of operators.
>
> Piotrek
>
> [1] https://issues.apache.org/jira/browse/FLINK-11499 <
> https://issues.apache.org/jira/browse/FLINK-11499>
>
&
would make it much easier for users
> to
> > understand the system.
> > Especially when it comes to consistent behavior across external systems.
> > Having a different file sink in Table API and DataStream API means that
> > DataStream can write correctly to S3 while Table API
Hi,
I am thinking we can provide hints to *table* related instances.
- TableFormatFactory: of cause we need hints support, there are many format
options in DDL too.
- catalog and module: I don't know, maybe in future we can provide some
hints for them.
Best,
Jingsong Lee
On Wed, Mar 18, 2020 at
Hi Jinhai, thanks for driving.
+1 to remove, I think we can remove StreamQueryConfig too. since we have
deprecated StreamQueryConfig two versions.
Remember to record it in release notes of issue.
Best,
Jingsong Lee
On Wed, Mar 18, 2020 at 5:58 PM jinhai wang wrote:
> Hi Devs
>
> I would like
eviating from
> >> this now, we only put more stress on other teams in the future. When
> >> the users start using a given API, with high probability, they will
> >> ask (and it is totally reasonable) consistent behaviour from all the
> >> other APIs that ship wit
Hi all,
I heard some users complain that table is difficult to test. Now with SQL
client, users are more and more inclined to use it to test rather than
program.
The most common example is Kafka source. If users need to test their SQL
output and checkpoint, they need to:
- 1.Launch a Kafka standa
nt data in row format in console
> >> - purposes
> >> - make it easier to test Flink SQL job e2e in IDE
> >> - test Flink pipeline and ensure output data format/value is
> >> correct
> >> 3. no output data sink
> >>
nerally, it's a very good proposal.
> >
> > About data gen source, do you think we need to add more columns with
> > various types?
> >
> > About print sink, do we need to specify the schema?
> >
> > Jingsong Li 于2020年3月23日周一 下午1:51写道：
> >
> &
tackle them for the sake of
> simplifying user experience to the extreme. Providing the above handy
> source and sink implementations already offer users a ton of immediate
> value.
>
>
> On Mon, Mar 23, 2020 at 20:20 Jingsong Li wrote:
>
> > Hi Benchao,
> >
> &g
+1. Thanks Timo for the design doc.
We can also consider @Experimental too. But I am +1 to @PublicEvolving, we
should be confident in the current change.
Best,
Jingsong Lee
On Tue, Mar 24, 2020 at 4:30 PM Timo Walther wrote:
> @Becket: We totally agree that we don't need table specific connect
treamingFileSink might not
> support currently. I am very glad to see that you all agree that improving
> the StreamingFileSink architecture for these new cases.
>
> Best,
> Guowei
>
>
> Jingsong Li 于2020年3月19日周四 上午12:19写道：
>
> > Hi Stephan & Kostas & Piotr
;
> > > > >> Best,
> > > > >> Jark
> > > > >>
> > > > >> [1]: https://kafka.apache.org/documentation/#consumerconfigs
> > > > >>
> > > > >> On Wed, 18 Mar 2020 at 21:44, Danny Chan
> >
Hi everyone,
I'd like to start the vote of FLIP-115 [1], which introduce Filesystem
table factory in table. This FLIP is discussed in the thread[2].
The vote will be open for at least 72 hours. Unless there is an objection,
I will try to close it by March 30, 2020 03:00 UTC if we have received
su
t; > > 在 2020年3月28日，16:25，Kurt Young 写道：
> > >
> > > +1
> > >
> > > Best,
> > > Kurt
> > >
> > >
> > > On Fri, Mar 27, 2020 at 10:51 AM Jingsong Li
> > wrote:
> > >
> > >> Hi eve
; Best,
> Jark
>
> On Mon, 30 Mar 2020 at 11:32, Jingsong Li wrote:
>
> > +1 (binding)
> >
> > Best,
> > Jingsong Lee
> >
> > On Sun, Mar 29, 2020 at 10:37 PM Benchao Li wrote:
> >
> > > +1 (non-binding)
> > >
> > >
Thanks Jark for the proposal.
+1 to the general idea.
For "version", what about "kafka.version"? It is obvious to know its
meaning.
And I'd like to start a new topic:
Should we need to explicitly separate source from sink?
With the development of batch and streaming, more and more connectors hav
1 - 100 of 610 matches
Mail list logo
