Hi folks,
The bug has been fixed and PR at docker-library/official-images has been
merged. The official images are available now.
Best regards,
Jing
On Mon, Jan 22, 2024 at 11:39 AM Jing Ge wrote:
> Hi folks,
>
> I am still working on the official images because of the issu
Hi folks,
I am still working on the official images because of the issue
https://issues.apache.org/jira/browse/FLINK-34165. Images under
apache/flink are
available.
Best regards,
Jing
On Sun, Jan 21, 2024 at 11:06 PM Jing Ge wrote:
> Thanks Leonard for the feedback! Also thanks @Jark
Thanks Leonard for the feedback! Also thanks @Jark Wu
@Chesnay
Schepler and each and everyone who worked closely with
me for this release. We made it together!
Best regards,
Jing
On Sun, Jan 21, 2024 at 9:25 AM Leonard Xu wrote:
> Thanks Jing for driving the release, nice work!
>
&g
ttps://issues.apache.org/jira/browse/FLINK-33824
Feel free to reach out to the release managers (or respond to this thread)
with feedback on the release process. Our goal is to constantly improve the
release process. Feedback on what could be improved or things that didn't
go so well are appreciated.
Regards,
Jing
,
they will need to find the needle in the haystack.
I just shared my thoughts and tried to help you look at the issue from many
different angles and I am open to learning opinions from other
contributors. Please feel free to proceed if there are no other objections.
Best regards,
Jing
On Mon, Nov
. I am not sure if this could help users
find the right method in the context of execution config better than
before.
I might miss something and look forward to your thoughts. Thanks!
Best regards,
Jing
On Sat, Nov 18, 2023 at 11:21 AM Junrui Lee wrote:
> Hello Wencong,
>
> Thank you
notes are available in Jira:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12352885
We would like to thank all contributors of the Apache Flink community who
made this release possible!
Best regards,
Konstantin, Qingsheng, Sergey, and Jing
,
Jing
On Wed, Aug 23, 2023 at 9:27 AM Christian Lorenz
wrote:
> Hi Jing,
>
>
>
> thanks for the answer. I have no idea what kind of work is needed for
> being a release manager. I think we’ll have to wait for the release then
> (if really urgent, the blocking bug can
Hi devs,
Thanks Giannis for your suggestion. It seems that the last email wasn't
sent to the dev ML. It is also an interesting topic for devs and user-zh.
Best regards,
Jing
-- Forwarded message -
From: Giannis Polyzos
Date: Tue, Aug 22, 2023 at 11:11 AM
Subject: [Discu
release.
Best regards,
Jing
On Tue, Aug 22, 2023 at 3:41 AM liu ron wrote:
> Hi, Christian
>
> We released 1.17.1 [1] in May, and the main focus of the community is
> currently on the 1.18 release, so 1.17.2 should be planned for after the
> 1.18 release!
>
> [1]
> https
Congratulations!
Best regards,
Jing
On Mon, Jul 3, 2023 at 3:21 PM yuxia wrote:
> Congratulations!
>
> Best regards,
> Yuxia
>
> --
> *发件人: *"Pushpa Ramakrishnan"
> *收件人: *"Xintong Song"
> *抄送: *"dev" , &
ward to receiving your submission and welcoming you
as a speaker at the Flink Forward Conference.
Thank you for your time and consideration.
Best regards,
--
Jing Ge | Head of Engineering
j...@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forw
Hi Chris,
not yet and we are working on it[1].
best regards,
Jing
[1]
https://issues.apache.org/jira/browse/FLINK-15736?page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel&focusedCommentId=17697544#comment-17697544
On Thu, Jun 1, 2023 at 11:40 PM Joseph, Chris S
w
major to tasks related to those
connectors.
Best regards,
Jing
On Tue, May 30, 2023 at 11:48 AM Qingsheng Ren wrote:
> Hi devs and users,
>
> I'd like to share some highlights from the release sync of 1.18 on May 30.
>
> 1. @developers please update the progress of your feat
regards,
Jing
On Mon, May 29, 2023 at 6:27 AM weijie guo
wrote:
> Hi Jing,
>
> Thank you for caring about the releasing process. It has to be said that
> the entire process went smoothly. We have very comprehensive
> documentation[1] to guide my work, thanks to the contribut
Hi Weijie,
Thanks again for your effort. I was wondering if there were any obstacles
you had to overcome while releasing 1.16.2 and 1.17.1 that could lead us to
any improvement wrt the release process and management?
Best regards,
Jing
On Fri, May 26, 2023 at 4:41 PM Martijn Visser
wrote
Hi Weijie,
That is earlier than I expected! Thank you so much for your effort!
Best regards,
Jing
On Fri, May 26, 2023 at 4:44 PM Martijn Visser
wrote:
> Same here as with Flink 1.16.2, thank you Weijie and those who helped with
> testing!
>
> On Fri, May 26, 2023 at 1:08 P
cc user ML to get more attention, since the plugin will be used by Flink
application developers.
Best regards,
Jing
On Mon, May 22, 2023 at 3:32 PM Jing Ge wrote:
> Hi Emre,
>
> Thanks for clarifying it. Afaiac, it is a quite interesting proposal,
> especially for Flink job develo
?
Best regards,
Jing
On Thu, Apr 27, 2023 at 8:18 AM Tamir Sagi
wrote:
> More details about the JDK bug here
> https://bugs.openjdk.org/browse/JDK-8277529
>
> Related Jira ticket
> https://issues.apache.org/jira/browse/FLINK-24998
>
> --
> *From:* J
Thanks Chesnay for working on this. Would you like to share more info about
the JDK bug?
Best regards,
Jing
On Mon, Apr 24, 2023 at 11:39 AM Chesnay Schepler
wrote:
> As it turns out Kryo isn't a blocker; we ran into a JDK bug.
>
> On 31/03/2023 08:57, Chesnay Schepler wrot
ting will be on April 18, 2023. Please feel
free to join us!
Zoom meeting:
https://us04web.zoom.us/j/79158702091?pwd=8CXPqxMzbabWkma5b0qFXI1IcLbxBh.1
Best regards,
Konstantin, Sergey, Qingsheng, and Jing
[1] https://cwiki.apache.org/confluence/display/FLINK/1.17+Release
[2] https://cwiki.apache
Congrats!
Best regards,
Jing
On Mon, Mar 27, 2023 at 2:32 PM Leonard Xu wrote:
> Congratulations!
>
>
> Best,
> Leonard
>
> On Mar 27, 2023, at 5:23 PM, Yu Li wrote:
>
> Dear Flinkers,
>
>
>
> As you may have noticed, we are pleased to announce that Fli
Excellent work! Congratulations! Appreciate the hard work and contributions
of everyone in the Apache Flink community who helped make this release
possible. Looking forward to those new features. Cheers!
Best regards,
Jing
On Thu, Mar 23, 2023 at 10:24 AM Leonard Xu wrote:
> The Apache Fl
, 2023 at 8:17 AM Shammon FY wrote:
>
>> Hi jing,
>>
>> It sounds good to me, we can add an option for it
>>
>> Best,
>> Shammon
>>
>>
>> On Fri, Feb 17, 2023 at 3:13 PM Jing Ge wrote:
>>
>>> Hi,
>>>
>>> It makes se
Hi,
It makes sense to offer this feature of catching and ignoring exp with
config on/off, when we put ourselves in users' shoes. WDYT? I will create a
ticket if most of you consider it as a good feature to help users.
Best regards,
Jing
On Fri, Feb 17, 2023 at 6:01 AM Shammon FY wrote:
Hi Yanfei,
Thanks for your effort. Looking forward to checking it.
Best regards,
Jing
On Mon, Jan 30, 2023 at 1:42 PM Yanfei Lei wrote:
> It is very happy to announce the release of FRocksDB 6.20.3-ververica-2.0.
>
> Compiled files for Linux x86, Linux arm, Linux ppc64le, MacOS x86
Hi Michael,
yeah, it will be addressed in Flink-28867.
Best regards,
Jing
On Wed, Nov 16, 2022 at 2:58 AM liu ron wrote:
> It will be addressed in FLINK-28867.
>
> Best,
> Ron
>
> Benenson, Michael via user 于2022年11月16日周三 08:47写道：
>
>> Thanks, Jing
>>
>
/parquet/#generic-record
Best regards,
Jing
On Tue, Nov 15, 2022 at 8:52 PM Benenson, Michael via user <
user@flink.apache.org> wrote:
> Hi, folks
>
>
>
> I’m using flink 1.16.0, and I would like to read Parquet file (attached),
> that has schema [1].
>
>
>
> I could
Hi Etienne,
Nice blog! Thanks for sharing!
Best regards,
Jing
On Wed, Nov 9, 2022 at 5:49 PM Etienne Chauchot
wrote:
> Hi Yun Gao,
>
> FYI I just updated the article after your review:
> https://echauchot.blogspot.com/2022/11/flink-howto-migrate-real-life-batch.html
>
> Bes
Congrats!
On Fri, Oct 28, 2022 at 1:22 PM 任庆盛 wrote:
> Congratulations and a big thanks to Chesnay, Martijn, Godfrey and Xingbo
> for the awesome work for 1.16!
>
> Best regards,
> Qingsheng Ren
>
> > On Oct 28, 2022, at 14:46, Xingbo Huang wrote:
> >
> > The Apache Flink community is very hap
live with it. It
might not be the perfect solution but is indeed the currently best
trade-off solution after considering the backward compatibility. I would
suggest firing a follow-up ticket after the PR to take care of the new
metric for the internal traffic in the future.
Best regards,
Jing
On
have two different output lines - one with the external system
and the other with the downstream operator. In this case, "numXXXSend" is
rather a new metric than a replacement of "numXXXOut". The "numXXXOut"
metric can still be used, depending on what the user wants t
issue for
users who have to rewrite their large codebases. Those users should be
aware of the effort from now on and would better not count on those scala
extension projects and prepare their migration plan before Flink 2.0.
Best regards,
Jing
On Tue, Oct 4, 2022 at 1:59 PM Martijn Visser
wrote:
f the transformation, you can specifically use the
DataStreamSource type(instead of DataStream) which provides some setter
methods extended from SingleOutputStreamOperator.
Best regards,
Jing
[1]
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/overview/
On Wed, Sep 14, 2022 at 3:
/release-notes/flink-1.15/
Best regards,
Jing
On Wed, Sep 7, 2022 at 11:14 AM Congxian Qiu wrote:
> In addition to the state compatibility mentioned above, the interfaces
> provided by Flink are stable if they have public annotation[1]
>
> [1]
> https://github.com/apache/flink/bl
Thanks Danny for your effort!
Best regards,
Jing
On Wed, Aug 24, 2022 at 11:43 PM Danny Cranmer
wrote:
> The Apache Flink community is very happy to announce the release of Apache
> Flink 1.15.2, which is the second bugfix release for the Apache Flink 1.15
> series.
>
> Apac
Hi,
using FLASH_SSD_OPTIMIZED already sets the number of threads to 4. This
optimization can improve the source throughput and reduce the delayed wrate
rate.
If this optimization didn't fix the back pressure, could you share more
information about your job? Could you check the metric of the back
After read FLIP-198 & FLIP-201，I confuse that this feature can be used on
Yarn mode and how to confige a deterministic `taskmanager.resource-id` ?Or
just suit for k8s mode.
Hi,
you don't have to do that. Next time you can try "Invalidate Caches..."
under the File menu in Intellij Idea.
Best regards,
Jing
On Wed, Jul 13, 2022 at 7:21 PM Min Tu via user
wrote:
> Thanks a lot !! I have removed the .idea folder and the unit test works.
>
> O
退订请发送任意消息至user-unsubscr...@flink.apache.org
In order to unsubscribe, please send an email to
user-unsubscr...@flink.apache.org
Thanks
Best regards,
Jing
From: liangzai
Date: Sun, Jun 19, 2022 at 4:37 AM
Subject: Re: New KafkaSource API: Change in default behavior regarding
starting offset
To
Hi Meghajit,
Thanks for the feedback. I have fired a ticket:
https://issues.apache.org/jira/browse/FLINK-28117
Best regards,
Jing
On Mon, Jun 13, 2022 at 7:23 AM Meghajit Mazumdar <
meghajit.mazum...@gojek.com> wrote:
> Hi folks,
>
> Thanks for the reply.
> We have i
Hi,
Just like Shengkai mentioned. I would strongly suggest trying SQL for ETL
dag. If you find anything that SQL does not work for you, please share your
requirements with us. We might check if it makes sense to build new
features in Flink to support them.
Best regards,
Jing
On Wed, Jun 15
gards,
Jing
On Tue, Jun 14, 2022 at 4:15 PM bastien dine wrote:
> Hello everyone,
>
> Does someone know why the starting offset behaviour has changed in the new
> Kafka Source ?
>
> This is now from earliest (code in KafkaSourceBuilder), doc says :
> "If offse
Hi,
Please be aware that SourceFunction will be deprecated soon[1]. It is
recommended to build a new source connector based on the new Source API
design by FLIP-27[2]. You might take the Kafka connector as the
reference implementation.
Best regards,
Jing
[1] https://lists.apache.org/thread
Hi meghajit,
I think it makes sense to extend the current metrics. Could you list all
metrics you need? Thanks!
Best regards,
Jing
On Fri, Jun 10, 2022 at 5:06 PM Lijie Wang wrote:
> Hi Meghajit,
>
> As far as I know, currently, the FileSource does not have the metrics you
> ne
Hi Carlos,
You might want to join the discussion about FLIP-238[1] to share your
thoughts with us. Thanks!
Best regards,
Jing
[1] https://lists.apache.org/thread/7gjxto1rmkpff4kl54j8nlg5db2rqhkt
On Thu, Jun 9, 2022 at 2:13 PM Sanabria, Carlos <
carlos.sanab...@accenture.com> wrote:
&g
Hi Alexey,
There is a thread[1] discussing this issue right now. It would be great if
you could share some thoughts about your experience. Thanks!
Best regards,
Jing
[1]https://lists.apache.org/thread/d6cwqw9b3105wcpdkwq7rr4s7x4ywqr9
On Wed, Jun 8, 2022 at 4:42 PM Alexey Trenikhun wrote
Hi Xiao,
Just done, please check. Thanks!
Best regards,
Jing
On Mon, Jun 6, 2022 at 3:59 AM Xiao Ma wrote:
> Hi Jing,
>
> Could you please add me to the slack channel also?
>
> Thank you.
>
>
> Best,
> Mark Ma
>
> On Sun, Jun 5, 2022 at 9:57 PM Jing Ge wro
Hi Sri,
Flink is very well documented. You can find it under e.g.
https://nightlies.apache.org/flink/flink-docs-master/
Best regards,
Jing
On Mon, Jun 6, 2022 at 3:39 AM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Flink Community,
>
> I want to go throu
Hi Raghunadh,
Just did, please check your email. Thanks!
Best regards,
Jing
On Mon, Jun 6, 2022 at 3:51 AM Raghunadh Nittala
wrote:
> Team, Kindly add me to the slack channel.
>
> Best Regards.
>
Hi Sucheth,
Just invited you, please check. Thanks!
Best Regards,
Jing
On Sun, Jun 5, 2022 at 6:06 PM Sucheth S wrote:
> Hello Jing,
>
> Can you please add me - suchet...@gmail.com
>
>
> On Sun, Jun 5, 2022 at 9:02 AM sri hari kali charan Tummala <
> kali.tumm...@g
done, please check. Thanks
Best regards,
Jing
On Sun, Jun 5, 2022 at 6:05 PM Deepak Sharma wrote:
> I need the invite as well .
> kdq...@gmail.com
>
> On Sun, 5 Jun 2022 at 9:32 PM, sri hari kali charan Tummala <
> kali.tumm...@gmail.com> wrote:
>
>> Hi Jing,
Hi Sri,
I have invited you, please check. Thanks!
Best regards,
Jing
On Sun, Jun 5, 2022 at 6:02 PM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Jing,
>
> Please add me kali.tumm...@gmail.com.
>
> Thanks
> Sri
>
> On Sat, Jun 4, 2022 at 4
Amazing! Thanks Yang for driving this! Thanks all for your effort!
Best regards,
Jing
On Sun, Jun 5, 2022 at 11:30 AM tison wrote:
> Congrats! Thank you all for making this release happen.
>
> Best,
> tison.
>
>
> rui fan <1996fan...@gmail.com> 于2022年6月5日周日 17
Hi,
Invites have been sent. Please check your emails. Thanks!
Regards,
JIng
On Sun, Jun 5, 2022 at 12:38 PM Jay Ghiya wrote:
> Request community to share invite link for me at ghiya6...@gmail.com and
> jay.gh...@ge.com
>
Hi Santhosh,
just invited you. Please check your email. Looking forward to knowing your
story! Thanks!
To anyone else who wants to join, please send an email to
user@flink.apache.org, you might have a better chance to get the invite.
Thanks.
Regards,
Jing
On Sat, Jun 4, 2022 at 10:37 PM
Hi Xingtong,
While inviting new members, there are two options: "From another company"
vs "Your coworker". In this case, we should always choose "Your coworker"
to add new members to the Apache Flink workspace, right?
Best regards,
Jing
On Fri, Jun 3, 2022 at 1:10
Hi,
Currently, the Flink Scala API is not in a good shape. Would you like to
start from there?
Best regards,
Jing
On Fri, Jun 3, 2022 at 4:29 PM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Folks,
>
> Is anyone hiring for Flink or Scala Akka contra
Hi,
It seems like an evaluation with a small dataset. In this case, would you
like to share your data sample and code? In addition, have you tried KMeans
with the same dataset and got inconsistent results too?
Best regards,
Jing
On Fri, Jun 3, 2022 at 4:29 AM Natia Chachkhiani <
natia.chachk
Thanks everyone for your effort!
Best regards,
Jing
On Thu, Jun 2, 2022 at 4:17 PM Martijn Visser
wrote:
> Thanks everyone for joining! It's good to see so many have joined in such
> a short time already. I've just refreshed the link which you can always
> find on the
Hi Bariša,
Could you share the reason why your data processing pipeline should keep
running when one kafka source is down?
It seems like any one among the multiple kafka sources is optional for the
data processing logic, because any kafka source could be the one that is
down.
Best regards,
Jing
Hi,
yuxia has already pointed out the correct direction. The exact line for
using the savepoint path to resume the job from a savepoint is at line 1326
[1]
[1]
https://github.com/apache/flink/blob/586715f23ef49939ab74e4736c58d71c643a64ba/flink-tests/src/test/java/org/apache/flink/test/checkpointi
Hi,
Afaik, there are still a lot of unit tests depending on it. I don't think
we can drop it before dropping all of these unit tests.
Best regards,
Jing
On Tue, May 31, 2022 at 8:10 AM Yun Gao wrote:
> Hi Jun,
>
> I think the release notes should only include the issues that
, which is recommended to replace
the usage of GlobalCommitter, is used to take care of the post commit
topology.
Best regards,
Jing
On Tue, May 24, 2022 at 9:11 AM di wu <676366...@qq.com> wrote:
> Hello
> Regarding the GlobalCommitter in Flink's two-phase commit,
> I see
ache.org/jira/browse/FLINK-27112
Best regards
Jing
On Thu, Apr 7, 2022 at 4:03 AM Xintong Song wrote:
> Hi Peter,
>
> Have you compared the DAT topologies in 1.15 / 1.14?
>
> I think it's expected that "Records Received", "Bytes Sent" and "Records
>
,
Jing
On Thu, Mar 17, 2022 at 3:24 AM WuKong wrote:
> Hi,
> now my data store hbase and I want use flink to implement kafka table
> temproal join hbase table , but condtion is not rowkey , I realize hbase
> secondary index, how can I implement this function what can use flink sql
&
quire a lot of effort to make it happen. Trade-off is always
the key. Currently, I have to agree with you again, we should focus more on
the common (batch) cases.
Best regards,
Jing
On Mon, Mar 7, 2022 at 1:53 PM Jing Zhang wrote:
> Hi Martijn,
>
> Thanks for driving this discuss
migration work.
Best,
Jing Zhang
Martijn Visser 于2022年3月7日周一 19:23写道：
> Hi everyone,
>
> Flink currently has 4 APIs with multiple language support which can be used
> to develop applications:
>
> * DataStream API, both Java and Scala
> * Table API, both Java and Scala
> *
-07T12:01:00.000Z|cnn.com|some-article-name
2022-04-07T12:02:00.000Z|cnn.com|some-article-name
best regards
Jing
On Mon, Feb 7, 2022 at 5:07 PM John Smith wrote:
> Maybe there's a misunderstanding. But basically I want to do clickstream
> count for a given "url" and for simpl
heading towards the unified batch and stream processing, IMHO, it would be
nice to pick up a feasible connector for this trend to let the user get a
sample close to the use cases.
Best regards
Jing
On Mon, Jan 31, 2022 at 3:07 PM Andrew Otto wrote:
> Shameless plug: Maybe the Wikipe
Hi Meghajit,
like the exception described, parquet schema with nested columns is not
supported currently. It is on our todo list with high priority.
Best regards
Jing
On Fri, Jan 7, 2022 at 6:12 AM Meghajit Mazumdar <
meghajit.mazum...@gojek.com> wrote:
> Hello,
>
> Flin
ot be found *by the ParquetVectorizedInputFormat *in the parquet footer, a
type info is still needed to build the projected schema.
Best regards
Jing
On Thu, Jan 6, 2022 at 12:38 PM Meghajit Mazumdar <
meghajit.mazum...@gojek.com> wrote:
> Hi Jing,
>
> Thanks for the reply.
>
should be given by the user. The
fieldTypes are required in case the given fields could not be found in the
parquet footer, like for example typo.
Best regards
Jing
On Thu, Jan 6, 2022 at 7:01 AM Meghajit Mazumdar <
meghajit.mazum...@gojek.com> wrote:
> Hello,
>
> We want to read and
companies have a lot of those
use cases[1]. It would be great if we could find a way to drop Gelly but
keep the graph computing ability within Flink's ecosystem.
Best regards
Jing
[1]
https://california18.com/the-ant-graph-calculation-is-upgraded-to-tugraph-and-it-won-the-2021-world-int
Hi Jing,
Please try this way,
Only create one sink for final output, write the window aggregate and topN
in one query, write the result of topN into the final sink.
Best,
Jing Zhang
Jing 于2021年12月24日周五 03:13写道：
> Hi Jing Zhang,
>
> Thanks for the reply! My current implementation is
Hi Jing Zhang,
Thanks for the reply! My current implementation is like this:
tableEnv.executeSql(
"CREATE TABLE ItemDesc (item_id STRING, channel_id STRING, window_end
BIGINT, num_select BIGINT) WITH ('connector' = 'kafka', 'scan.startup.mode'
= '
Hi Jing,
In fact, I agree with you to use TopN [2] instead of Window TopN[1] by
normalizing
time into a unit with 5 minute, and add it to be one of partition keys.
Please note two points when use TopN
1. the result is an update stream instead of append stream, which means the
result sent might be
Hi Jing,
I'm afraid there is no possible to Window TopN in SQL on 1.12 version
because window TopN is introduced since 1.13.
> I saw the one possibility is to create a table and insert the aggregated
data to the table, then do top N like [1]. However, I cannot make this
approach work b
for this
table and I may also need to create another kafka topic for this. Is there
any existing way to do the Window Top N with Flink 1.12?
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.12/dev/table/sql/queries.html#top-n
Thanks,
Jing
You are Welcome. Glad to hear the information is helpful.
Guoqin Zheng 于2021年12月10日周五 03:28写道：
> Hi Jing,
>
> Thanks for the advice. This is very helpful.
>
> -Guoqin
>
> On Wed, Dec 8, 2021 at 11:52 PM Jing Zhang wrote:
>
>> Hi Guoqin,
>> I understand t
pdate stream instead of append stream, which means
the result sent might be retracted later. Besides, you could take care of
state clean.
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/dev/table/sql/queries/topn/
Best,
Jing Zhang
Guoqin Zheng 于2021年12月9日周四 14:16写道：
>
TABLE(
TUMBLE(TABLE MyTable, DESCRIPTOR(readtime), INTERVAL
'5' MINUTES))
) WHERE rownum <= 1;
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sql/queries/window-topn/#window-top-n-follows-after-windowing-tvf
Best,
Jing Zhang
Guoqin Zheng 于2021年12月9
:48 PM Jing Lu wrote:
> Hi Caizhi,
>
> Here is my current configuration:
>
> val dynamoDBSinkConfig: DynamoDBSinkConfig =
> (new DynamoDBSinkConfig.Builder).batchSize(50).queueLimit(20).build()
>
> new FlinkDynamoDBSink[Row](
> dynamoDBBuilder,
> "
/src/main/java/com/klarna/flink/connectors/dynamodb/FlinkDynamoDBSink.java#L127
> [2]
> https://github.com/klarna-incubator/flink-connector-dynamodb/blob/10e8abaec2ef5473618efba41c31484dadb9ad39/src/main/java/com/klarna/flink/connectors/dynamodb/FlinkDynamoDBSink.java#L202
>
> Jing Lu 于2021年1
Hi Cazhi,
Thanks for your reply! The database is DynamoDB. The connector I use is
https://github.com/klarna-incubator/flink-connector-dynamodb. My source is
a continuous event stream. My Flink version is 1.12.
Best,
Jing
On Tue, Dec 7, 2021 at 6:15 PM Caizhi Weng wrote:
> Hi!
>
&
app to
write to a database. Will this smooth the writing? What should I do for the
second Flink app?
Thanks,
Jing
Hi,
Thanks for reporting this BUG. It seems to be a duplicate with FLINK-23919
[1] which would be solved in 1.13.4.
[1] https://issues.apache.org/jira/browse/FLINK-23919
Best,
Jing Zhang
Ivan Budanaev 于2021年11月28日周日 下午7:18写道：
> I am getting the *Field names must be unique. Found duplica
Hi Dan,
AFAIK, there is no built-in way to solve your problem.
You could check whether state processor API
<https://nightlies.apache.org/flink/flink-docs-master/zh/docs/libs/state_processor_api/>
could
help you.
Or you could add log in your program.
Best,
Jing Zhang
Dan Hill 于2021年11月26日周
Hi, vtygoss
+1 on Timo's solutions.
I tried those two solutions in 1.12. Both them could work well.
Thanks @Timo for good suggestions.
Best,
JING ZHANG
Hi vtygoss,
I'm a little confused.
The UDF could already work well without defining `DataTypeHint `annotation.
Why do you define `DataTypeHint `annotation before input parameter of
`eval `method?
Best,
JING ZHANG
vtygoss 于2021年11月9日周二 下午8:17写道：
> Hi, JING ZHANG!
>
> Thanks for y
ry("select TestFunc(COLLECT(ROW(id, name))) as info from
table group by ...")
@SerialVersionUID(1L)
object TestFunc extends ScalarFunction {
def eval(s: java.util.Map[Row, Integer]): String = s.keySet().mkString("\n")
}
Best regards,
JING ZHANG
vtygoss 于2021年11月8日周一 下午
is not triggered yet?
Best,
JING ZHANG
Francesco Guardiani 于2021年11月5日周五 上午12:57写道：
> As a rule of thumb, I would first try to check that Flink ingests
> correctly your csv. Perhaps try to run just a select on your input and see
> if the input is parsed as expected and is ordered.
&
Hi Arvid,
Thanks for the suggestion. Sorry to ask a trivial question 😂. How to
backport klarna connector to Java 8?
Thanks,
Jing
On Sat, Oct 30, 2021 at 5:58 AM Arvid Heise wrote:
> I have also found [1]. You could also fork the klarna connector and
> backport it to Java 8.
>
&g
learn-flink-sql-the-easy-way-d9d48a95ae57
>
>
>
> Jing Lu 于2021年10月30日周六 上午2:03写道：
>
>> Hi Flink users,
>>
>> I am working on testing my code in start-scala-shell.sh. The flink
>> version is: flink-1.12.0-bin-scala_2.11.tgz. I put the jar file (
>> https
roblem?
Thanks,
Jing
Hi folks,
Is there any package for writing from flink stream to DynamoDB?
I checked:
https://github.com/klarna-incubator/flink-connector-dynamodb
but, it supports Java11 only. My Java runtime is Java8.
Thanks,
Jing
lease-1.13/docs/dev/datastream/event-time/generating_watermarks/#watermark-strategies-and-the-kafka-connector
Arujit Pradhan 于2021年10月25日周一 下午5:36写道：
> Hey JING,
>
> Thanks a lot for replying to the thread!
>
> Yeah, we are looking at `PreserveWatermarks`. But t
nk/flink-docs-master/docs/ops/state/savepoints/#what-is-a-savepoint-how-is-a-savepoint-different-from-a-checkpoint
Best,
JING ZHANG
[2]
Roman Khachatryan 于2021年10月25日周一 下午4:53写道：
> Hi ChangZhuo,
>
> Yes, restoring from a savepoint is expected to be significantly slower
> from a che
Hi,
I guess you would get suggestions more quickly if you send this email in
user mail list of KStream.😀
Or you could use Flink to complete your requirements directly.
Mohammed Kamaal 于2021年10月25日周一 下午3:47写道：
> Hi,
>
> Is there a way to define a sliding window with a count (number of
> occurrenc
Hi,
I'm not sure I understand your requirement.
However, are you looking for `PreserveWatermarks` in package
`org.apache.flink.table.sources.wmstrategies`?
Best,
JING ZHANG
Arujit Pradhan 于2021年10月25日周一 下午4:02写道：
> Hi all,
>
>
> We maintain an Open-sourced project for protobu
1 - 100 of 237 matches
Mail list logo
