Re: Elastic Block Store as checkpoint storage

Hi Prabhu, this should be possible, but is quite expensive in comparison to AWS S3 and you have to remount the EBS volumes to the new Taskmanagers in case of a failure which takes some non-trivial time, which slows down recovery. So, overall I don't think its peferrable compared to S3. We do use

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

Congrats! Am Mo., 27. März 2023 um 14:32 Uhr schrieb Leonard Xu : > Congratulations! > > > Best, > Leonard > > On Mar 27, 2023, at 5:23 PM, Yu Li wrote: > > Dear Flinkers, > > > > As you may have noticed, we are pleased to announce that Flink Table Store > has joined the Apache Incubator as a s

Re: [ANNOUNCE] Apache Flink 1.16.1 released

Great. Thanks, Martijn for managing the release. Am Mi., 1. Feb. 2023 um 20:26 Uhr schrieb Martijn Visser < martijnvis...@apache.org>: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.16.1, which is the first bugfix release for the Apache Flink 1.16 > series.

Re: Best way to perform look up with historical data in Flink

Hi Surendra, where does your historical data reside? In a database? Files? Behind a REST API? Depending on the answer and which API you use, the AsyncIO [1] operator (DataStream API) or a Lookup Table Join [2] might be good options. There are other ways, too. A while back I did a webinar [3] on

Re: Community fork of Flink Scala API for Scala 2.12/2.13/3.x

Great work! Thank you for sharing. Am Do., 12. Mai 2022 um 17:19 Uhr schrieb Jeff Zhang : > That's true scala shell is removed from flink . Fortunately, Apache > Zeppelin has its own scala repl for Flink. So if Flink can support scala > 2.13, I am wondering whether it is possible to integrate it

Re: [Discuss] Creating an Apache Flink slack workspace

gt; find. However, I'm a bit concerned about the maintenance overhead. I'm not > very familiar with Discourse or Reddit. My impression is that they are not > as easy to set up and maintain as Slack. > > Thank you~ > > Xintong Song > > > [1] https://asktug.com/ &

Re: Migrating Flink apps across cloud with state

Hi there, to me the simplest and most reliable solution still seems to be to split the stream based on event time. It requires a bit of preparation and assume that you can tolerate some downtime when doing the migration. 1) For Cloud1 you chain a filter to your sources that filters out any record

Re: flink Job is throwing depdnecy issue when submitted to clusrer

Hi there, are you using any of Flink S3 Filesystems? If so, where do you load it from a) lib/ b) plugins/ c) bundled with your Job in a fat JAR b) would be the right way to do it in Flink 1.13. I don't know if this fixes the issue, but IIRC because we introduced the plugin mechansim we don't rel

Re: [Discuss] Creating an Apache Flink slack workspace

Thanks for starting this discussion again. I am pretty much with Timo here. Slack or Discourse as an alternative for the user community, and mailing list for the contributing, design discussion, etc. I definitely see the friction of joining a mailing list and understand if users are intimidated. I

Re: Alertmanager Sink Connector

; implementation around it. > > 2. In Flink 1.15, there are Async Sinks ( > https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink) > but not much documentation around. Also don't know if it would be > achievable to write the continuous firing logic in alertmanager > >

Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

eel packages? > > Best, > Xingbo > > Leonard Xu 于2022年3月16日周三 01:02写道： > >> Thanks a lot for being our release manager Konstantin and everyone who >> involved! >> >> Best, >> Leonard >> >> 2022年3月15日 下午9:34，Martijn Visser 写道： >> &

[ANNOUNCE] Apache Flink 1.1.4.4 released

Jira: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12351231 We would like to thank all contributors of the Apache Flink community who made this release possible! Regards, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github

Re: Add libatomic1 to flink image

: > Hi Developers, > > I wish to add a new library to existing flink docker image since it’s a > dependency requirement in my processor. > Is it possible to add? > > apt-get install libatomic1 > > Thanks, > Julius > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Apache Flink 1.13.6 released

Jira: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12351074 We would like to thank all contributors of the Apache Flink community who made this release possible! Regards, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github

[RESULT] [VOTE] Deprecate Per-Job Mode

rmann Non-Binding +1 Chenya Zhang David Moravek Gabor Somogyi Cheers, Konstantin [1] https://lists.apache.org/thread/v6oz92dfp95qcox45l0f8393089oyjv4 [2] https://issues.apache.org/jira/browse/FLINK-25999 [3] https://issues.apache.org/jira/browse/FLINK-26000 -- Konstantin Knauf https://twitte

Re: [DISCUSS] Future of Per-Job Mode

ocation of the cluster resources prior to taking down the previous > job during upgrade when the goal is optimization for availability. > > Thanks, > Thomas > > [1] https://github.com/lyft/flinkk8soperator > > On Thu, Jan 13, 2022 at 12:32 AM Konstantin Knauf > wrote: &g

Re: [DISCUSS] Moving connectors from Flink to external connector repositories

> * The FileSystem, DataGen, Print and BlackHole connectors are important >> for >> > first time Flink users/testers. If you want to experiment with Flink, >> you >> > will most likely start with a local file before moving to one of the >> other >> > sources

[DISCUSS] Future of Per-Job Mode

ode midterm? Cheers and thank you, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: Flink native k8s integration vs. operator

gt; TM heartbeat lost and allocate a new one timely. > > Thanks for sharing this, we should evaluate it as part of a proposal. > If we can optimize recovery or scaling with active resource management > then perhaps it is worth to support it through the operator. > Previously ment

Re: Flink native k8s integration vs. operator

rom the latest checkpoint, it may be fairly simple to implement. >>>> What I'm struggling with are the more complex upgrade scenarios such as >>>> dual, blue / green deployment. >>>> > >>>> > >>>> > To sum this up, I'd re

Advise on Apache Log4j Zero Day (CVE-2021-44228)

[2] https://nvd.nist.gov/vuln/detail/CVE-2021-44228 [3] https://logging.apache.org/log4j/2.x/security.html [4] https://issues.apache.org/jira/browse/FLINK-25240 -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [DISCUSS] Deprecate MapR FS

it in Flink 1.16. Removing this from Flink will slightly shrink the >> codebase and CI runtime. >> >> I'm also cross posting this to the User mailing list, in case there's >> still anyone who's using MapR. >> >> Best regards, >> >> Mart

Re: [ANNOUNCE] Apache Flink 1.13.3 released

on=12350329 > > We would like to thank all contributors of the Apache Flink community > who made this release possible! > > Regards, > Chesnay > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [DISCUSS] Creating an external connector repository

tribution to open source at the > > >> project level. Sometimes it is everything ASF. More often it is > > >> "Apache Foo". It would be fatal to end up with a patchwork of projects > > >> with potentially different licenses and governance to arrive

Re: [DISCUSS] Creating an external connector repository

at checking out older commits can be problematic because > > you'd still work against the latest snapshots, and they not be > > compatible with each other. > > > > > > On 18/10/2021 15:22, Arvid Heise wrote: > > > I was actually betting on snapshots versions. What are the limits? > > > Obviously, we can only do a release of a 1.15 connector after 1.15 is > > > release. > > > > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [ANNOUNCE] Apache Flink 1.14.0 released

verview of the > > > improvements for this bugfix release: > > > https://flink.apache.org/news/2021/09/29/release-1.14.0.html > > > > > > The full release notes are available in Jira: > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12349614 > > > > > > We would like to thank all contributors of the Apache Flink community > > > who made this release possible! > > > > > > Regards, > > > Xintong, Joe, Dawid > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [ANNOUNCE] Apache Flink 1.13.0 released

> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >> > -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream P

[ANNOUNCE] Flink Jira Bot fully live (& Useful Filters to Work with the Bot)

d", "Deployment / Kubernetes", "Deployment / Mesos", "Deployment / YARN", flink-docker, "Release System", "Runtime / Coordination", "Runtime / Metrics", "Runtime / Queryable State", "Runtime / REST", Travis) AND resolution = Unresolved AND labels in (stale-assigned) AND labels in (pull-request-available) Cheers, Konstantin [1] https://github.com/apache/flink-jira-bot/blob/master/config.yaml -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: Flink Statefun Python Batch

at the moment, I can prepare a branch for you to > experiment with, in the following days. > > Regarding to open tracing integration, I think the community can benefit a > lot out of this, > and definitely contributions are welcome! > > @Konstantin Knauf would you like to unde

Re: [BULK]Re: [SURVEY] Remove Mesos support

; >> management component. We are pretty heavy users of Mesos for scheduling > >> workloads on our edge datacenters and we do want to continue to be able > to > >> run some of our Flink topologies (to compute machine learning short term > >> features) on those D

Re: Future of QueryableState

e to use it in K8 settings, performance considerations) or > just lack of interest/support (in that case we may offer some help)? > > > thanks, > > maciek > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: FlinkSQL kafka->dedup->kafka

ime in 1.12, this will be >>> available soon. >>> >>> Best, >>> Leonard >>> >>> >> >> -- >> *Laurent Exsteens* >> Data Engineer >> (M) +32 (0) 486 20 48 36 >> >> *EURA NOVA* >> Rue Emile Francqui, 4 >> 1435 Mont-Saint-Guibert >> (T) +32 10 75 02 00 >> >> >> *euranova.eu <http://euranova.eu/>* >> *research.euranova.eu* <http://research.euranova.eu/> >> >> ♻ Be green, keep it on the screen >> >> >> > > -- > *Laurent Exsteens* > Data Engineer > (M) +32 (0) 486 20 48 36 > > *EURA NOVA* > > Rue Emile Francqui, 4 > > 1435 Mont-Saint-Guibert > > (T) +32 10 75 02 00 > > *euranova.eu <http://euranova.eu/>* > > *research.euranova.eu* <http://research.euranova.eu/> > > ♻ Be green, keep it on the screen -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: FlinkSQL kafka->dedup->kafka

am into append > records with change flag encoded. > 2. Yes. It will replace records with the same key, i.e. upsert statement. > 3. I think it will be available in one or two months. There will be a > first release candidate soon. > You can watch on the dev ML. I'm no

[ANNOUNCE] Weekly Community Update 2020/44-45

ent-time-skewness-can-reduce-checkpoint-failures-and-task-manager-crashes Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/39-43

MC-member-Zhu-Zhu-tp45418p45474.html [21] https://flink.apache.org/2020/10/15/from-aligned-to-unaligned-checkpoints-part-1.html [22] https://flink.apache.org/news/2020/10/13/stateful-serverless-internals.html Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [SURVEY] Remove Mesos support

Hi Robert, +1 to the plan you outlined. If we were to drop support in Flink 1.13+, we would still support it in Flink 1.12- with bug fixes for some time so that users have time to move on. It would certainly be very interesting to hear from current Flink on Mesos users, on how they see the evolut

Re: [DISCUSS] Remove flink-connector-filesystem module.

t;>> favor of the relatively recently introduced StreamingFileSink. > >>> > >>> For the sake of a clean and more manageable codebase, I propose to > >>> remove this module for release-1.12, but of course we should see first > >>> if there are any u

[ANNOUNCE] Weekly Community Update 2020/38

https://twitter.com/FlinkForward/status/1306219099475902464 Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/37

k-forward.org/global-2020 [13] https://www.ververica.com/blog/a-deep-dive-on-change-data-capture-with-flink-sql-during-flink-forward Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/36

782&index=2 Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/35

g-list-archive.1008284.n3.nabble.com/ANNOUNCE-New-PMC-member-Dian-Fu-tp44170p44240.html Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/31-34

s://www.flink-forward.org/global-2020/conference-program [24] https://www.eventbrite.com/e/flink-forward-global-virtual-2020-tickets-113775477516#tickets Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [DISCUSS] Removing deprecated methods from DataStream API

t;>>> >>>> > enableCheckpointing() >>>> >>>> > isForceCheckpointing() >>>> >>>> > >>>> >>>> > readFile(FileInputFormat inputFormat,String >>>> >>>> > filePath,FileProcessingMode watchType,long interval, FilePathFilter >>>> >>>> > filter) >>>> >>>> > readFileStream(...) >>>> >>>> > >>>> >>>> > socketTextStream(String hostname, int port, char delimiter, long >>>> maxRetry) >>>> >>>> > socketTextStream(String hostname, int port, char delimiter) >>>> >>>> > >>>> >>>> > There are more, like the (get)/setNumberOfExecutionRetries() that were >>>> >>>> > deprecated long ago, but I have not investigated to see if they are >>>> >>>> > actually easy to remove. >>>> >>>> > >>>> >>>> > Cheers, >>>> >>>> > Kostas >>>> >>>> > >>>> >>>> > On Mon, Aug 17, 2020 at 10:53 AM Dawid Wysakowicz >>>> >>>> > wrote: >>>> >>>> > >>>> >>>> > Hi devs and users, >>>> >>>> > >>>> >>>> > I wanted to ask you what do you think about removing some of the >>>> deprecated APIs around the DataStream API. >>>> >>>> > >>>> >>>> > The APIs I have in mind are: >>>> >>>> > >>>> >>>> > RuntimeContext#getAllAccumulators (deprecated in 0.10) >>>> >>>> > DataStream#fold and all related classes and methods such as >>>> FoldFunction, FoldingState, FoldingStateDescriptor ... (deprecated in >>>> 1.3/1.4) >>>> >>>> > StreamExecutionEnvironment#setStateBackend(AbstractStateBackend) >>>> (deprecated in 1.5) >>>> >>>> > DataStream#split (deprecated in 1.8) >>>> >>>> > Methods in (Connected)DataStream that specify keys as either indices >>>> or field names such as DataStream#keyBy, DataStream#partitionCustom, >>>> ConnectedStream#keyBy, (deprecated in 1.11) >>>> >>>> > >>>> >>>> > I think the first three should be straightforward. They are long >>>> deprecated. The getAccumulators method is not used very often in my >>>> opinion. The same applies to the DataStream#fold which additionally is not >>>> very performant. Lastly the setStateBackend has an alternative with a class >>>> from the AbstractStateBackend hierarchy, therefore it will be still code >>>> compatible. Moreover if we remove the >>>> #setStateBackend(AbstractStateBackend) we will get rid off warnings users >>>> have right now when setting a statebackend as the correct method cannot be >>>> used without an explicit casting. >>>> >>>> > >>>> >>>> > As for the DataStream#split I know there were some objections against >>>> removing the #split method in the past. I still believe the output tags can >>>> replace the split method already. >>>> >>>> > >>>> >>>> > The only problem in the last set of methods I propose to remove is >>>> that they were deprecated only in the last release and those method were >>>> only partially deprecated. Moreover some of the methods were not deprecated >>>> in ConnectedStreams. Nevertheless I'd still be inclined to remove the >>>> methods in this release. >>>> >>>> > >>>> >>>> > Let me know what do you think about it. >>>> >>>> > >>>> >>>> > Best, >>>> >>>> > >>>> >>>> > Dawid >>> >>> -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [DISCUSS] Remove Kafka 0.10.x connector (and possibly 0.11.x)

And > yes, I know that we had multiple discussions like this in the past but I'm > trying to gauge the current sentiment. > > I'm cross-posting to the user-ml since this is important for both users > and developers. > > Best, > Aljoscha > > [1] https://issues.apache.org/jira/browse/FLINK-17260 > > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/29-30

rg/news/2020/07/14/application-mode.html [12] https://blogs.oracle.com/javamagazine/streaming-analytics-with-java-and-apache-flink [13] https://www.youtube.com/watch?v=HWTb5kn4LvE [14] https://www.flink-forward.org/global-2020/training-program Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [ANNOUNCE] Apache Flink 1.11.1 released

treaming >> > > applications. >> > > > >> >> > > > >> The release is available for download at: >> > > > >> https://flink.apache.org/downloads.html >> > > > >> >> > > > >> Please check out the release blog post for an overview of the >> > > improvements for this bugfix release: >> > > > >> https://flink.apache.org/news/2020/07/21/release-1.11.1.html >> > > > >> >> > > > >> The full release notes are available in Jira: >> > > > >> >> > > >> > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12348323 >> > > > >> >> > > > >> We would like to thank all contributors of the Apache Flink >> > community >> > > who made this release possible! >> > > > >> >> > > > >> Regards, >> > > > >> Dian >> > > > > >> > > > >> > > >> > >> > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/28

troduction-to-flink-video-series [12] https://www.youtube.com/watch?v=ZU1r7uEAO7o Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/26-27

link-on-zeppelin-part2.html Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/25

lobal-2020/call-for-presentations Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/23-24

1008284.n3.nabble.com/ANNOUNCE-New-Apache-Flink-Committer-Xintong-Song-tp42194p42207.html [9] https://flink.apache.org/news/2020/06/11/community-update.html Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/22

[8] [7] https://twitter.com/FlinkForward/status/1265281578676166658 [8] https://www.flink-forward.org/global-2020 Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/21

ink-to-run-real-time-streaming-pipelines [9] https://www.infoq.com/presentations/ml-streaming-lyft/ Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/20

020. [9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Add-a-material-web-page-under-https-flink-apache-org-tp41298.html Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/19

p.com/futureofdata-princeton/events/269933905/ Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/18

rward-virtual-2020-recap [9] https://www.youtube.com/watch?v=NF0hXZfUyqE&list=PLDX4T_cnKjD0ngnBSU-bYGfgVv17MiwA7 Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: join in sql without time interval

window join, nor sliding window join and >> interval join. >> >> Best Regards >> Lec Ssmi >> > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

[ANNOUNCE] Weekly Community Update 2020/17

pache.org/news/2020/04/21/memory-management-improvements-flink-1.10.html [16] https://flink-packages.org/packages/flink-memory-calculator Cheers, Konstantin -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk

Re: [ANNOUNCE] Apache Flink 1.9.3 released

.apache.org/news/2020/04/24/release-1.9.3.html >>> >>> The full release notes are available in Jira: >>> https://issues.apache.org/jira/projects/FLINK/versions/12346867 >>> >>> We would like to thank all contributors of the Apache Flink community

Re: Flink

ploy on >> EKS? >> > >> > From my understanding, with flink 1.10 running it on EKS will >> > automatically scale up and down with kubernetes integration based on >> the >> > load. Is this correct? Do I have to do enable some configs to support >

Re: Handling stale data enrichment

can think of Low Level joins but not sure how do we know > if it is stale data or not based on timestamp (watermark) as it can happen > that a particular enriched record is not updated for 6 hrs. > > Regards, > Vinay Patil > -- Konstantin Knauf

[ANNOUNCE] Weekly Community Update 2020/16

tion-of-training-materials-into-Apache-Flink-tp40299.html [24] https://medium.com/@abdelkrim.hadjidj/event-driven-supply-chain-for-crisis-with-flinksql-be80cb3ad4f9 [25] https://flink.apache.org/news/2020/04/15/flink-serialization-tuning-vol-1.html [26] https://flink.apache.org/2020/04/09/pyflink-udf-support-flink.html Cheers, Konstantin (@snntrable) -- Konstantin Knauf

[ANNOUNCE] Weekly Community Update 2020/14

.org/news/2020/04/01/community-update.html Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conferen

[ANNOUNCE] Weekly Community Update 2020/13

/22/Migrating+Flink%27s+CI+Infrastructure+from+Travis+CI+to+Azure+Pipelines Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/>

Re: Kafka - FLink - MongoDB using Scala

the code snippet to store data into MongoDB. > > Thanks > Siva > -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stre

[ANNOUNCE] Weekly Community Update 2020/12

ics [10] https://www.ververica.com/blog/how-openssl-in-ververica-platform-improves-your-flink-job-performance Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forwar

[ANNOUNCE] Weekly Community Update 2020/11

sonally believe all upcoming meetups in the regions, I usually cover, will be cancelled. So, no update on this today. [15] https://flink.apache.org/ecosystem/2020/02/22/apache-beam-how-beam-runs-on-top-of-flink.html Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 9

[ANNOUNCE] Weekly Community Update 2020/10

423809/ [17] https://www.meetup.com/futureofdata-princeton/events/268830725/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - Th

Re: [DISCUSS] FLIP-111: Docker image unification

docker use cases to refer to this >> new approach (mostly Kubernetes now). >> >> The first contributed version of Flink docker integration also contained >> example and docs for the integration with Bluemix in IBM cloud. We also >> suggest to maintain it outside of Flink r

[ANNOUNCE] Weekly Community Update 2020/09

3] https://www.meetup.com/futureofdata-princeton/events/268830725/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/>

[ANNOUNCE] Weekly Community Update 2020/07

ents/268418974/ [23] https://www.meetup.com/futureofdata-zurich/events/268423809/ [24] https://www.meetup.com/futureofdata-princeton/events/268830725/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ve

[ANNOUNCE] Weekly Community Update 2020/07

tup/events/268400545/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Head of Product +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven |

[ANNOUNCE] Weekly Community Update 2020/06

020/speakers [16] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Community-Discounts-for-Flink-Forward-SF-2020-Registrations-td37055.html [17] https://www.meetup.com/Apache-Flink-London-Meetup/events/268400545/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Soluti

[ANNOUNCE] Weekly Community Update 2020/05

) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Ververica GmbH | Invalidenstrass

Re: Is there anything strictly special about sink functions?

his > > e-mail is strictly prohibited. If you have received this e-mail in error, > > please notify the sender and permanently delete the e-mail and any > > attachments immediately. You should not retain, copy or use this e-mail or > > any attachment for any purpose,

[ANNOUNCE] Weekly Community Update 2020/04

nts/268080082/ [10] https://www.meetup.com/rladies-kyiv/events/267948988/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/>

[ANNOUNCE] Weekly Community Update 2020/03

n-Madrid/events/267744681/ [13] https://www.meetup.com/rladies-kyiv/events/267948988/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.

[ANNOUNCE] Weekly Community Update 2020/02

Detection with Apache Flink at the Apache Flink Meetup in Madrid [8]. [6] https://www.flink-forward.org/sf-2020 [7] https://www.meetup.com/Hyderabad-Apache-Flink-Meetup-Group/events/267610014/ [8]https://www.meetup.com/Meetup-de-Apache-Flink-en-Madrid/events/267744681/ Cheers, Konstantin (

Re: [ANNOUNCE] Weekly Community Update 2019/50

http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html >> [10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html >> [11] >> https://developpaper.com/why-will-apache-flink-1-9-0-support-the-pyt

[ANNOUNCE] Weekly Community Update 2019/50

w.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink

[ANNOUNCE] Weekly Community Update 2019/49

mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <

[ANNOUNCE] Weekly Community Update 2019/48

] https://github.com/alibaba/Alink/blob/master/README.en-US.md [7] https://www.meetup.com/Chicago-Apache-Flink-Meetup-CHAF/events/266609828/ [8] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160

[ANNOUNCE] Weekly Community Update 2019/47

irigu*, Airbus, and *Konstantin Knauf* (on Stateful Functions). [10] * There will be an introduction to Apache Flink, use cases and best practices at the next Uber Engineering meeup in Toronto. If you live in Toronto, its an excellent opportunity to get started with Flink or to meet local Fl

Weekly Community Update 2019/46

ber. [10] * The next edition of the Bay Area Apache Flink meetup will happen on the 20th of November with talks by *Gyula Fora (Cloudera)* and *Lakshmi Rao (Lyft)*.[11] * We will have our next Apache Flink Meetup in Munich on November 27th with talks by *Heiko Udluft & Giuseppe Siri

[ANNOUNCE] Weekly Community Update 2019/45

of November with talks by *Gyula Fora (Cloudera)* and *Lakshmi Rao (Lyft)*.[10] * We will have our next Apache Flink Meetup in Munich on November 27th with talks by *Heiko Udluft & Giuseppe Sirigu*, Airbus, and *Konstantin Knauf* (on Stateful Functions). [11] [6] http://apache-flink-maili

[ANNOUNCE] Weekly Community Update 2019/44

h talks by *Heiko Udluft & Giuseppe Sirigu*, Airbus, and *Konstantin Knauf* (on Stateful Functions). [15] [10] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Becket-Qin-joins-the-Flink-PMC-tp34400p34452.html [11] https://research.euranova.eu/flink-forward-the-key-tak

[ANNOUNCE] Weekly Community Update 2019/43

a/events/265957761/ [13] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forw

[ANNOUNCE] Weekly Community Update 2019/42

p/events/265285812/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Proce

[ANNOUNCE] Weekly Community Update 2019/41

luding at least three Flink talks by *Timo Walter* (Ververica), *Shashank Agarwal* (Razorpay) and *Rasyid Hakim* (GoJek). [6] [6] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525

[ANNOUNCE] Weekly Community Update 2019/40

98dc2 [9] https://www.dynamicyield.com/blog/turning-messy-data-into-a-gold-mine/ [10] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/ [11] https://europe-2019.flink-forward.org Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525

[ANNOUNCE] Weekly Community Update 2019/39

ow * Dean Shaw* and *Max McKittrick* will talk about click stream analysis at scale at Capital One at the next dataCouncil.ai NYC Data Engineering meetup. [13] [12] https://europe-2019.flink-forward.org/ [13] https://www.meetup.com/DataCouncil-AI-NYC-Data-Engineering-Science/events/264748638/ Cheers, Kon

[ANNOUNCE] Weekly Community Update 2019/38

nk-on-yarn-with-kerberos-authentication-adeb62ef47d2 Cheers, Konstantin -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream P

[ANNOUNCE] Weekly Community Update 2019/37

k-on-k8s-operator Cheers, Konstantin -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time

[ANNOUNCE] Weekly Community Update 2019/33-36

p/events/262680261/ [33] https://www.meetup.com/Apache-Flink-London-Meetup/events/264123672/ Cheers, Konstantin -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forwar

[ANNOUNCE] Weekly Community Update 2019/32

.nabble.com/ANNOUNCE-Hequn-becomes-a-Flink-committer-tp31378.html [13] https://www.meetup.com/seattle-flink/events/263782233 [14] https://www.eventbrite.com/e/apache-pulsar-meetup-beijing-tickets-67849484635 [15] https://www.meetup.com/acm-sf/events/263768407/ Cheers, Konstantin (@snntrable) -

[ANNOUNCE] Weekly Community Update 2019/31

*Nico Kruber *published the second part of his series on Flink's network stack. This time about metrics, monitoring and backpressure. (This slipped through last week.) [10] [10] https://flink.apache.org/2019/07/23/flink-network-stack-2.html Cheers, Konstantin (@snntrable) -- Konstan

[ANNOUNCE] Weekly Community Update 2019/30

g-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhijiang-Wang-has-been-added-as-a-committer-to-the-Flink-project-tp30830p30943.html [9] https://www.meetup.com/budapest-scala/events/263025323/ [10] https://www.meetup.com/EPAM-Tech-Talks-Wroc%C5%82aw/events/263027190/ Cheers, Konstantin (@snntr

[ANNOUNCE] Weekly Community Update 2019/28

been-added-as-a-committer-to-the-Flink-project-td30670.html [14] https://berlin-2019.flink-forward.org/conference-program [15] https://berlin-2019.flink-forward.org/training-program [16] https://www.meetup.com/budapest-scala/events/263025323/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf |

[ANNOUNCE] Weekly Community Update 2019/28

e.com/ANNOUNCE-Rong-Rong-becomes-a-Flink-committer-td30451.html#a30474 Cheers and have a nice evening, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 -- Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany -- Ververica GmbH Registered at Amtsger

Re: How are kafka consumer offsets handled if sink fails?

>> On Mon, Jul 8, 2019 at 6:39 AM John Smith wrote: >> >>> So when we say a sink is at least once. It's because internally it's not >>> checking any kind of state and it sends what it has regardless, correct? >>> Cause I willl build a sink that calls

Re: Apache Flink - Multiple Kinesis stream consumers

suming same > kinesis multiple times in a single application ? Are there any issues that > can arise from this pattern ? > 2. How does Flink coordinate consumers of same kinesis stream across > multiple applications ? > > Thanks > > Mans > -- Konstantin Knauf | Solution

  1   2   3   >