Who's hiring, December 2016

2016-12-16 Thread Kostas Tzoumas
Hi folks, As promised, here is the first thread for Flink-related job positions. If your organization is hiring people on Flink-related positions do reply to this thread with a link for applications. data Artisans is hiring on multiple technical positions. Help us build Flink, and help our custom

[ANNOUNCE] New Flink community mailing list

2016-12-14 Thread Kostas Tzoumas
Hi everyone, We have created a new Flink mailing lists, commun...@flink.apache.org where we can post everything related to the broader Flink community including job offers, upcoming meetups and conferences, exciting reads, and everything else that is deemed worthy for the greater Flink community.

Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-13 Thread Kostas Tzoumas
It seems that several folks are excited about the idea - but there is still a concern on whether this would be spam for the dev@ and user@ lists (which I share) As a compromise, I propose to request a new mailing list ( commun...@flink.apache.org) which we can use for this purpose, and also to pos

Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-09 Thread Kostas Tzoumas
antsin Kamkou [mailto:kkam...@gmail.com] >> *Sent:* Wednesday, December 07, 2016 9:57 PM >> *To:* user@flink.apache.org >> *Subject:* Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the >> mailing lists? >> >> >> >> Is it possible to avoid

Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-06 Thread Kostas Tzoumas
yes, of course! On Tue, Dec 6, 2016 at 12:54 PM, Márton Balassi wrote: > +1. It keeps it both organized and to a reasonable minimum overhead. > > Would you volunteer for starting the mail thread each month then, Kostas? > > Best, > > Marton > > On Tue, Dec 6, 2016

[DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-06 Thread Kostas Tzoumas
Hi folks, I'd like to see how the community feels about a monthly "Who is hiring on Flink" email thread on the dev@ and user@ mailing lists where folks can post job positions related to Flink. I personally think that posting individual job offerings in the mailing list is off-topic (hence I have

Flink survey by data Artisans

2016-11-18 Thread Kostas Tzoumas
Hi everyone! The Apache Flink community has evolved quickly over the past 2+ years, and there are now many production Flink deployments in organizations of all sizes. This is both exciting and humbling :-) data Artisans is running a brief survey to understand Apache Flink usage and the needs of

[ANNOUNCE] Flink Forward 2016: First round of speakers and sessions is out

2016-07-25 Thread Kostas Tzoumas
Hi everyone, I wanted to share this with the community: we have announced the first round of speakers and sessions of Flink Forward 2016, and it looks amazing! Check it out here: http://flink-forward.org/program/sessions/ This year we have a great mix of use case talks (e.g., by Netflix, Alibaba

Re: Flink on Azure HDInsight

2016-05-04 Thread Kostas Tzoumas
As far as I know, Azure HDInsight is based on Hortonworks HDP, on top of which Flink has been used extensively. On Mon, May 2, 2016 at 10:42 AM, Brig Lamoreaux < brig.lamore...@microsoft.com> wrote: > Thanks Stephan, > > > > Turns out Azure Table is slightly different than Azure HDInsight. Both u

[ANNOUNCE] Flink 1.0.0 has been released

2016-03-08 Thread Kostas Tzoumas
Hi everyone! As you might have noticed, Apache Flink 1.0.0 has been released and announced! You can read more about the release at the ASF blog and the Flink blog - https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces88 - http://flink.apache.org/news/2016/03/08/relea

[DISCUSS] Flink roadmap for 2016

2015-12-16 Thread Kostas Tzoumas
Hi everyone, I think it is very interesting to both developers and users of Flink to define a roadmap for future development. Together with Stephan, we started a draft containing a couple of areas that we think are important to focus on next. https://docs.google.com/document/d/1ExmtVpeVVT3TIhO1Jo

Community choice for Hadoop Summit Europe 2016

2015-12-09 Thread Kostas Tzoumas
Hi everyone, Just a reminder, the community vote for the Hadoop Summit Europe 2016 talks in Dublin is still open until December 15. There is a very good number of talks around Flink submitted, here are the ones that mention "flink" in their abstract: https://hadoopsummit.uservoice.com/search?filt

Re: Fold vs Reduce in DataStream API

2015-11-18 Thread Kostas Tzoumas
Granted, both are presented with the same example in the docs. They are modeled after reduce and fold in functional programming. Perhaps we should have a bit more enlightening examples. On Wed, Nov 18, 2015 at 6:39 PM, Fabian Hueske wrote: > Hi Ron, > > Have you checked: > https://ci.apache.org/

Re: Apache Flink Operator State as Query Cache

2015-11-15 Thread Kostas Tzoumas
Hi Wally, This version adds support for specifying and switching between time semantics - processing time, ingestion time, or event time. When working with event time, you can specify watermarks to track the progress of event time. So, even if events arrive out of order, windows will be specified

Re: Powered by Flink

2015-10-19 Thread Kostas Tzoumas
to that page? > > Cheers, Fabian > > 2015-10-19 14:50 GMT+02:00 Kostas Tzoumas : > >> Hi everyone, >> >> I started a "Powered by Flink" wiki page, listing some of the >> organizations that are using Flink: >> >> https://cwiki.apache.org/confluence/

Powered by Flink

2015-10-19 Thread Kostas Tzoumas
Hi everyone, I started a "Powered by Flink" wiki page, listing some of the organizations that are using Flink: https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink If you would like to be added to the list, just send me a short email with your organization's name and a description

Volunteers needed for Flink Forward 2015 (and they get a free ticket)

2015-09-07 Thread Kostas Tzoumas
Hi folks, The Flink Forward 2015 organizers are looking for volunteers (and they are offering free tickets in exchange). Sign up here if you are interested (or send me an email): http://flink-forward.org/?page_id=495 Best, Kostas

Re: Hardware requirements and learning resources

2015-09-03 Thread Kostas Tzoumas
Well hidden. I added now a link at the menu of http://data-artisans.com/. This material is provided for free by data Artisans but they are not part of the official Apache Flink project. On Thu, Sep 3, 2015 at 2:20 PM, Stefan Winterstein < stefan.winterst...@dfki.de> wrote: > > > Answering to mys

Re: Hardware requirements and learning resources

2015-09-02 Thread Kostas Tzoumas
Hi Juan, Flink is quite nimble with hardware requirements; people have run it in old-ish laptops and also the largest instances available in cloud providers. I will let others chime in with more details. I am not aware of something along the lines of a cheatsheet that you mention. If you actually

Re: About exactly once question?

2015-08-27 Thread Kostas Tzoumas
Oops, seems that Stephan's email covers my answer plus the plans to provide transactional sinks :-) On Thu, Aug 27, 2015 at 1:25 PM, Kostas Tzoumas wrote: > Note that the definition of "exactly-once" means that records are > guaranteed to be processed exactly once by Flin

Re: About exactly once question?

2015-08-27 Thread Kostas Tzoumas
Note that the definition of "exactly-once" means that records are guaranteed to be processed exactly once by Flink operators, and thus state updates to operator state happen exactly once (e.g., if C had a counter that x1, x2, and x3 incremented, the counter would have a value of 3 and not a value o

[ANNOUNCE] Flink Forward 2015 program is online

2015-08-25 Thread Kostas Tzoumas
Hi everyone, Just a shoutout that we have posted the program of Flink Forward 2015 here: http://flink-forward.org/?post_type=day You can expect few changes here and there, but the majority of the talks is in. Thanks again to the speakers and the reviewers! If you have not registered yet, now is

Re: Flink 0.9 built with Scala 2.11

2015-06-10 Thread Kostas Tzoumas
Please do ping this list if you encounter any problems with Flink during your project (you have done so already :-), but also if you find that the Flink API needs additions to map Pig well to Flink On Wed, Jun 10, 2015 at 3:47 PM, Philipp Goetze < philipp.goe...@tu-ilmenau.de> wrote: > Done. Can

Re: CoGgroup Operator Data Sink

2015-04-14 Thread Kostas Tzoumas
Each operator has only one output (which can be consumed by multiple downstream operators), so you cannot branch out to two different directions from inside the user code with many collectors. The reasoning is that you can have the same effect with what Robert suggested. But perhaps your use case

Flink 0.9.0-milestone1 released

2015-04-13 Thread Kostas Tzoumas
We are very excited to announce Flink 0.9.0-milestone1, a preview release to give users early access to some Flink 0.9.0 features, including: - A Table API for SQL-like queries embedded in Java and Scala - Gelly, Flink's graph processing API - A Machine Learning library on Flink inspired by scikit

Re: Flink meetup group in Stockholm

2015-04-08 Thread Kostas Tzoumas
Super cool!!! I'm sure you will make it a huge success :-) On Wed, Apr 8, 2015 at 5:44 PM, Till Rohrmann wrote: > Really cool :-) > > On Wed, Apr 8, 2015 at 5:09 PM, Maximilian Michels wrote: > >> Love the purple. Have fun! :) >> >> On Wed, Apr 8, 2015 at 5:05 PM, Henry Saputra >> wrote: >> >>

Re: Flink Forward 2015

2015-04-07 Thread Kostas Tzoumas
Anwar, I will publish this soon on the FF website, we are looking at mid/late summer. Kostas On Tue, Apr 7, 2015 at 5:04 PM, Anwar Rizal wrote: > Look great. Any dates for the abstract deadline already ? > > On Tue, Apr 7, 2015 at 2:38 PM, Kostas Tzoumas > wrote: > >>

Re: Flink Forward 2015

2015-04-07 Thread Kostas Tzoumas
Ah, thanks Sebastian! :-) On Tue, Apr 7, 2015 at 2:33 PM, Sebastian wrote: > There are still some "Berlin Buzzwords" snippets in your texts ;) > > http://flink-forward.org/?page_id=294 > > > On 07.04.2015 14:24, Kostas Tzoumas wrote: > >> Hi everyone, >

Flink Forward 2015

2015-04-07 Thread Kostas Tzoumas
Hi everyone, The folks at data Artisans and the Berlin Big Data Center are organizing the first physical conference all about Apache Flink in Berlin the coming October: http://flink-forward.org The conference will be held in a beautiful spot an old brewery turned event space (the same space that

Fwd: External Talk: Apache Flink - Speakers: Kostas Tzoumas (CEO dataArtisans), Stephan Ewen (CTO dataArtisans)

2015-04-07 Thread Kostas Tzoumas
ies by one more item: corr(U[0:N], V[n:N+n]) for n=0 to n=1000. Any ideas on how one can do that without a Cartesian product? Best, Kostas -- Forwarded message -- From: Mats Zachrison Date: Tue, Mar 31, 2015 at 9:21 AM Subject: To: Kostas Tzoumas , Stefan Avesand < stefan.aves...

Fwd: Contact from site - Lou

2015-03-27 Thread Kostas Tzoumas
Hi, I am forwarding this question from Lou so that others can benefit as well. Kostas -- Forwarded message -- From: Date: Thu, Mar 26, 2015 at 4:07 PM Hi there, I am Lou, a Ph.D. research scientist working at Ericsson Research (ER), Stockholm, Sweden. At first, many thanks f

February 2015 in the Flink community

2015-03-02 Thread Kostas Tzoumas
Hi everyone February might be the shortest month of the year, but the community has been pretty busy: - Flink 0.8.1, a bugfix release has been made available - The project added a new committer - Flink contributors developed a Flink adapter for Apache SAMOA - Flink committers contributed to Go

January 2015 in the Flink community

2015-02-04 Thread Kostas Tzoumas
Here is a digestible read on some January activity in the Flink community: http://flink.apache.org/news/2015/02/04/january-in-flink.html Highlights: - Flink 0.8.0 was released - The Flink community published a technical roadmap for 2015 - Flink was used to scale matrix factorization to extreme

[ANNOUNCE] Apache Flink 0.8.0 released

2015-01-22 Thread Kostas Tzoumas
The Apache Flink team is proud to announce the release of Apache Flink 0.8.0 This is the first release of Apache Flink as an Apache Top-Level Project Flink is building a system for distributed batch and real-time streaming data analysis that offers familiar collection-based programming APIs in Ja

Fwd: The Apache Software Foundation Announces Apache™ Flink™ as a Top-Level Project

2015-01-12 Thread Kostas Tzoumas
ilestone for Flink and reflects the speed with which the community has been growing," said Kostas Tzoumas, co-founder and CEO of data Artisans. "The community is currently working on some exciting new features that make Flink even more powerful and accessible to a wider audience, and severa

December in Flink

2015-01-09 Thread Kostas Tzoumas
Hi folks, I started a new blog series along the lines of "This month in Flink" to give a summary of the community activity for those that feel overwhelmed by the traffic in the mailing lists but would still like to follow what's happening in the project. Here is the first post I wrote with input