Re: You're Invited: Apache Samza Meetup on Wednesday, February 17 at LinkedIn's campus in Mountain View, CA.

2016-02-17 Thread Michael Sklyar
Hi, Sounds very interesting, I don't see a stream link - is there any? (unfortunately I will not make it on time from Tel-Aviv) Thanks, Michael On Thu, Feb 4, 2016 at 2:11 AM, Ed Yakabosky < eyakabo...@linkedin.com.invalid> wrote: > Hi all, > > I want to formally invite you all to attend an Apa

Re: Data consistency and check-pointing

2016-01-19 Thread Michael Sklyar
messages from the last commit. > > Please let us know whether that satisfies your use case. > > Thanks! > > -Yi > > On Sun, Jan 17, 2016 at 11:09 AM, Michael Sklyar > wrote: > > > Hi, > > > > We have a Samza job reading messages from Kafka and inserti

Data consistency and check-pointing

2016-01-17 Thread Michael Sklyar
rtion with Samza checkpointing? I am thinking of overriding the *KafkaCheckpointManager* & *KafkaCheckpointManagerFactory* and synchronize check-pointing with committing the data to hive. Is it a good idea? Thanks in advance, Michael Sklyar

Re: Unable to write to HDFS

2016-01-17 Thread Michael Sklyar
Hi, 1. Are you using samza version 0.10? 2. Did you include the "samza-hdfs_2.10" jar? ( http://mvnrepository.com/artifact/org.apache.samza/samza-hdfs_2.10) Regards, Michael On Sun, Jan 17, 2016 at 1:13 PM, Նարեկ Գալստեան wrote: > Hello Everyone! > > I am really new to Samza and am trying to c

Re: Is it possible to ensure that the same key in different kafka topics will always reach the same Samza Task instance?

2015-12-29 Thread Michael Sklyar
actory* from > <http://goog_1566468382> > > http://samza.apache.org/learn/documentation/0.9/jobs/configuration-table.html > < > http://samza.apache.org/learn/documentation/0.9/jobs/configuration-table.html > > > . > > > > On Mon, Dec 28, 2015 at 9:19 A

Is it possible to ensure that the same key in different kafka topics will always reach the same Samza Task instance?

2015-12-28 Thread Michael Sklyar
topics, also consumed by (2). Is it possible to make sure that the same key in different kafka topics will reach the same Samza task instance? Other option, of course, would be to hold all the enrichments in all RocksDB instances. What do you think? What is the best practice? Thanks, M

Re: Asynchronous approach and samza

2015-09-21 Thread Michael Sklyar
mplete, the job can start processing events from other input > streams as well. > > I hope my explanation clarifies your question. :) > > Thanks! > Navina > > > On Mon, Sep 21, 2015 at 1:56 AM, Michael Sklyar > wrote: > > > Thank you for your replies, >

Re: Asynchronous approach and samza

2015-09-21 Thread Michael Sklyar
t; > default does not provide this feature. So you maybe a little cautious > when > > implementing this. > > > > Thanks, > > > > Fang, Yan > > yanfang...@gmail.com > > > > On Sun, Sep 20, 2015 at 4:28 PM, Michael Sklyar > > wrote: > &

Asynchronous approach and samza

2015-09-20 Thread Michael Sklyar
ou are strongly discouraged from using threads in your job’s code*". It seems that Samza design suits very well "data transformation" scenarios, what is not clear is how well can it support external services? Thanks, Michael Sklyar