Re: ChangeLog Question for TTL rocksDB stores

2016-02-03 Thread David Garcia
Boris, thank you for the clarification. But just to make sure I understand, is it correct to say that entries deleted by the TTL-policy in rocksDB will NOT be logged in the change-log? My job processes a lot of data and saves a large portion of it to RocksDB (for reference later…but subject to a

Re: ChangeLog Question for TTL rocksDB stores

2016-02-03 Thread Boris Shkolnik
As Jacob mentioned there is not direct relationship between the rocksdb tts (internal to rocksdb) and changelog (done by Samza). The problem may arise if the store is restored from the changelog, since the log will have the expired entries, and they will be entered with the NEW date (and as Yi ment

You're Invited: Apache Samza Meetup on Wednesday, February 17 at LinkedIn's campus in Mountain View, CA.

2016-02-03 Thread Ed Yakabosky
Hi all, I want to formally invite you all to attend an Apache Samza meetup on Wednesday, February 17 at LinkedIn's campus in Mountain View, CA. Here's are the details: - You can find the agenda and RSVP here . - We have two

Re: Review Request 43074: SAMZA-866 Refactor and fix Container allocation logic.

2016-02-03 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43074/ --- (Updated Feb. 3, 2016, 8:04 p.m.) Review request for samza, Navina Ramesh and Y

Re: Review Request 43074: SAMZA-866 Refactor and fix Container allocation logic.

2016-02-03 Thread Jake Maes
> On Feb. 3, 2016, 2:55 a.m., Jagadish Venkatraman wrote: > > samza-yarn/src/main/java/org/apache/samza/job/yarn/ContainerAllocator.java, > > line 46 > > > > > > I think the javadoc about the run() method may be move

Re: Review Request 43074: SAMZA-866 Refactor and fix Container allocation logic.

2016-02-03 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43074/ --- (Updated Feb. 3, 2016, 8:03 p.m.) Review request for samza, Navina Ramesh and Y