Re: Review Request 31034: SAMZA-479: Make StreamAppender pluggable for different log formats

2015-02-18 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31034/ --- (Updated Feb. 19, 2015, 2:07 a.m.) Review request for samza. Bugs: SAMZA-479

Re: Stream SQL for Samza Query Language Guide and Design

2015-02-18 Thread Chris Riccomini
Hey all, I've setup a request with INFRA to migrate to CWiki: https://issues.apache.org/jira/browse/INFRA-9176 Cheers, Chris On Tue, Feb 17, 2015 at 9:57 AM, Yi Pan wrote: > I shared the same pain with wiki before. Either cwiki or Markdown sounds > good to me. > > -Yi > > On Tue, Feb 17, 2015

Re: Review Request 31034: SAMZA-479: Make StreamAppender pluggable for different log formats

2015-02-18 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/31034/ --- (Updated Feb. 18, 2015, 9:36 p.m.) Review request for samza. Bugs: SAMZA-479

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Chris Riccomini
Hey Lukas, I agree. The error was failing when trying to fsync the directory. Given that the directory is a synced folder, maybe there's something weird going on with the FS that RocksDB doesn't like. Cheers, Chris On Wed, Feb 18, 2015 at 11:41 AM, Lukas Steiblys wrote: > I tried running every

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Lukas Steiblys
I tried running everything from the /vagrant directory directly and it fails as well so this might actually be a synced folder issue. Lukas From: Lukas Steiblys Sent: Wednesday, February 18, 2015 1:46 AM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argum

RE: [DISCUSS] JDK7

2015-02-18 Thread Tommy Becker
I just added this comment to SAMZA-455, since I was listed as requesting JDK 6 support: We have recently migrated to JDK 8, so you may consider my request for JDK 6 support withdrawn (though it was really more of a clarification of whether JDK 6 is supported than a request for such support). Pe

Re: [DISCUSS] JDK7

2015-02-18 Thread Julian Hyde
Another data point. Calcite just dropped support for JDK 1.6. Calcite 1.0 supports 1.6, 1.7, 1.8, but Calcite 1.1 will only support 1.7, 1.8. We could be persuaded to reconsider. Julian > On Feb 18, 2015, at 09:40, Chris Riccomini wrote: > > Hey all, > > Ruslan has been working on upgradin

Re: [DISCUSS] JDK7

2015-02-18 Thread Chris Riccomini
Hey all, FYI- Calcite and Hive have also dropped support for JDK6: https://issues.apache.org/jira/browse/CALCITE-591 https://issues.apache.org/jira/browse/HIVE-9521 This will impact SAMZA-390. Cheers, Chris On Wed, Feb 18, 2015 at 9:40 AM, Chris Riccomini wrote: > Hey all, > > Ruslan has

[DISCUSS] JDK7

2015-02-18 Thread Chris Riccomini
Hey all, Ruslan has been working on upgrading Samza to the latest RocksDB build. https://issues.apache.org/jira/browse/SAMZA-442 During this migration, we realized that upgrading Samza to a modern version of RocksDB will require JDK 7, since RocksDB requires it to build. Without this upgrade,

Re: Process of adding a new integration test

2015-02-18 Thread Milinda Pathirage
Hi Chris, Thanks for the reply. I'll have a look at the resources and update tests.md once I figure out the way to add tests. Milinda On Wed, Feb 18, 2015 at 12:04 PM, Chris Riccomini wrote: > Hey Milinda, > > Use the negate-numbers test in samza-test as an example. Adding a new test > involve

Re: Process of adding a new integration test

2015-02-18 Thread Chris Riccomini
Hey Milinda, Use the negate-numbers test in samza-test as an example. Adding a new test involves adding some code to samza-test/src/main/python, and samza-test/src/main/java (if you want to write a new StreamTask). Have a look at: https://github.com/linkedin/Zopkio http://samza.apache.org/co

Process of adding a new integration test

2015-02-18 Thread Milinda Pathirage
Hi, What is the process I need to follow to add a new integration test to the samza-test? Is there a easy way, if I just need to initialize a task and send some messages to it? Thanks Milinda -- Milinda Pathirage PhD Student | Research Assistant School of Informatics and Computing | Data to In

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Lukas Steiblys
The symlink is to the synced folder /vagrant from the running user's home directory. That's essentially where all the project files are and where the job is run from. There are a couple of hardcoded paths in the setup so it might not be easy to run the job from /vagrant directly, but I can try. A

Re: Modeling charts

2015-02-18 Thread Uwe Dauernheim
Thanks Fang, will do some read up. /Uwe On Tue, Feb 17, 2015 at 11:01 PM, Yan Fang wrote: > Hi Uwe, > > Your use case seems to me is more like a state-management case. What comes > to my mind is that, > 1) every time a song is played, you updates the count of this song. You do > not put the map