Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Chris Riccomini
tried running everything from the /vagrant directory directly and it > fails as well so this might actually be a synced folder issue. > > Lukas > > From: Lukas Steiblys > Sent: Wednesday, February 18, 2015 1:46 AM > To: dev@samza.apache.org > Subject: Re: RocksDBException:

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Lukas Steiblys
uary 17, 2015 3:25 PM > > To: dev@samza.apache.org > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > I deployed it to one of our VMs in Rackspace and it worked fine. > > Lukas > > -Original Message- From: Ruslan Khafizov > S

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-18 Thread Lukas Steiblys
age----- From: Lukas Steiblys > > Sent: Tuesday, February 17, 2015 3:25 PM > > > > To: dev@samza.apache.org > > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > > > I deployed it to one of our VMs in Rackspace and it worked fine. >

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
deal solution. > > Lukas > > -Original Message- From: Lukas Steiblys > Sent: Tuesday, February 17, 2015 3:25 PM > > To: dev@samza.apache.org > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > I deployed it to one of our VMs in Rackspace and it work

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
n: IO error: directory: Invalid argument I deployed it to one of our VMs in Rackspace and it worked fine. Lukas -Original Message- From: Ruslan Khafizov Sent: Tuesday, February 17, 2015 3:11 PM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument O

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
I deployed it to one of our VMs in Rackspace and it worked fine. Lukas -Original Message- From: Ruslan Khafizov Sent: Tuesday, February 17, 2015 3:11 PM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument On Wed, Feb 18, 2015 at 5:37 AM

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Ruslan Khafizov
ing on the check? > > Lukas > > -Original Message- From: Chris Riccomini > Sent: Tuesday, February 17, 2015 1:02 PM > > To: dev@samza.apache.org > Cc: Chris Riccomini > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > Hey Lucas, >

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
I could try and built a test job if you can’t reproduce it locally. Lukas From: Chris Riccomini Sent: Tuesday, February 17, 2015 2:19 PM To: Lukas Steiblys Cc: dev@samza.apache.org ; Chris Riccomini Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, Let me try

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
g a handle to the store, but then I got an error that > state/engagement-store/Partition 0 was not found. > > Lukas > > -Original Message- From: Chris Riccomini > Sent: Tuesday, February 17, 2015 1:47 PM > To: dev@samza.apache.org > Cc: Chris Riccomini > Subject: Re:

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
Riccomini Sent: Tuesday, February 17, 2015 1:47 PM To: dev@samza.apache.org Cc: Chris Riccomini Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, Hmm. 1. I'm running it as another user, but in the user's home directory so it has no problem writing or reading

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
gt; Sent: Tuesday, February 17, 2015 1:37 PM > > To: dev@samza.apache.org > Cc: Chris Riccomini > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > 1. I'm running it as another user, but in the user's home directory so it > has no problem writing or re

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
1:37 PM To: dev@samza.apache.org Cc: Chris Riccomini Subject: Re: RocksDBException: IO error: directory: Invalid argument 1. I'm running it as another user, but in the user's home directory so it has no problem writing or reading files. 2. See below. 3. I'm running Windows on my machine so I d

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
eted before the job was run, it's failing on the check? Lukas -Original Message- From: Chris Riccomini Sent: Tuesday, February 17, 2015 1:02 PM To: dev@samza.apache.org Cc: Chris Riccomini Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lucas, I'm w

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
t;> >> Lukas >> >> -Original Message- From: Chris Riccomini >> Sent: Tuesday, February 17, 2015 12:12 PM >> To: Chris Riccomini >> Cc: dev@samza.apache.org >> >> Subject: Re: RocksDBException: IO error: directory: Invalid argument >> >

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
ubject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, Strange. Having a more detailed look at your logs. Note: /vagrant is a synced folder, and I think it *does* persist between VM restarts. But, if you've deleted /vagrant/SamzaJobs/deploy, then the state should be empty. Cheers

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
spin up a new VM. Happens after a >>> restart as well. >>> >>> Lukas >>> >>> -Original Message- From: Chris Riccomini >>> Sent: Tuesday, February 17, 2015 11:01 AM >>> To: dev@samza.apache.org >>> Subject: Re: RocksDBExceptio

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
te: This happens every time even if I spin up a new VM. Happens after a restart as well. Lukas -Original Message- From: Chris Riccomini Sent: Tuesday, February 17, 2015 11:01 AM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, Interes

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
Same thing happens if I delete the whole deploy folder. Lukas -Original Message- From: Chris Riccomini Sent: Tuesday, February 17, 2015 12:07 PM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, Could you try clearing out the

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
M, Lukas Steiblys > wrote: > >> This happens every time even if I spin up a new VM. Happens after a >> restart as well. >> >> Lukas >> >> -Original Message- From: Chris Riccomini >> Sent: Tuesday, February 17, 2015 11:01 AM >> To: d

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
m: Chris Riccomini > Sent: Tuesday, February 17, 2015 11:01 AM > To: dev@samza.apache.org > Subject: Re: RocksDBException: IO error: directory: Invalid argument > > Hey Lukas, > > Interesting. Does this happen only after restarting your job? Or does it > happen the first t

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
This happens every time even if I spin up a new VM. Happens after a restart as well. Lukas -Original Message- From: Chris Riccomini Sent: Tuesday, February 17, 2015 11:01 AM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Chris Riccomini
/vagrant/SamzaJobs/deploy/samza/state/engaged-store > 36K/vagrant/SamzaJobs/deploy/samza/state > > Lukas > > -Original Message----- From: Chris Riccomini > Sent: Monday, February 16, 2015 5:53 PM > To: dev@samza.apache.org > Subject: Re: RocksDBException: IO e

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-17 Thread Lukas Steiblys
ge- From: Chris Riccomini Sent: Monday, February 16, 2015 5:53 PM To: dev@samza.apache.org Subject: Re: RocksDBException: IO error: directory: Invalid argument Hey Lukas, It looks like the exception is actually thrown on get, not put: at org.apache.samza.storag

Re: RocksDBException: IO error: directory: Invalid argument

2015-02-16 Thread Chris Riccomini
Hey Lukas, It looks like the exception is actually thrown on get, not put: at org.apache.samza.storage.kv.KeyValueStorageEngine.get( KeyValueStorageEngine.scala:44) 1. Are you running your job under YARN, or as a local job (ThreadJobFactory/ProcessJobFactory)? 2. What OS are you runnin

RocksDBException: IO error: directory: Invalid argument

2015-02-16 Thread Lukas Steiblys
Hello, I was setting up the key-value storage engine in Samza and ran into an exception when querying the data. I added these properties to the config: stores.engaged-store.factory=org.apache.samza.storage.kv.RocksDbKeyValueStorageEngineFactory stores.engaged-store.changelog=kafka.eng