Re: "Could not deserialize AssignedTask" error

2014-08-12 Thread Brian Wickman
re InitGoogleLogging() is written to STDERR > I0813 00:57:40.229567 10732 exec.cpp:131] Version: 0.19.1 > I0813 00:57:40.231796 10761 exec.cpp:205] Executor registered on slave > 20140812-235601-84869386-5050-469-0 > FATAL] Could not deserialize AssignedTask > FATAL] Traceback (most recen

Re: "Could not deserialize AssignedTask" error

2014-08-12 Thread Bill Farner
exec.cpp:205] Executor registered on slave > 20140812-235601-84869386-5050-469-0 > FATAL] Could not deserialize AssignedTask > FATAL] Traceback (most recent call last): > File "apache/aurora/executor/aurora_executor.py", line 234, in > validate_task > assigned_task

"Could not deserialize AssignedTask" error

2014-08-12 Thread Josh Adams
0813 00:57:40.229567 10732 exec.cpp:131] Version: 0.19.1 I0813 00:57:40.231796 10761 exec.cpp:205] Executor registered on slave 20140812-235601-84869386-5050-469-0 FATAL] Could not deserialize AssignedTask FATAL] Traceback (most recent call last): File "apache/aurora/executor/aurora_executo

Re: best practice to use host local drive?

2014-08-12 Thread Jay Buffington
On Tue, Aug 12, 2014 at 1:18 PM, Bill Farner wrote: > - read/write, persistent data > > There's not a great story here, at least not in the traditional > mesos/aurora "run anywhere" model. The best approach we have so far is to > mount to a directory owned by the user that will access the data, c

Re: Service Discovery with Announcer a la AURORA-587

2014-08-12 Thread Brian Wickman
Your understanding is correct. The znodes will be standard sequential/ephemerals in the paths you mention, starting with "member_" and ending in the sequence id. You can either roll your own code to read the znodes or derive from one of the implementations referenced in the user guide. ~brian

Service Discovery with Announcer a la AURORA-587

2014-08-12 Thread Joe Stein
Hey, so I wanted to confirm my understanding of AURORA-587 (based on my reading the rb). So lets say I launch some Kafka brokers with Aurora. Then the host/ports would end up under. /aurora/role/enviornment/mykafkaclusterexample So then when I launch a producer (which requires a broker to connec

Re: best practice to use host local drive?

2014-08-12 Thread Bill Farner
The answer will depend on the use case. Here's the three most common: - read/write scratch space (e.g. /tmp) Prefer using the sandbox instead (avoid the problem). Otherwise, create a directory containing a UUID and try to clean up after yourself. This is ultimately brittle. - read-only data a

best practice to use host local drive?

2014-08-12 Thread Joe Stein
Hi, I wanted to get recommends on what is the best practice within a launched task by Aurora for accessing some local drive (i.e. /mnt/data/stuff) within the process running. Thanks! /*** Joe Stein Founder, Principal Consultant Big Data Open Source Secur