Hi again,
On Tue, Sep 9, 2014 at 2:20 PM, Tobias Pfeiffer wrote:
>
> On Tue, Sep 9, 2014 at 2:02 PM, Ron's Yahoo! wrote:
>>
>> For example, let’s say there’s a particular topic T1 in a Kafka queue.
>> If I have a new set of requests coming from a particular client A, I was
>> wondering if I co
Hi,
On Tue, Sep 9, 2014 at 2:02 PM, Ron's Yahoo! wrote:
> So I guess where I was coming from was the assumption that starting up a
> new job to be listening on a particular queue topic could be done
> asynchronously.
>
No, with the current state of Spark Streaming, all data sources and the
pr
Hi Tobias,
So I guess where I was coming from was the assumption that starting up a new
job to be listening on a particular queue topic could be done asynchronously.
For example, let’s say there’s a particular topic T1 in a Kafka queue. If I
have a new set of requests coming from a particular
Hi,
On Tue, Sep 9, 2014 at 12:59 PM, Ron's Yahoo! wrote:
>
> I want to create a synchronous REST API that will process some data that
> is passed in as some request.
> I would imagine that the Spark Streaming Job on YARN is a long
> running job that waits on requests from something. What that s
Tobias,
Let me explain a little more.
I want to create a synchronous REST API that will process some data that is
passed in as some request.
I would imagine that the Spark Streaming Job on YARN is a long running job
that waits on requests from something. What that something is is still not
cl
Tobias,
Let me explain a little more.
I want to create a synchronous REST API that will process some data that is
passed in as some request.
I would imagine that the Spark Streaming Job on YARN is a long running job
that waits on requests from something. What that something is is still not
Ron,
On Tue, Sep 9, 2014 at 11:27 AM, Ron's Yahoo!
wrote:
>
> I’m trying to figure out how I can run Spark Streaming like an API.
> The goal is to have a synchronous REST API that runs the spark data flow
> on YARN.
I guess I *may* develop something similar in the future.
By "a synchronou
Hi,
I’m trying to figure out how I can run Spark Streaming like an API.
The goal is to have a synchronous REST API that runs the spark data flow on
YARN.
Has anyone done something like this? Can you share your architecture? To
begin with, is it even possible to have Spark Streaming run as a
