Do you really need to create a DStream from the original messaging queue?
Can't you just read them in a while loop or something on the driver?
On Fri, Jun 16, 2017 at 1:01 PM, Mike Hugo wrote:
> Hello,
>
> I have a web application that publishes JSON messages on to a messaging
> queue that conta
Hello,
I have a web application that publishes JSON messages on to a messaging
queue that contain metadata and a link to a CSV document on S3. I'd like
to iterate over these JSON messages, and for each one pull the CSV document
into spark SQL to transform it (based on the metadata in the JSON mes
