ns/45618489/executing-separate-streaming-queries-in-spark-structured-streaming
>
>
>
> appreciate your further help/support.
>
>
>
> Best Regards,
>
>
>
> Jian Xu
>
>
>
> *From:* Amit Joshi
> *Sent:* Friday, May 21, 2021 12:52 PM
> *To:* jia...@xtro
Sent: Friday, May 21, 2021 5:10 PM
To: 'Amit Joshi'
Cc: user@spark.apache.org
Subject: RE: multiple query with structured streaming in spark does not work
�
Hi Amit;
�
Thank you for your prompt reply and kind help. Wonder how to set the scheduler
to FAIR mode in python. Follo
no
Cc: user@spark.apache.org
Subject: Re: multiple query with structured streaming in spark does not work
�
Hi Jian,
�
You have to use same spark session to run all the queries.
And use the following to wait for termination.
�
q1 = writestream.start
q2 = writstream2.start
spark.streams.awai
Hi Jian,
You have to use same spark session to run all the queries.
And use the following to wait for termination.
q1 = writestream.start
q2 = writstream2.start
spark.streams.awaitAnyTermination
And also set the scheduler in the spark config to FAIR scheduler.
Regards
Amit Joshi
On Saturday
Hi There;
�
I am new to spark. We are using spark to develop our app for data streaming
with sensor readings.
�
I am having trouble to get two queries with structured streaming working
concurrently.
�
Following is the code. It can only work with one of them. Wonder if there is
any way
