Hi Ram,
Have you seen this stackoverflow query and response-
https://stackoverflow.com/questions/39685744/apache-spark-how-to-cancel-job-in-code-and-kill-running-tasks
if not, please have a look. seems to have a similar problem .
*Regards,*
*Someshwar Kale*
On Fri, May 20, 2022 at 7:34 AM Artem
WAITFOR is part of the Transact-SQL and it's Microsoft SQL server
specific, not supported by Spark SQL. If you want to impose a delay in
a Spark program, you may want to use the thread sleep function in Java
or Scala. Hope this helps...
On 5/19/22 1:45 PM, K. N. Ramachandran wrote:
Hi Sean,
Hi Sean,
I'm trying to test a timeout feature in a tool that uses Spark SQL.
Basically, if a long-running query exceeds a configured threshold, then the
query should be canceled.
I couldn't see a simple way to make a "sleep" SQL statement to test the
timeout. Instead, I just ran a "select count(*)
[Note: You're receiving this because you are subscribed to one or more
Apache Software Foundation project mailing lists.]
This is your final reminder that the Call for Presetations for
ApacheCon North America 2022 will close at 00:01 GMT on Monday, May
23rd, 2022. Please don't wait! Get your talk