Hi guys,

I have tried SparkStructuredStreamingRunner for streaming job with Spark 2.4 
and it does not work.
I faced with the same error which is described on stackoverflow:
https://stackoverflow.com/questions/64361372/apache-bean-spark-runner-does-not-work-on-streaming-mode-java-lang-illegalacce

Exception in thread "main" java.lang.IllegalAccessException: Class 
org.apache.spark.sql.streaming.DataStreamReader can not access a member of 
class 
org.apache.beam.runners.spark.structuredstreaming.translation.streaming.DatasetSourceStreaming
 with modifiers ""

It gives the same result for 2.25, 2.26, 2.27 versions.

Is there any Jira issue ticket to track progress regarding it?


Best regards,
Dmytro Dragan | dd...@softserveinc.com<mailto:dd...@softserveinc.com> | Lead 
Big Data Engineer| SoftServe<http://www.softserveinc.com/>


Reply via email to