Help needed in Spark Job.

Hi Spark Users, I am facing an issue while running a spark job in aws glue. The whole case is on this link please help me to figure it out what is the issue with it. Than

PySpark Connect client hangs after query completes

Hello, I have observed that for long queries (say > 1 hour) from pyspark with Spark Connect (3.5.2), the client often gets stuck: even when the query completes successfully, the client stays waiting in _execute_and_fetch_as_iterator​ (see traceback below). The client session still shows as act

Data is not displayed in the readable format

Hi Team, It would be really helpful if I can get any help on this https://stackoverflow.com/questions/79121611/unable-to-get-the-postgres-data-in-the-right-format-via-kafka-jdbc-source-conne Any hints would be appreciated. Thanks,