Hi I have been using Embedded Kafka in my batch job to test if my output is correct. It works correctly upto Spark 3.4.3 but fails at Spark 3.5.0. I have tried different versions of Embedded Kafka as well upto the latest version.
What might be the problem? Is this something that needs to be fixed in Spark or Embedded Kafka? I am using this library: https://github.com/embeddedkafka/embedded-kafka This is the exception I get: io.github.embeddedkafka.KafkaUnavailableException was thrown. io.github.embeddedkafka.KafkaUnavailableException at io.github.embeddedkafka.ops.ProducerOps.publishToKafka(ProducerOps.scala:219) at io.github.embeddedkafka.ops.ProducerOps.publishToKafka(ProducerOps.scala:82) at io.github.embeddedkafka.ops.ProducerOps.publishToKafka$(ProducerOps.scala:72) at MySpec.publishToKafka(MySpec.scala:5) Please help. Thank you Kind regards, Adesh
