I have a requirement to write in kafka queue from a spark streaming application.
I am using spark 1.2 streaming. Since different executors in spark are allocated at each run so instantiating a new kafka producer at each run seems a costly operation .Is there a way to reuse objects in processing executors(not in receivers)?
