Hi Spark Team,
I am using Spark 3.4.0 version in my application which is use to consume
messages from Kafka topics.
I have below queries:
1. Does DStream support pause/resume streaming message consumption at runtime
on particular condition? If yes, please provide details.
2. I tried to revoke partition from consumer at runtime which cause error.
throw new IllegalStateException(s"Previously tracked partitions " +
s"${revokedPartitions.mkString("[", ",", "]")} been revoked by Kafka
because of consumer " +
s"rebalance. This is mostly due to another stream with same group id
joined, " +
s"please check if there're different streaming application misconfigure
to use same " +
s"group id. Fundamentally different stream should use different group
id")
3. Does Spark support Blue/Green Deployment. I need to implement Blue/Green
Deployment scenario with Spark. Facing problem as need to deploy both Blue and
Green deployment with same consumer-group-id. As I read, spark does not support
2 deployment with same consumer group-id, this implementation is failing.
Please guide how this can be implemented with Spark.
4. Does Spark support Active-Active deployment.
It will be great if you can reply on above queries please.
--
Regards,
Saurabh Agrawal
Software Development Specialist, IPaaS R&D
[A picture containing logoDescription automatically generated]
This email and the information contained herein is proprietary and confidential
and subject to the Amdocs Email Terms of Service, which you may review at
https://www.amdocs.com/about/email-terms-of-service
<https://www.amdocs.com/about/email-terms-of-service>
