Hi KafkaUsers, I have a question regarding the scalability of Kafka Rest Proxy in production. I have a use case where I have to push data from on-premise data centres(many) to AWS MSK. I have setup proxy rest api to push data, however before taking this into production want to understand whether this can handle high-load or not. As ours is a IOT use case data will be in high volume. We are going to deploy this on ec2 instances fronted by AWS ALBs for load balancing have multiple instances(auto-scaling enabled). In addition are there are documentation on config tuning to run this under high volumes as well. I have gone through this link - https://docs.confluent.io/1.0/kafka-rest/docs/deployment.html . As most of the emphasis in on consumer side as that is a stateful operation and hence a point of concern. Since mine is a produce only use case, are there any limitations and known issues which could be a major blocker. Alternatively are there any other options we can look into to achieve the same thing. Anyone who is running it in production if you can share your experience and learning will be very helpful.
Thanks in advance. Cheers, Hemant