[ 
https://issues.apache.org/jira/browse/KAFKA-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15799448#comment-15799448
 ] 

Apurva Mehta commented on KAFKA-4558:
-------------------------------------

That sounds like a good idea in general, to make metrics easier to gather from 
a variety of clients. What metric would you add to the consumer to fix this 
test? Number of partitions assigned or something else?

Another thought: the Throttling test strictly requires that consumer be started 
and ready to go before the producer starts. The other tests using 
`ProduceConsumeValidate` do not require this. One short term work around is to 
revert [this patch to 
ProduceConsumeValidate|https://github.com/apache/kafka/pull/1904/files#diff-70247099943a55f682e6e6e4f400334eL35]
 . This way, we could keep the throttling test ignored until we have a more 
reliable way to determine that the consumer is ready, but the other tests would 
be good to go..

Thoughts?

> throttling_test fails if the producer starts too fast.
> ------------------------------------------------------
>
>                 Key: KAFKA-4558
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4558
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Apurva Mehta
>            Assignee: Apurva Mehta
>
> As described in https://issues.apache.org/jira/browse/KAFKA-4526, the 
> throttling test will fail if the producer in the produce-consume-validate 
> loop starts up before the consumer is fully initialized.
> We need to block the start of the producer until the consumer is ready to go. 
> The current plan is to poll the consumer for a particular metric (like, for 
> instance, partition assignment) which will act as a good proxy for successful 
> initialization. Currently, we just check for the existence of a process with 
> the PID, which is not a strong enough check, causing the test to fail 
> intermittently. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to