tongtaodragon opened a new issue, #7613:
URL: https://github.com/apache/rocketmq/issues/7613

   ### Before Creating the Bug Report
   
   - [X] I found a bug, not just asking a question, which should be created in 
[GitHub Discussions](https://github.com/apache/rocketmq/discussions).
   
   - [X] I have searched the [GitHub 
Issues](https://github.com/apache/rocketmq/issues) and [GitHub 
Discussions](https://github.com/apache/rocketmq/discussions)  of this 
repository and believe that this is not a duplicate.
   
   - [X] I have confirmed that this bug belongs to the current repository, not 
other repositories of RocketMQ.
   
   
   ### Runtime platform environment
   
   Linux 
   
   ### RocketMQ version
   
   Broker: 4.8.0
   Client: 4.9.3
   
   ### JDK Version
   
   java version "1.8.0_121"
   
   ### Describe the Bug
   
   A topic has 4 brokers and 16 queues totally. One consumer group has two 
instance.
   After the issue observed, find the cg lag keeps growing. We identify two 
queues in one broker have the issue. The offset of these two queues has no 
change. We use tcpdump check the message sent from client to broker and found 
the offset sent from client always use the old value. Then we check the dump 
file of client and find the offset in dump of these two queues use old value. 
At the same time we find consumer still consume message successfully from all 
queues.
   
   Since it's production environment we use admin tool reset offset. Now the 
problem has gone.
   
   ### Steps to Reproduce
   
   Don't know how to reproduce it currently.
   
   Some clues
   1. Our client started in docker container.
   2. Due to node issue we have to restart all nodes one by one.
   3. The message of that offset was consumed by one old container but this 
message is still pulled by new started container.
   4. We use pushConsumer model.
   5. Other 14 queues offset is normal
   
   ### What Did You Expect to See?
   
   No lag and offset is normal
   
   ### What Did You See Instead?
   
   Lag keep growing and offset maintain old value
   
   ### Additional Context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@rocketmq.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to