[GitHub] [incubator-brpc] cuisonghui commented on issue #697: 客户端出现大量timeout

Tue, 09 Apr 2019 23:22:18 -0700 

cuisonghui commented on issue #697: 客户端出现大量timeout
URL: https://github.com/apache/incubator-brpc/issues/697#issuecomment-481550024
 
 
   已经把bvar的线程移动到main函数之后执行，以保证fork之后才执行bvar线程．
   
   目前进行业务压测，超时问题应该是bthread_worker_usage达到上限导致,跟预期服务承载能力不相符，目前还在排查．
   
![1755025561](https://user-images.githubusercontent.com/8772285/55847307-5cf25080-5b7b-11e9-8b62-20c5aae2a2d8.jpg)
   
![376294209](https://user-images.githubusercontent.com/8772285/55847315-61b70480-5b7b-11e9-9f03-238b22bb9d5f.jpg)
   
   但是随着qps继续上涨，服务会直接卡死，访问前端页面(http://*:6104,http://*:6104/vars)也不行，压测全部报超时error
   *******
   Search request Error1: 1008: [E1008]Reached timeout=3500ms @*:6104 Query : 
爱情练习题
   Search request Error1: 1008: [E1008]Reached timeout=3500ms @*:6104 Query : 
爱情两部曲
   Search request Error1: 1008: [E1008]Reached timeout=3500ms @*:6104 Query : 
爱情两好三坏
   Search request Error1: 1008: [E1008]Reached timeout=3500ms @*:6104 Query : 
爱情领域
   *******
   且服务cpu占用基本为0,服务不能自己恢复正常,只能重启解决．
   但是netstat查看监听端口正常,处于LINSEN状态，并且使用telnet访问此端口也能连接上.
   然而发现服务的线程堆栈信息block住，导致的问题.
   ![Screenshot from 2019-04-10 
14:16:22](https://user-images.githubusercontent.com/8772285/55856000-989d1280-5b9b-11e9-89d2-060053fac326.png)
   
   麻烦帮忙定位下这是什么原因导致的?
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to