Hi All
My Company use a leader-follower instructure to solve large index problem,
instructure just like picture (attach file name: instructure.png). And data
update process is like:
1. disable follwer polling by sending disablepolling HTTP request
2. index data into offline leader
3. send optimize request compress into 10 segements
4. send enablepolling request to all follower node and wait for poll finished
In this process, we meet a problem, slave poll blocked, progress show 0% and
currentFile shows last Iterations file just like picture 2(attach file name:
blocked.png)
So I read the source code and use diagnostic tools Arthas to find reason. The
reasonof showing last Iterations file I found. Because of currentFile does't
have mechanisms to reset to Null after normal poll job finishing and all files
downloaded.
And the "dead loop" problem I alse found by using Arthas, indexFetcher Thread
Blocked in acquire iwLock's writeLock because of readLock not unclocked
success, But I still can find the reason why readLock can't unlock. So I send
this mail to ask for help! Thanks
x...@wedoctor.com