after the 6th patch, we have all our codes done, we'd like to stop and get all the review done. this is for the first attempt to the memory core, not the last :D
let us sum up what is there: 1, we made a dyn-freelist, which will prefer to free the memory when some list is wasting memory. 2, we changed the direct IO buffer allocator, using the memory in LRU list instead of the freelist, the result is POP one, read one, on the standard LRU. by the #2, we have strict the standard LRU to the memory blocks when the ram cache is full. by #1, we can free the unused memory buckets into the system or reuse internally. that is what we have done in Taobao, which is very critical enhancement for us, or ATS is not usable for us at all. NOTE: you must change the LRU algorithm to Standard LRU by set proxy.config.cache.ram_cache.algorithm to 1 what we have done is hard to adapt into CLFUS, we are still seeking the way for CLFUS. Anyway, let us make sure we can lock the memory down. thanks 在 2012-12-09日的 00:47 +0800,ming....@gmail.com写道: > laster week, we have submited the patches for TS-1006, > https://issues.apache.org/jira/browse/TS-1006 . > > the memory issue is the most critical issue here as we are running TS in > heavy duty, here is the 2nd version of our memory patch in TS-1006: > https://issues.apache.org/jira/secure/attachment/12556207/0001-Allocator-optimize-InkFreeList-memory-pool.patch > https://issues.apache.org/jira/secure/attachment/12556208/0002-Allocator-make-InkFreeList-memory-pool-configurable.patch > > if you have some issue with memory problem, please try it and feed back. > > and if you are interesting in the detail and here is the docs for the > detail, but in Chinese: > https://docs.google.com/document/d/12ojZqZdPH-Xuhjo_UgX9i5o9jEO3JRdB577g1Azhut4/edit > these patches done by Zhang Yunkai, guided by Chen Bin. the first > version contributed by Chen Bin(kuotai), and not intend to commit. > > there is another memory issue in the ram_cache, where we'd like to fix > it if we have TS-1006 accepted, maybe we can put our interim solution > later. > > thanks -- Zhao Yongming aka: zym @ apache.org, yonghao @ taobao.com