after the 6th patch, we have all our codes done, we'd like to stop and
get all the review done. this is for the first attempt to the memory
core, not the last :D

let us sum up what is there:
1, we made a dyn-freelist, which will prefer to free the memory when
some list is wasting memory.
2, we changed the direct IO buffer allocator, using the memory in LRU
list instead of the freelist, the result is POP one, read one, on the
standard LRU.

by the #2, we have strict the standard LRU to the memory blocks when the
ram cache is full. by #1, we can free the unused memory buckets into the
system or reuse internally.

that is what we have done in Taobao, which  is very critical enhancement
for us, or ATS is not usable for us at all.

NOTE: you must change the LRU algorithm to Standard LRU by set
proxy.config.cache.ram_cache.algorithm to 1
what we have done is hard to adapt into  CLFUS, we are still seeking the
way for CLFUS. Anyway, let us make sure we can lock the memory down.

thanks

在 2012-12-09日的 00:47 +0800,ming....@gmail.com写道:
> laster week, we have submited the patches for  TS-1006,
> https://issues.apache.org/jira/browse/TS-1006 .
> 
> the memory issue is the most critical issue here as we are running TS in
> heavy duty, here is the 2nd  version of our memory patch in TS-1006:
> https://issues.apache.org/jira/secure/attachment/12556207/0001-Allocator-optimize-InkFreeList-memory-pool.patch
> https://issues.apache.org/jira/secure/attachment/12556208/0002-Allocator-make-InkFreeList-memory-pool-configurable.patch
> 
> if you have some issue with memory problem, please try it and feed back.
> 
> and if you are interesting in the detail and here is the docs for the
> detail, but in Chinese:
> https://docs.google.com/document/d/12ojZqZdPH-Xuhjo_UgX9i5o9jEO3JRdB577g1Azhut4/edit
> these patches done by Zhang Yunkai, guided by Chen Bin. the first
> version contributed by  Chen Bin(kuotai), and not intend to commit.
> 
> there is another memory issue in the ram_cache, where we'd like to fix
> it if we have TS-1006 accepted, maybe we can put our interim solution
> later.
> 
> thanks 

-- 
Zhao Yongming
aka: zym @ apache.org, yonghao @ taobao.com

Reply via email to