Xiangdong Huang created COMDEV-411: -------------------------------------- Summary: Apache IoTDB: use netty as the memory buffer pool to reduce GC problem and take full use of memory Key: COMDEV-411 URL: https://issues.apache.org/jira/browse/COMDEV-411 Project: Community Development Issue Type: Task Components: GSoC/Mentoring ideas Reporter: Xiangdong Huang
Apache IoTDB [1] is an Open Source IoT database designed to meet the rigorous data, storage, and analytics requirements of large-scale Internet of Things (IoT) and Industrial Internet of Things (IIoT) applications. Memory control is very very important for DBMS. Currently, we are using a customized memory buffer pool, which contains a pool of int[], a pool of long[], a pool of boolean[] and as well as float[] and double[]. However, there are two things left: # it is complex to implement a buffer pool for String[] or byte[][], as the size of String and byte[] are variable. # We are using HeapByteBuffer, while in many cases, directByteBuffer is more efficient. As Netty has provided a high efficient buffer pool, we'd like to try to migrate the current buffer pool to the Netty implementation. Things you should know: # Know Java well # Know Netty well # read codes of IoTDB (mainly in StorageEngine, StorageGroupProcessor and related classes) -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@community.apache.org For additional commands, e-mail: dev-h...@community.apache.org