Thanks all, here is my application: Project Name: Support Pulsar Transaction Buffer multi snapshot Project Description:
Now the pulsar transaction buffer is recovered by one snapshot, this snapshot is an entry. When the number of abort txns is too many, the size of this snapshot will exceed the size limit of a single entry. In this case, we should take multiple snapshots to prevent snapshots from failing to take because the entry size limit is exceeded. Difficulty Level: - [ ] Basic - [x] Advanced Project Validation Items: Item 1: Write a proposal to describe your design Item 2: Implement the multi snapshot feature at the pulsar transaction buffer and push the PR out Item 3: Add unit tests to verify it Item 4: Add the documentation for this feature … Project Mentor: Bo Cong Your Name: Bo Cong Your Email: bog...@apache.org Your Apache ID: bogong Ran Gao <r...@apache.org> 于2022年5月6日周五 22:51写道： > > Thanks for Penghui and Dianjin, > > Project Name: Query compacted data of topic by Pulsar SQL > > Project Description: > > The Pulsar SQL is a SQL query engine for Pulsar topics data analytics based > on the Trino, users could get data from Pulsar topics by SQL scripts. The > topic compaction is used to compress messages which has a key, after > compaction, the topic will only maintain the latest value of the key. > > Currently, the Pulsar didn't support querying compacted data, it's a useful > improvement for Pulsar SQL. Some key points for implementing this feature are > understanding the topic compaction process, how to split topic data(compacted > part and un-compacted part) to generate query tasks, and reading data of the > compacted ledger. > > Difficulty Level: > - [ ] Basic > - [x] Advanced > > Project Validation Items: > Item 1: Understand and try to use topic compaction and the Pulsar SQL > component. > Item 2: Prepare a design for this feature. > Item 3: Start coding. > Item 4: Add unit and integration tests. > Item 5: Add doc for this feature. > > Project Mentor: > Your Name: Ran Gao > Your Email: r...@apache.org > Your Apache ID: rgao > > > On 2022/04/24 13:23:18 PengHui Li wrote: > > Hi all, > > > > Open Source Promotion Plan, OSPP[1] is open for project registration, > > like Google Summer of Code. This Plan aims to encourage college students > > to participate in open-source projects and make contributions. > > > > The project idea is open from 4/21, 2022 to 5/9, 2022(UTC+8). > > Apache Pulsar ended up with 6 projects seats. If you have great ideas, > > please copy the following template and fill in the fields. > > Once you have completed your project ideas, you can reply to this email. > > We will help you register for the program. Note that One mentor can > > mentor one project at a time and both mentors and students can > > receive financial awards for completed projects. Only Pulsar committers > > can be the mentors as asked by the OSPP. > > > > The project can include feature catchup, ecological tool construction, > > new features of the pulsar and so on. > > > > Welcome to join the Pulsar > > slack channel: #ospp-summer for asking any questions about OSPP. > > > > [1] https://summer-ospp.ac.cn > > > > Thanks, > > Penghui > > > > ---------------------------------------- > > Template > > > > Project Name: > > Project Description: (at most 1000 words) > > Difficulty Level: > > - [ ] Basic > > - [ ] Advanced > > Project Validation Items: > > Item 1:__________________________ > > Item 2:__________________________ > > Item 3:__________________________ > > … > > Project Mentor: > > Your Name: > > Your Email: > > Your Apache ID: > >
