Re: [Proposal] Support large variable-length string type

2021-07-20 Thread Zhao Chun
Chun > Sent: July 20, 2021 2:42 > To: dev@doris.apache.org > Subject: Re: [Proposal] Support large variable-length string type > > This solution we have done some POC internally. > > In the current code, this will cause the memory usage to become larger and > more likely to trig

Re: [Proposal] Support large variable-length string type

2021-07-20 Thread Lee Happen
ly 20, 2021 2:42 To: dev@doris.apache.org Subject: Re: [Proposal] Support large variable-length string type This solution we have done some POC internally. In the current code, this will cause the memory usage to become larger and more likely to trigger OOM, also the size of batch will excee

Re: [Proposal] Support large variable-length string type

2021-07-19 Thread Zhao Chun
This solution we have done some POC internally. In the current code, this will cause the memory usage to become larger and more likely to trigger OOM, also the size of batch will exceed the maximum value of int32 during RPC. So to use this scheme, you need to design carefully in several places.