GoGoWen opened a new pull request, #31995:
URL: https://github.com/apache/doris/pull/31995
## Proposed changes
In our situation, we use Doris to query iceberg table which data file
stored in cloud OSS. As the oss charge we with the number of api call, we want
to optimize the number of api call.
change:
1, let buffer size configurable, as we have many small file, and later will
want reuse this instead of read file again to reduce OSS api call
2, use heap instead of stack for parquet footer read buffer, in order to
reduce the risk of stack overflow
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
