technotablet opened a new issue, #8587:
URL: https://github.com/apache/gravitino/issues/8587
### What would you like to be improved?
We encountered frequent crashes and `WAITING_FOR_RESOURCES` errors on Trino
for larger workloads when using Gravitino 0.9.1 as the Iceberg REST Catalog
Service. After significant troubleshooting, we discovered that the root cause
was insufficient memory allocated via the undocumented `GRAVITINO_MEM`
environment variable defined in common.sh:
```
if [[ -z "${GRAVITINO_MEM}" ]]; then
export GRAVITINO_MEM="-Xms1024m -Xmx1024m -XX:MaxMetaspaceSize=512m"
fi
```
The above was overriding any options that we provided in `JAVA_OPTS` when
starting the Gravitino Iceberg REST Catalog Docker Container.
This parameter is not mentioned anywhere in the official documentation or
release notes, so users often remain unaware of it until they face stability
issues.
### How should we improve?
We suggest documenting `GRAVITINO_MEM` with:
* Purpose and scope: Explain its role in controlling JVM memory for
Gravitino when used as an Iceberg REST Catalog Service.
* Default values and tuning guidance: Provide recommended configurations for
different workload sizes.
* Impact on stability: Highlight that insufficient memory can lead to
failures like `WAITING_FOR_RESOURCES` on Trino and similar systems.
* Examples: Offer sample settings for production vs. development
environments.
Adding this to the documentation will help other users avoid similar
troubleshooting pain and improve production reliability.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
