[
https://issues.apache.org/jira/browse/IMPALA-13795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985662#comment-17985662
]
Surya Hebbar commented on IMPALA-13795:
---------------------------------------
This memory usage tracker tracks the compression buffer, which is used to
compress all webpages served.
This can be used to get an *estimate of the maximum file size* that was
{*}served{*}(i.e. query profile etc).
!web_response_memory_estimate.png|width=1000!
> Support serving webUI metadata with gzip compression
> ----------------------------------------------------
>
> Key: IMPALA-13795
> URL: https://issues.apache.org/jira/browse/IMPALA-13795
> Project: IMPALA
> Issue Type: New Feature
> Reporter: Surya Hebbar
> Assignee: Surya Hebbar
> Priority: Major
> Attachments: 8mbps_throttled_plan_TPCDS14_compression.png,
> 8mbps_throttled_plan_TPCDS14_no_compression.png,
> no_throttle_plan_TPCDS14_compression.png,
> no_throttle_plan_TPCDS14_no_compression.png, web_response_memory_estimate.png
>
>
> For large JSONs and text profiles, Impala can support serving text metadata
> with gzip content encoding for query plan, query timeline and the text
> profile. This results in faster load times, as the browser's native gzip
> decompression is very fast 300-400MB/s.
> This would result in an average compression of 60-70%, resulting in profile
> sizes of 400MB becoming 40MB or less.
> In many cases, the bandwidth hinders faster webUI renderings. This would
> result in significant increases on speed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
