wgtmac opened a new pull request, #3126:
URL: https://github.com/apache/parquet-java/pull/3126

   ### Rationale for this change
   
   There is no way to print size stats from the parquet-cli yet.
   
   ### What changes are included in this PR?
   
   Add a new CLI command for SizeStatistics.
   
   ### Are these changes tested?
   
   Added a test case.
   
   File with both histogram and unencoded bytes.
   ```
   Row group 0
   
--------------------------------------------------------------------------------
   column         unencoded bytes rep level histogram                      def 
level histogram
   [int32_field]  -               [10]                                     [10]
   [int64_field]  -               [10]                                     [10]
   [float_field]  -               [10]                                     [10]
   [double_field] -               [10]                                     [10]
   [binary_field] 46 B            [10]                                     [10]
   [flba_field]   -               [10]                                     [10]
   [date_field]   -               [10]                                     [10]
   ```
   
   File with only unencoded bytes.
   ```
   Row group 0
   
--------------------------------------------------------------------------------
   column     unencoded bytes rep level histogram                      def 
level histogram
   [id]       -               -                                        -
   [type]     66 B            -                                        -
   [sha1_git] -               -                                        -
   ```
   
   File with no size stats.
   ```
   Row group 0
   
--------------------------------------------------------------------------------
   column           unencoded bytes rep level histogram                      
def level histogram
   [processed_dttm] -               -                                        -
   [float8_1]       -               -                                        -
   ```
   
   ### Are there any user-facing changes?
   
   Yes, updated README for the new command.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@parquet.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@parquet.apache.org
For additional commands, e-mail: issues-h...@parquet.apache.org

Reply via email to