[GitHub] [hudi] p-powell commented on issue #5351: Hudi Write Performance

2022-04-21 Thread GitBox
p-powell commented on issue #5351: URL: https://github.com/apache/hudi/issues/5351#issuecomment-1105389992 @codope I built from master and takes 492 secs. Still seems slow. We have an internal file(2.6m rows ~300col) takes 16min to load into a new table(one partition). If we dump t

[GitHub] [hudi] p-powell commented on issue #5351: Hudi Write Performance

2022-04-19 Thread GitBox
p-powell commented on issue #5351: URL: https://github.com/apache/hudi/issues/5351#issuecomment-1102828050 @codope Thanks for the response. Strange I get 333s when I call the parquet writer directly using the exact snippet provided. Should hudi write and parquet write be similar in performa