Re: [I] Investigate performance of decimal math / aggregation [datafusion-comet]

Sat, 20 Jul 2024 06:04:04 -0700 


andygrove commented on issue #670:
URL: 
https://github.com/apache/datafusion-comet/issues/670#issuecomment-2241146571

   > 33 iterations of sf=1
   > 
   > ### Pure scan without doing sum(decimals)
   > ![Screenshot 2024-07-19 at 11 57 10 
PM](https://private-user-images.githubusercontent.com/129050/350671310-e04c72dc-02ca-41a9-968e-c108a68b24df.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0ODA4NjIsIm5iZiI6MTcyMTQ4MDU2MiwicGF0aCI6Ii8xMjkwNTAvMzUwNjcxMzEwLWUwNGM3MmRjLTAyY2EtNDFhOS05NjhlLWMxMDhhNjhiMjRkZi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQxMzAyNDJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0yZTQ5MThmN2UxNmE1YzMzZGQ5MzcwMzhlMGE4MWIwOWJmZmZiMTQ5ZGU3ZTBhMGJmMmNiMTFiNzMwNzhlMDVlJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.1a5mJ379yWY8oiQX9bsIdFQPlVn2QYcRytbskDIp-XY)
   > 
   > ### Scan with doing Spark sum(decimals)
   > ![Screenshot 2024-07-19 at 11 57 10 
PM](https://private-user-images.githubusercontent.com/129050/350671325-50280fd7-0bb8-4200-9d6c-603107c1c17c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0ODA4NjIsIm5iZiI6MTcyMTQ4MDU2MiwicGF0aCI6Ii8xMjkwNTAvMzUwNjcxMzI1LTUwMjgwZmQ3LTBiYjgtNDIwMC05ZDZjLTYwMzEwN2MxYzE3Yy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQxMzAyNDJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0wZTk3NDIzOGE3ZGMyYzc1ZWE2NDViOTcwODkwN2ZhMjdiZjBjYjFlN2RkMDFjMTM4MDNhY2VmYjBmYTMzNDVjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.e9NlTy4Em8zh7H5G8M4afeZT9yvbpmuApZ1IIM6VGns)
   > 
   > So somehow once Sum is applied, Comet scan slows down...
   
   I think these two screen shots are identical?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to