Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-02-04 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2634895592 Next week (s): - https://github.com/apache/datafusion/issues/14491 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-02-04 Thread via GitHub
alamb closed issue #14179: Jan 18, 2025: This week(s) in DataFusion URL: https://github.com/apache/datafusion/issues/14179 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-31 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2627859726 @comphead is working to improve the homepage: - https://github.com/apache/datafusion/issues/14389 -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-30 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2625208242 I also started collecting tickets / bugs that need some additional attention - https://github.com/apache/datafusion/issues/14375 -- This is an automated message from the Apach

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-30 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2625203640 I also wrote up lessons from CMU ticket: - https://github.com/apache/datafusion/issues/14373 -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-29 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2622790016 Thanks to some great work from @buraksenn @berkaysynnada and @logan-keede we have completed extracting physical optimizer rules: - https://github.com/apache/datafusion/issues/1

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-28 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2620020603 > Does this mean that some joins and window clauses now get pushed down to the TableProvider? @adriangb no -- I think it means more filters are pushed pased window functio

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-27 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2616932624 Here is really nice PR to add source code span information to DataFusion errors from @eliaperantoni: - https://github.com/apache/datafusion/pull/13664 -- This is an automat

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-26 Thread via GitHub
adriangb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2614529181 > * [@nuno-faria](https://github.com/nuno-faria) extended filter pushdown to cover `PARTITION BY` window clauses [feat(optimizer): Enable filter pushdown on window functions #1

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-25 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2613925385 If anyone else is interested in helping build times, @waynexia is starting to organize a project: - https://github.com/apache/datafusion/issues/14256 -- This is an automated

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-23 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2611192163 This is a pretty neat looking dataframe library built on DataFusion: - https://github.com/databora/elusion -- This is an automated message from the Apache Git Service. To re

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-23 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2610174007 @mertak-synnada has a PR that nicely refactors the data source code but may be a non trivial downstream API change - https://github.com/apache/datafusion/pull/14224 -- This

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-23 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2609473769 This is a neat "zero lake" idea (DataFusion via WASM in browser) https://gh-sparkling-cherry-6975.fly.dev/ https://github.com/user-attachments/assets/a280fa61-fe90-414

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-22 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2608446477 EPIC EPIC work from @logan-keede @berkaysynnada and @buraksenn hacking out the physical-optimizer into its own crate (finally!) - https://github.com/apache/datafusion/pull/1419

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-22 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2607115317 @mbrobbel has a nice proposal to add extension types in arrow-rs (which would potentially help ExtensionTypes in DataFusion). Would apprecaite any feedback: - https://github.

Re: [I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-21 Thread via GitHub
alamb commented on issue #14179: URL: https://github.com/apache/datafusion/issues/14179#issuecomment-2604361327 @2010YOUY01 became a committer: https://lists.apache.org/thread/b7df0bpzyzzcg6ph50swx7jw0b5dks75 🎉 -- This is an automated message from the Apache Git Service. To respond to t

[I] Jan 18, 2025: This week(s) in DataFusion [datafusion]

2025-01-18 Thread via GitHub
alamb opened a new issue, #14179: URL: https://github.com/apache/datafusion/issues/14179 ### Is your feature request related to a problem or challenge? _No response_ ### Describe the solution you'd like _No response_ ### Describe alternatives you've considered