Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-08-01 Thread via GitHub
Standing-Man commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-3143818186 I'm interested in this issue. May I give it a try? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-02-04 Thread via GitHub
Spaarsh commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2634981559 @HectorPascual I have added an optional seed argument and have also added support for Binary input. -- This is an automated message from the Apache Git Service. To respond to

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-29 Thread via GitHub
Spaarsh commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2623464462 Thanks @HectorPascual! I'm opening PR from here on for transperancy's sake! -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-29 Thread via GitHub
HectorPascual commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2621513736 Hi @Spaarsh, The hashes match to the python module : ![Image](https://github.com/user-attachments/assets/d8f1f9e9-7a33-4e84-ad71-b07769a962cd) In r

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-27 Thread via GitHub
HectorPascual commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2616893055 Looks good, I can try tomorrow hashing the same inputs with the Python xxhash module and double check the output of the results. @Spaarsh -- This is an automated messag

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-27 Thread via GitHub
Spaarsh commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2616461779 @alamb @HectorPascual these are the final query outputs. I have added support for individual values of the types ```Utf8```, ```Int32```, ```Int64```, ```UInt32``` and ```UInt64

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-26 Thread via GitHub
HectorPascual commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2614607006 > [@HectorPascual](https://github.com/HectorPascual) is this the output that you expect? > > ``` > > SELECT > xxhash32(column1) AS xxhash32_result > FR

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-26 Thread via GitHub
Spaarsh commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2614584812 @HectorPascual is this the output that you expect? ```xxhash32 > SELECT xxhash32(column1) AS xxhash32_result FROM ( SELECT UNNEST(ARRAY[1, 2, 3, 4, 5])

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-23 Thread via GitHub
Spaarsh commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2609856700 > Perhaps consider adding a non cryptographic module and add wyhash as well (here some of the crates I've used for similar usecase but in polars: https://github.com/ion-elgreco/

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-23 Thread via GitHub
ion-elgreco commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2609606375 Perhaps consider adding a non cryptographic module and add wyhash as well (here some of the crates I've used for similar usecase but in polars: https://github.com/ion-elgrec

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-22 Thread via GitHub
alamb commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2608460635 @Spaarsh sounds like a good plan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-08 Thread via GitHub
HectorPascual commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2578288000 Hi, thanks for the reply. That is true, although, my concern comes from this other issue raised in delta-rs project (link below), since I need to use this hash opera

Re: [I] Implement xxhash algorithms as part of the expression API [datafusion]

2025-01-08 Thread via GitHub
alamb commented on issue #14044: URL: https://github.com/apache/datafusion/issues/14044#issuecomment-2578127820 You could also implement this as a user defined function perhaps -- This is an automated message from the Apache Git Service. To respond to the message, please log on to