Re: Question: Hive String Concatenation with NULLs - Behavior and Rationale

2025-05-19 Thread Stamatis Zampetakis
Hi Sadegh, If I recall well the behavior of the string concatenation is defined by the SQL standard (ISO/IEC 9075). Section 6.29: General rules 2.b.i: If at least one of S1 and S2 is the null value, then the result of the is the null value. Hive as well as many other DBMS systems strive to rema

Re: upgrade to the latest versions

2025-03-06 Thread Stamatis Zampetakis
Hello, I just wanted to highlight that Hive 3.x line is EOL. It has various known security vulnerabilities, many serious bugs (including wrong results and data corruption), and lacks lots of improvements and major features that are available in Hive 4. Upgrading is the right path forward. Best, S

Re: Re: Blog article 'Performance Tuning for Single-table Queries'

2024-12-30 Thread Stamatis Zampetakis
Hello, The blog post is informative but examines the performance of one single query thus it may not be enough to justify a change in the default configuration. If there are more comprehensive benchmarks that show that changing the default value of hive.optimize.reducededuplication is beneficial f

CVE-2024-23945: Apache Hive and Spark: CookieSigner exposes the correct signature when message verification fails

2024-12-23 Thread Stamatis Zampetakis
Severity: important Affected versions: - Apache Hive 1.2.0 before 4.0.0 - Apache Spark 2.0.0 before 3.0.0 - Apache Spark 3.0.0 before 3.3.4 - Apache Spark 3.4.0 before 3.4.2 - Apache Spark 3.5.0 Description: Signing cookies is an application security feature that adds a digital signature to coo

CVE-2022-41137: Apache Hive: Deserialization of untrusted data when fetching partitions from the Metastore

2024-12-04 Thread Stamatis Zampetakis
Severity: moderate Affected versions: - Apache Hive 4.0.0-alpha-1 before 4.0.0 Description: Apache Hive Metastore (HMS) uses  SerializationUtilities#deserializeObjectWithTypeInformation method when filtering and fetching partitions that is unsafe and can lead to Remote Code Execution (RCE) si

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Stamatis Zampetakis
Hi Andor, The Hive community is not doing separate releases for standalone metastore anymore because it adds overhead to the release process. Since now we never had requests to provide these individual binaries. The functionality is still there so you may be able to construct the standalone metas

[ANNOUNCE] New Committer: Shohei Okumiya

2024-11-12 Thread Stamatis Zampetakis
eeded. Stamatis Zampetakis (on behalf of the Apache Hive PMC) [1] https://cwiki.apache.org/confluence/display/Hive/HowToCommit

Re: Question related to reuse of BytesColumnVector.vector[][].

2024-10-02 Thread Stamatis Zampetakis
Hello, The error looks like a bug and is data/query specific thus I assume reproducible. I would suggest filing a JIRA ticket with as many details as possible (query, DDLs, logs, plans, data) to reproduce the issue. Best, Stamatis On Sun, Sep 29, 2024 at 7:51 AM lisoda wrote: > > Currently, whe

Re: IMPORTANT: Hive date parsing issue, input needed

2024-09-19 Thread Stamatis Zampetakis
Many thanks to Zoltán for starting this thread and driving the discussion forward. I am happy to see that many people chimed in and gave feedback about the suggested changes in HIVE-28483; this is a good indicator of a healthy community. Since there were some comments/questions about the behavior

CVE-2023-35701: Apache Hive: Arbitrary command execution via JDBC driver

2024-05-03 Thread Stamatis Zampetakis
Severity: moderate Affected versions: - Apache Hive 4.0.0-alpha-1 before 4.0.0 Description: Improper Control of Generation of Code ('Code Injection') vulnerability in Apache Hive. The vulnerability affects the Hive JDBC driver component and it can potentially lead to arbitrary code execution

Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Stamatis Zampetakis
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since Apache Hive 3.1.3) and it's probably the biggest release so far in the history of the project. The numbers clearly show that this is a collective effort that wouldn't be possible without a strong community and many volunteers al

Re: [Hive Support] Query about StandardStructObjectInspector converting field names to lowercase

2024-02-01 Thread Stamatis Zampetakis
Hi Chang, The hive-hcatalog-core-1.1.0-cdh5.13.1.jar jar file is not something maintained by Apache. For vendor specific problems you should reach out to the respective support team from where you obtained the product. Apart from that the version that you are using (5.13.1) is quite old. Please r

Re: Contributing doc

2024-01-14 Thread Stamatis Zampetakis
Hi Henri, I gave you the necessary permissions to the wiki. Please check and if you encounter any issues let us know. Best, Stamatus On Fri, Jan 12, 2024 at 10:56 AM Henri Biestro wrote: > > > My Apache Id is hen...@apache.org. > Cheers > > On 2024/01/12 09:52:20 Henri Biestro wrote: > > Hello;

Re: [ANNOUNCE] New committer: Butao Zhang (zhangbutao)

2023-11-21 Thread Stamatis Zampetakis
Congratulations Butao, well deserved! Very glad to see another Iceberg expert joining the team. Best, Stamatis On Tue, Nov 21, 2023, 4:47 PM Butao Zhang wrote: > Thank you to the Hive community for this honor. I will continue to > contribute to the community with my efforts. > Thanks all! > >

[ANNOUNCE] New committer: Sourabh Badhya

2023-10-03 Thread Stamatis Zampetakis
Apache Hive's Project Management Committee (PMC) has invited Sourabh Badhya to become a committer, and we are pleased to announce that he has accepted. Sourabh has been doing some great work for the project. He has landed important fixes in critical parts of Hive and made significant contributions

[ANNOUNCE] Apache Hive 4.0.0-beta-1 Released

2023-08-14 Thread Stamatis Zampetakis
The Apache Hive team is proud to announce the release of Apache Hive version 4.0.0-beta-1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enabl

Re: Request write access to the Hive wiki

2023-05-12 Thread Stamatis Zampetakis
Hi Venu, I just gave you permissions to view and add pages, attachments, and comments. Please test and let me know if it works for you. Please do not modify the wiki before the changes get committed to master and coordinate with the reviewer to go over your modifications to the wiki. Thanks for c

Re: Kill the Pig 🐷

2023-04-28 Thread Stamatis Zampetakis
I checked the Pig repo and I see some recent activity. Rohini is actively leading the effort towards a new Pig release. Given that there is proven interest to maintain and contribute to this module I would prefer to keep it for the time being unless there are major issues that I am not aware of. B

Re: [DISCUSS] Jira Public Signup Disabled

2023-03-06 Thread Stamatis Zampetakis
#HowToContribute-JIRA [2] https://issues.apache.org/jira/browse/INFRA-24306 On Fri, Mar 3, 2023 at 9:31 AM Stamatis Zampetakis wrote: > Thanks for bringing this up Ayush. > > Yes we should update the wiki to reflect the new process; if nobody does > it in the following days I wil

Re: [DISCUSS] Jira Public Signup Disabled

2023-03-03 Thread Stamatis Zampetakis
ontribute-JIRA > > On Thu, 17 Nov 2022 at 16:43, Stamatis Zampetakis > wrote: > >> The jira-reque...@hive.apache.org has been created and I added relevant >> instructions on how to request a JIRA account in the wiki [1]. Feel free to >> improve as you see fit! >>

Re: [ANNOUNCE] New committer for Apache Hive: Laszlo Vegh

2023-02-08 Thread Stamatis Zampetakis
Congratulations Laszlo! ACID and compactions are a complex beast and the slightest problem there can have a huge impact in the system. Many thanks for all your work in this area that makes the life of the rest of us much easier. Best, Stamatis On Wed, Feb 8, 2023 at 9:46 AM Akshat m wrote: > C

Re: unsubscribe

2023-02-01 Thread Stamatis Zampetakis
Hi Darren, In order to unsubscribe from the list you need to send an email here: user-unsubscr...@hive.apache.org The same holds to other mailing lists as well [1]. Best, Stamatis [1] https://hive.apache.org/community/mailinglists/ On Wed, Feb 1, 2023 at 11:34 AM Darren Beckstand wrote: > uns

Re: [ANNOUNCE] New PMC Member: Krisztian Kasa

2023-01-31 Thread Stamatis Zampetakis
Krisztian's impact on the project has been immense, particularly in areas such as rewriting, view maintenance, iceberg integration, sub-query processing, and top-k pushdown, to name a few. His contributions cannot be fully captured by the numbers and go beyond what they can indicate. Keep up the a

Re: [ANNOUNCE] New PMC Member: Laszlo Bodor

2023-01-30 Thread Stamatis Zampetakis
While the numbers give some insight, they do not tell the complete story of how much Laszlo has helped drive the project forward. Congrats Laszlo and thanks for everything that you have done for the project. Best, Stamatis On Sun, Jan 29, 2023 at 11:05 PM Sai Hemanth Gantasala < saihema...@cloud

Re: [ANNOUNCE] New PMC Member: Stamatis Zampetakis

2023-01-16 Thread Stamatis Zampetakis
ks > > > > > > On Sat, 14 Jan 2023 at 00:03, Naveen Gangam > > wrote: > > > > > >> Hello Hive Community, > > >> Apache Hive PMC is pleased to announce that Stamatis Zampetakis has > > >> accepted the Apache Hive PMC's invitation to be

Re: Proposal: Revamp Apache Hive website.

2023-01-09 Thread Stamatis Zampetakis
tent update with the >framework change. In this case, we can make the other changes incrementally >at a later stage. > > > Thanks! > Simhadri G > > On Wed, Oct 5, 2022 at 3:41 PM Stamatis Zampetakis > wrote: > >> Thanks for staying on top of this Simhadri. &

Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena

2022-12-19 Thread Stamatis Zampetakis
Congrats Ayush! Very well deserved! Thanks for all the hard work that you are putting for the project and always being there when people ask for help. Best, Stamatis On Tue, Dec 20, 2022 at 7:51 AM Sankar Hariappan via user < user@hive.apache.org> wrote: > Congrats Ayush! > > > > Thanks, > > Sa

Re: Roadmap information

2022-11-29 Thread Stamatis Zampetakis
Hi Cristian, The 4.0.0-alpha-2 was released on 16 November 2022. The next scheduled release is most likely the stable 4.0.0 [1]. The usual release cadence is 4 to 6 months so the expected date should be somewhere between March and June 2023. A not so recent discussion about the content of 4.0.0 ca

Re: Issue for discussion (slight change in behavior): HIVE-26683

2022-11-22 Thread Stamatis Zampetakis
Hello, Regarding the inconsistency you describe in the window function, indeed it seems to be a bug. However, I would double-check with the SQL standard to be sure there is no intentional deviation and/or test the query in different DBMS. As far as it concerns the behavior of the aggregate functi

Re: [DISCUSS] Jira Public Signup Disabled

2022-11-17 Thread Stamatis Zampetakis
, 2022 at 9:59 PM Stamatis Zampetakis wrote: > Logged https://issues.apache.org/jira/browse/INFRA-23905 for the creation > of the new mailing list. > > On Tue, Nov 15, 2022 at 9:57 PM Abhay Chennagiri > wrote: > >> +1, Thank you, Stamatis. >> >> On Tue, Nov 15, 202

Re: [ANNOUNCE] Apache Hive 4.0.0-alpha-2 Released

2022-11-17 Thread Stamatis Zampetakis
Many thanks to everyone who made this release happen and especially Denys for leading this effort! Best, Stamatis On Wed, Nov 16, 2022 at 5:25 PM Denys Kuzmenko wrote: > The Apache Hive team is proud to announce the release of Apache Hive > version 4.0.0-alpha-2 > > The Apache Hive (TM) data wa

Re: [DISCUSS] Jira Public Signup Disabled

2022-11-15 Thread Stamatis Zampetakis
gt; >> -Pravin >> >> On Tue, Nov 15, 2022 at 5:57 PM Stamatis Zampetakis >> wrote: >> >>> Hi everyone, >>> >>> Due to the large amount of spam account creation the ASF INFRA team has >>> disabled the JIRA account creation [1]. &

[DISCUSS] Jira Public Signup Disabled

2022-11-15 Thread Stamatis Zampetakis
Hi everyone, Due to the large amount of spam account creation the ASF INFRA team has disabled the JIRA account creation [1]. >From the 11th of November, contributors who wish to have a JIRA account (to create, assign, watch, etc issues) will need to request an account through an ASF PMC. Other p

Re: Consider using bi-directional links in JIRA

2022-10-21 Thread Stamatis Zampetakis
inging this up. > > On Fri, Oct 14, 2022 at 5:06 AM Stamatis Zampetakis > wrote: > >> Hi all, >> >> This is a small tip/reminder for everyone using JIRA. >> >> It is very common and convenient to refer to other tickets by adding the >> HIVE-X pa

Consider using bi-directional links in JIRA

2022-10-14 Thread Stamatis Zampetakis
Hi all, This is a small tip/reminder for everyone using JIRA. It is very common and convenient to refer to other tickets by adding the HIVE-X pattern in summary, description, and comments. The pattern allows someone to navigate quickly to an older JIRA from the current one but not the other

Re: Proposal: Revamp Apache Hive website.

2022-10-05 Thread Stamatis Zampetakis
suggestions regarding the design and content of the website over there, for >>> anything else we can always come back here if we are blocked on something, >>> or if something more needs to be done in this context. >>> >>> -Ayush >>> >>> On 21-S

Re: Proposal: Revamp Apache Hive website.

2022-09-21 Thread Stamatis Zampetakis
. >> >> I like the look and feel of the new website, and I agree with Stamatis >> that having the website sources in the Hive repo, and automatically >> publishing the site upon commits would be very beneficial. >> >> Best regards, >> Alessandro >> &g

Re: Proposal: Revamp Apache Hive website.

2022-09-15 Thread Stamatis Zampetakis
Hi all, It's great to see some effort in improving the website. The POC from Simhadri looks really cool; I didn't check the content but I love the look and feel. Now regarding the current process for modifying and updating the website there is some info in this relatively recent thread [1]. Movi

Re: hive standalone can't find MaterializationsCacheCleanerTask

2022-09-07 Thread Stamatis Zampetakis
The task was removed by the following commit. Check HIVE-20006 and related jiras for more details. commit 1b5903b035c3b3ac02efbddf36d5438cda97cc91 Author: Jesus Camacho Rodriguez Date: Tue Jun 26 11:37:27 2018 -0700 HIVE-20006: Make materializations invalidation cache work with multiple ac

Re: HiveServer2 slowly increaseing background CPU usage until restated

2022-09-07 Thread Stamatis Zampetakis
Hi Laurence, It's hard to say just by seeing the graphs. Moreover Hive 2.3.1 is a quite old version so there are many things that may go wrong. I would suggest checking the logs and taking jstacks overtime and/or use a profiler (such as async-profiler[1]) to see what HS2 is actually doing while C

Re: [DISCUSS] Hive EOL question

2022-06-20 Thread Stamatis Zampetakis
Hi Guangming, There was a recent discussion about EOL Hive releases [1] but it was not conclusive. Feel free to reopen that thread if you have some thoughts on the subject. Best, Stamatis [1] https://lists.apache.org/thread/sxcrcf4v9j630tl9domp0bn4m33bdq0s On Sun, Jun 19, 2022 at 11:20 AM Guan

Re: [DISCUSS] Remove Druid dependency from Hive

2022-06-17 Thread Stamatis Zampetakis
Hi Simhadri, Thanks for starting this discussion Simhadri. I am cc'ing the user list as well so that we have a better idea if there are any active users. Personally I am not that familiar with the Druid module. * Is it currently broken? * Do we have active tests? * Does it need significant effor

Re: [DISCUSS] End of life for Hive 1.x, 2.x, 3.x

2022-05-10 Thread Stamatis Zampetakis
sically agree on everything you >> wrote. >> >> I just wanted to add that this kind of proposal might sound harsh, >> because in many contexts upgrading is a complex process, but it's in >> nobody's interest to keep release branches that are missing important

[DISCUSS] End of life for Hive 1.x, 2.x, 3.x

2022-05-06 Thread Stamatis Zampetakis
Hi all, The current master has many critical bug fixes as well as important performance improvements that are not backported (and most likely never will) to the maintenance branches. Backporting changes from master usually requires adapting the code and tests in questions making it a non-trivial

[DISCUSS] End of life for Hive 1.x, 2.x, 3.x

2022-05-06 Thread Stamatis Zampetakis
Hi all, The current master has many critical bug fixes as well as important performance improvements that are not backported (and most likely never will) to the maintenance branches. Backporting changes from master usually requires adapting the code and tests in questions making it a non-trivial

Re: Is the web broken?

2022-03-15 Thread Stamatis Zampetakis
; >> Hi, > >> > >> Could we keep a redirect page at the old place, or a CNAME resolution? > >> > >> Best, > >> Adrian > >> > >> -- > >> 发件人:Stamatis Zampetakis &g

Re: Hive 3 and Java 11 issue

2022-03-14 Thread Stamatis Zampetakis
I confirm what Pau said, the only supported JDK is 8. Upgrade to JDK 11 has started [1] but was paused due to various problems. I don't know if anyone is actively working on fixing this at the moment. Best, Stamatis [1] https://issues.apache.org/jira/browse/HIVE-22415 On Thu, Mar 10, 2022 at 10:

Re: Is the web broken?

2022-03-10 Thread Stamatis Zampetakis
Hi, I am not sure if I am missing something but I get the impression [1] that the site from now on will be served from here: https://apache.github.io/hive-site/ Best, Stamatis [1] https://issues.apache.org/jira/browse/INFRA-20776 On Thu, Mar 10, 2022 at 10:21 AM Ming wrote: > I have the same

Re: Release plans (relative to Log4j fixes/upgrades)

2022-03-02 Thread Stamatis Zampetakis
Hi Brent, There are plans [1] to release 4.0.0-alpha-1 and 3.1.3 but no exact dates yet. I don't know anything about 2.3.X. Best, Stamatis [1] https://lists.apache.org/thread/xyvttddcjhk9ffg242wn1wkggsghpc5c On Tue, Mar 1, 2022 at 9:36 PM Brent wrote: > Hi everyone, > > I've been trying to go

Re: [DISCUSS] Properties for scheduling compactions on specific queues

2022-02-07 Thread Stamatis Zampetakis
HIVE-25595 is currently not > compatible with the new config as it was developed for the old > compactor.mapred... property: > > https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/CompactorUtil.java#L31 > This also needs to be handled

[DISCUSS] Properties for scheduling compactions on specific queues

2022-01-31 Thread Stamatis Zampetakis
Hi all, This email is an attempt to converge on which Hive/Tez/MR properties someone should use in order to schedule a compaction on specific queues. For those who are not familiar with how queues are used the YARN capacity scheduler documentation [1] gives the general idea. Using specific queues

Re: Time to Remove Hive-on-Spark

2022-01-28 Thread Stamatis Zampetakis
Hi team, Almost one year has passed since the last exchange in this discussion and if I am not wrong there has been no effort to revive Hive-on-Spark. To be more precise, I don't think I have seen any Spark related JIRA for quite some time now and although I don't want to rush into conclusions, th

Re: I can't mvn clean package

2021-10-18 Thread Stamatis Zampetakis
Hi igyu, >From some paths appearing in the stack trace it seems you are running on Windows. I don't know of anybody developing Hive on Windows so I am not surprised the build fails. Build should run fine on Linux and Mac environments. I just tried running the package goal (see below) and it finis

Re: [EXTERNAL] Re: Move Date and Timestamp parsing from ResolverStyle.LENIENT to ResolverStyle.STRICT

2021-07-21 Thread Stamatis Zampetakis
: > > > Hello, > > > > Is anyone able to try out a few different vendor RDBMS to see how they > > handle invalid dates, or provide links to documentation, both for invalid > > formatting and things like mm-dd-yyy 12-40-2021? > > > > Thanks. > >

Re: [EXTERNAL] Re: Move Date and Timestamp parsing from ResolverStyle.LENIENT to ResolverStyle.STRICT

2021-07-13 Thread Stamatis Zampetakis
p. >> In the interest of backward compatibility, can we make all these changes >> under a flag which can be enabled by default? >> >> >> Thanks, >> Sankar >> -Original Message----- >> From: David >> Sent: 10 July 2021 07:35 >&

Re: Failed to compile apache hive tag - rel/release-2.3.8

2021-06-15 Thread Stamatis Zampetakis
Hi Apurwa, I think it is related to HIVE-25173 [1]. The pentaho-aggdesigner-algorithm artifacts were present only in the spring repo and not in maven central. I think the spring repo was retired so it is not possible to find the artifacts any more. Best, Stamatis [1] https://issues.apache.org/ji

Re: Running Hive 3.1.2 embedded in JVM for testing

2021-02-19 Thread Stamatis Zampetakis
Hi James, I am doing something similar with the difference that everything runs on docker [1]. I am using Hive 3.1 (HDP though) but things work fine at least with in-memory derby. javax.jdo.option.ConnectionURL jdbc:derby:memory:metastore;create=true Best, Stamatis [1]

Re: Hive SQL extension

2020-10-26 Thread Stamatis Zampetakis
an input and can rewrite it to a new SQL command >>- I would write simplified parser which tries to be as simple as >>possible for the specific command >>- Based on the parsing I would return the same command / throw an >> exception / rewrite the command &

Re: Hive SQL extension

2020-10-22 Thread Stamatis Zampetakis
Hi Peter, I am nowhere near being an expert but just wanted to share my thoughts. If I understand correctly you would like some syntactic sugar in Hive to support partitioning as per Iceberg. I cannot tell if that's really useful or not but from my point of view it doesn't seem a very good idea t

Request write access to the Hive wiki for zabetak

2020-06-05 Thread Stamatis Zampetakis
Hello, Can somebody please give me write access to the Hive wiki? My username is zabetak Best, Stamatis