Hi,
Hive has 2 JvmPauseMonitor classes
https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/JvmPauseMonitor.java
https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/metrics/JvmPauseMonito
Eugene Koifman created HIVE-21266:
-
Summary: Issue with single delta file
Key: HIVE-21266
URL: https://issues.apache.org/jira/browse/HIVE-21266
Project: Hive
Issue Type: Sub-task
Affects
Eugene Koifman created HIVE-21226:
-
Summary: Exclude read-only transactions from ValidTxnList
Key: HIVE-21226
URL: https://issues.apache.org/jira/browse/HIVE-21226
Project: Hive
Issue Type
Eugene Koifman created HIVE-21177:
-
Summary: Optimize AcidUtils.getLogicalLength()
Key: HIVE-21177
URL: https://issues.apache.org/jira/browse/HIVE-21177
Project: Hive
Issue Type: Bug
tor/TestCrudCompactorOnTez.java
Lines 195 (patched)
<https://reviews.apache.org/r/69367/#comment298163>
I still don't understand what this comment is conveying. This is just a
normal read, so I would assume TezSplitGrouper is not running in compactor mode
- Eugene Koifman
On J
Eugene Koifman created HIVE-21172:
-
Summary: DEFAULT keyword handling in MERGE UPDATE clause issues
Key: HIVE-21172
URL: https://issues.apache.org/jira/browse/HIVE-21172
Project: Hive
Issue
Eugene Koifman created HIVE-21161:
-
Summary: Remove checks that disallow updating bucketing and
partitioning columns
Key: HIVE-21161
URL: https://issues.apache.org/jira/browse/HIVE-21161
Project
Eugene Koifman created HIVE-21160:
-
Summary: Rewrite Update statement as Multi-insert and do Update
split early
Key: HIVE-21160
URL: https://issues.apache.org/jira/browse/HIVE-21160
Project: Hive
Eugene Koifman created HIVE-21159:
-
Summary: Modify Merge statement logic to perform Update split early
Key: HIVE-21159
URL: https://issues.apache.org/jira/browse/HIVE-21159
Project: Hive
Eugene Koifman created HIVE-21158:
-
Summary: Perform update split early
Key: HIVE-21158
URL: https://issues.apache.org/jira/browse/HIVE-21158
Project: Hive
Issue Type: Improvement
Eugene Koifman created HIVE-21154:
-
Summary: Investigate using object IDs in Acid HMS schema instead
of names
Key: HIVE-21154
URL: https://issues.apache.org/jira/browse/HIVE-21154
Project: Hive
l/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFValidateAcidSortOrder.java
Lines 74 (patched)
<https://reviews.apache.org/r/69367/#comment297916>
nit: make class and fields final to make sure compareTo is inlined?
q
Eugene Koifman created HIVE-21146:
-
Summary: Enforce TransactionBatch size=1 for blob stores
Key: HIVE-21146
URL: https://issues.apache.org/jira/browse/HIVE-21146
Project: Hive
Issue Type
n-javabean/org/apache/hadoop/hive/metastore/api/CompactionInfoStruct.java
Lines 53 (patched)
<https://reviews.apache.org/r/69704/#comment297739>
why is this needed? when is the writeId list ever get passed over the wire?
- Eugene Koifman
On Jan. 16, 2019, 10:08
re/txn/TxnHandler.java
Line 1228 (original), 1231 (patched)
<https://reviews.apache.org/r/69704/#comment297737>
exclude 'p' type here
- Eugene Koifman
On Jan. 16, 2019, 10:08 a.m., Jaume Marhuenda wrote:
>
> ---
Eugene Koifman created HIVE-21114:
-
Summary: Create read-only transactions
Key: HIVE-21114
URL: https://issues.apache.org/jira/browse/HIVE-21114
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-21106:
-
Summary: Potential NEP in
VectorizedOrcAcidRowBatchReader.ColumnizedDeleteEventRegistry
Key: HIVE-21106
URL: https://issues.apache.org/jira/browse/HIVE-21106
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69462/#review211519
---
Ship it!
Ship It!
- Eugene Koifman
On Dec. 21, 2018, 4:30
t;https://reviews.apache.org/r/69462/#comment296733>
this seems unused anywhere
- Eugene Koifman
On Dec. 20, 2018, 5:02 p.m., Jaume Marhuenda wrote:
>
> ---
> This is an automatically generated e-mail. To reply, v
Eugene Koifman created HIVE-21058:
-
Summary: Make Compactor run in a transaction (Umbrella)
Key: HIVE-21058
URL: https://issues.apache.org/jira/browse/HIVE-21058
Project: Hive
Issue Type
che.org/r/69462/#comment296388>
why is this added here? The CompactionHeartbeater should do this
- Eugene Koifman
On Dec. 17, 2018, 9:59 a.m., Jaume Marhuenda wrote:
>
> ---
> This is an automatically generated e-mail. To
ionInfo.java
Lines 172 (patched)
<https://reviews.apache.org/r/69462/#comment296385>
could you add a comment at the top next to the member variables to indicate
that these methods should be modfied to be in sync
- Eugene Koifman
On Dec. 17, 2018, 9:59 a.m., Jau
nt296191>
I would put both of these in CompactionInfo. If someone adds fields to
CompactionInfo, they are unlikely to ever find these methods and so some info
will be lost in the marshalling back and forth.
Alternatively, could CompactionInfo be a
Eugene Koifman created HIVE-21036:
-
Summary: extend OpenTxnRequest with transaction type
Key: HIVE-21036
URL: https://issues.apache.org/jira/browse/HIVE-21036
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-21025:
-
Summary: LLAP IO fails on read if partition column is included in
the table and the query has a predicate on the partition column
Key: HIVE-21025
URL: https://issues.apache.org
Eugene Koifman created HIVE-21020:
-
Summary: log which table/partition is being processed by a txn in
Worker
Key: HIVE-21020
URL: https://issues.apache.org/jira/browse/HIVE-21020
Project: Hive
Eugene Koifman created HIVE-20960:
-
Summary: remove CompactorMR.createCompactorMarker()
Key: HIVE-20960
URL: https://issues.apache.org/jira/browse/HIVE-20960
Project: Hive
Issue Type: Bug
comment295489>
I think comparison should include 'bucketProperty' since we sort on
'bucketProperty' not just bucketId.
In particular, if you have > 1 statement per txn, we expect that rows from
2nd stmt follow those fro
Eugene Koifman created HIVE-20948:
-
Summary: Eliminate file rename in compactor
Key: HIVE-20948
URL: https://issues.apache.org/jira/browse/HIVE-20948
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-20943:
-
Summary: Handle Compactor transaction abort properly
Key: HIVE-20943
URL: https://issues.apache.org/jira/browse/HIVE-20943
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-20942:
-
Summary: Worker should heartbeat its own txn
Key: HIVE-20942
URL: https://issues.apache.org/jira/browse/HIVE-20942
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-20941:
-
Summary: Compactor produces a delete_delta_x_y even if there are
no input delete events
Key: HIVE-20941
URL: https://issues.apache.org/jira/browse/HIVE-20941
Lines 565 (patched)
<https://reviews.apache.org/r/69367/#comment295304>
there should be something in AcidUtils to parse original bucket file name
- Eugene Koifman
On Nov. 15, 2018, 4:59 p.m., Vaibhav Gumashta wrote:
>
> -
Eugene Koifman created HIVE-20901:
-
Summary: running compactor when there is nothing to do produces
duplicate data
Key: HIVE-20901
URL: https://issues.apache.org/jira/browse/HIVE-20901
Project: Hive
Eugene Koifman created HIVE-20885:
-
Summary: ql.txn.compactor.TestCompactor runs most tests 2 times
Key: HIVE-20885
URL: https://issues.apache.org/jira/browse/HIVE-20885
Project: Hive
Issue
Eugene Koifman created HIVE-20874:
-
Summary: Add ability to to run high priority compaction
Key: HIVE-20874
URL: https://issues.apache.org/jira/browse/HIVE-20874
Project: Hive
Issue Type
Eugene Koifman created HIVE-20862:
-
Summary: QueryId no longer shows up in the logs
Key: HIVE-20862
URL: https://issues.apache.org/jira/browse/HIVE-20862
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-20863:
-
Summary: remove dead code
Key: HIVE-20863
URL: https://issues.apache.org/jira/browse/HIVE-20863
Project: Hive
Issue Type: Improvement
Components
Eugene Koifman created HIVE-20859:
-
Summary: clean up invocation of Worker/Cleaner/Initiator in test
code
Key: HIVE-20859
URL: https://issues.apache.org/jira/browse/HIVE-20859
Project: Hive
Eugene Koifman created HIVE-20856:
-
Summary: ValidReaderWriteIdList() is not valid in most places
Key: HIVE-20856
URL: https://issues.apache.org/jira/browse/HIVE-20856
Project: Hive
Issue
Eugene Koifman created HIVE-20823:
-
Summary: Make Compactor run in a transaction
Key: HIVE-20823
URL: https://issues.apache.org/jira/browse/HIVE-20823
Project: Hive
Issue Type: Improvement
Eugene Koifman created HIVE-20769:
-
Summary: TxnHandler.checkLock() will re-acquire the same lock
Key: HIVE-20769
URL: https://issues.apache.org/jira/browse/HIVE-20769
Project: Hive
Issue
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68805/#review209558
---
Ship it!
Ship It!
- Eugene Koifman
On Sept. 21, 2018, 3:51
Eugene Koifman created HIVE-20738:
-
Summary: Enable Delete Event filtering in
VectorizedOrcAcidRowBatchReader
Key: HIVE-20738
URL: https://issues.apache.org/jira/browse/HIVE-20738
Project: Hive
Eugene Koifman created HIVE-20730:
-
Summary: Do delete event filtering even if hive.acid.index is not
there
Key: HIVE-20730
URL: https://issues.apache.org/jira/browse/HIVE-20730
Project: Hive
Eugene Koifman created HIVE-20723:
-
Summary: Allow per table specification of compaction yarn queue
Key: HIVE-20723
URL: https://issues.apache.org/jira/browse/HIVE-20723
Project: Hive
Issue
y more
More generally, what is the point of other changes in this class?
- Eugene Koifman
On Sept. 21, 2018, 3:51 p.m., Jaume Marhuenda wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.
Eugene Koifman created HIVE-20699:
-
Summary: Query based compactor for full CRUD Acid tables
Key: HIVE-20699
URL: https://issues.apache.org/jira/browse/HIVE-20699
Project: Hive
Issue Type
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68834/#review209243
---
Ship it!
Ship It!
- Eugene Koifman
On Sept. 24, 2018, 8:04
s.apache.org/r/68834/#comment293365>
it would make sense to check in the catch that you are getting the expected
error msg
- Eugene Koifman
On Sept. 24, 2018, 8:04 p.m., Jaume Marhuenda wrote:
>
> ---
> This is an automati
Eugene Koifman created HIVE-20655:
-
Summary: Optimize arrayCopy in LlapRecordReader
Key: HIVE-20655
URL: https://issues.apache.org/jira/browse/HIVE-20655
Project: Hive
Issue Type
Eugene Koifman created HIVE-20654:
-
Summary: remove masking of "Masked writeid"
Key: HIVE-20654
URL: https://issues.apache.org/jira/browse/HIVE-20654
Project: Hive
Issue Type: I
Eugene Koifman created HIVE-20640:
-
Summary: Upgrade Hive to use ORC 1.5.3
Key: HIVE-20640
URL: https://issues.apache.org/jira/browse/HIVE-20640
Project: Hive
Issue Type: Improvement
Eugene Koifman created HIVE-20635:
-
Summary: VectorizedOrcAcidRowBatchReader doesn't filter delete
events for original files
Key: HIVE-20635
URL: https://issues.apache.org/jira/browse/HIVE-
s.java
Lines 135 (patched)
<https://reviews.apache.org/r/68805/#comment293222>
should probably check that you got the right exception not just "any
exception", i.e. check the message.
- Eugene Koifman
On Sept. 21, 2018, 3:51 p.m., Jaume Marhuenda wrote:
>
>
Eugene Koifman created HIVE-20604:
-
Summary: Minor compaction disables ORC column stats
Key: HIVE-20604
URL: https://issues.apache.org/jira/browse/HIVE-20604
Project: Hive
Issue Type
Eugene Koifman created HIVE-20581:
-
Summary: Eliminate rename() from full CRUD transactional tables
Key: HIVE-20581
URL: https://issues.apache.org/jira/browse/HIVE-20581
Project: Hive
Issue
Eugene Koifman created HIVE-20580:
-
Summary: OrcInputFormat.isOriginal() should not rely on
hive.acid.key.index
Key: HIVE-20580
URL: https://issues.apache.org/jira/browse/HIVE-20580
Project: Hive
Eugene Koifman created HIVE-20579:
-
Summary: VectorizedOrcAcidRowBatchReader.checkBucketId() should
run for unbucketed tables
Key: HIVE-20579
URL: https://issues.apache.org/jira/browse/HIVE-20579
Eugene Koifman created HIVE-20553:
-
Summary: more acid stats tests
Key: HIVE-20553
URL: https://issues.apache.org/jira/browse/HIVE-20553
Project: Hive
Issue Type: Improvement
Eugene Koifman created HIVE-20460:
-
Summary: AcidUtils.Directory.getAbortedDirectories() may be missed
for full CRUD tables
Key: HIVE-20460
URL: https://issues.apache.org/jira/browse/HIVE-20460
Eugene Koifman created HIVE-20459:
-
Summary: add ThriftHiveMetastore.get_open_txns(long txnid)
Key: HIVE-20459
URL: https://issues.apache.org/jira/browse/HIVE-20459
Project: Hive
Issue Type
Eugene Koifman created HIVE-20458:
-
Summary: hive-schema-3.1.0.postgres.sql - some tables are not
quoted
Key: HIVE-20458
URL: https://issues.apache.org/jira/browse/HIVE-20458
Project: Hive
Eugene Koifman created HIVE-20454:
-
Summary: CLONE - extend inheritPerms to ACID in Hive 1.X
Key: HIVE-20454
URL: https://issues.apache.org/jira/browse/HIVE-20454
Project: Hive
Issue Type
Eugene Koifman created HIVE-20436:
-
Summary: Lock Manager scalability - linear
Key: HIVE-20436
URL: https://issues.apache.org/jira/browse/HIVE-20436
Project: Hive
Issue Type: Improvement
Eugene Koifman created HIVE-20435:
-
Summary: Failed Dynamic Partition Insert into insert only table
may looks transaction metadata
Key: HIVE-20435
URL: https://issues.apache.org/jira/browse/HIVE-20435
Eugene Koifman created HIVE-20410:
-
Summary: aborted Insert Overwrite on transactional table causes
"Not enough history available for..." error
Key: HIVE-20410
URL: https://issues.apache.org/jira/b
Eugene Koifman created HIVE-20392:
-
Summary: make compaction atomic on S3
Key: HIVE-20392
URL: https://issues.apache.org/jira/browse/HIVE-20392
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-20369:
-
Summary: TestPreUpgradeTool not run by ptest
Key: HIVE-20369
URL: https://issues.apache.org/jira/browse/HIVE-20369
Project: Hive
Issue Type: Bug
/UpdateDeleteSemanticAnalyzer.java
Lines 972 (patched)
<https://reviews.apache.org/r/68281/#comment290236>
what if some table is named "select_table"
- Eugene Koifman
On Aug. 9, 2018, 12:19 p.m., Deepak Jaiswal wrote:
>
> ---
>
- to see
clearly the difference in the plan.
- Eugene Koifman
On Aug. 9, 2018, 10:44 a.m., Deepak Jaiswal wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
>
Eugene Koifman created HIVE-20327:
-
Summary: Compactor should gracefully handle 0 length files and
invalid orc files
Key: HIVE-20327
URL: https://issues.apache.org/jira/browse/HIVE-20327
Project
Eugene Koifman created HIVE-20324:
-
Summary: change hive.compactor.max.num.delta default to 50
Key: HIVE-20324
URL: https://issues.apache.org/jira/browse/HIVE-20324
Project: Hive
Issue Type
Eugene Koifman created HIVE-20313:
-
Summary: consider making ROW__ID a 1st class object
Key: HIVE-20313
URL: https://issues.apache.org/jira/browse/HIVE-20313
Project: Hive
Issue Type
Eugene Koifman created HIVE-20305:
-
Summary: LlapRecordReader uses OrcInputFormat.getRootColumn(false)
Key: HIVE-20305
URL: https://issues.apache.org/jira/browse/HIVE-20305
Project: Hive
Eugene Koifman created HIVE-20234:
-
Summary: Add an option to disable stats computation from Compactor
Key: HIVE-20234
URL: https://issues.apache.org/jira/browse/HIVE-20234
Project: Hive
Eugene Koifman created HIVE-20218:
-
Summary: make sure Statement.executeUpdate() returns number of
rows affected
Key: HIVE-20218
URL: https://issues.apache.org/jira/browse/HIVE-20218
Project: Hive
cid_no_buckets.q
Lines 37 (patched)
<https://reviews.apache.org/r/67969/#comment289149>
I don't understand this comment. There was update/insert done (line 25)
since last analyze at line 22-23. Shouldn't analyze at 34-35 change stats?
Or are they auto updated after each st
Eugene Koifman created HIVE-20137:
-
Summary: Truncate for Transactional tables should use base_x
Key: HIVE-20137
URL: https://issues.apache.org/jira/browse/HIVE-20137
Project: Hive
Issue
Eugene Koifman created HIVE-20119:
-
Summary: permissions on files in transactional tables
Key: HIVE-20119
URL: https://issues.apache.org/jira/browse/HIVE-20119
Project: Hive
Issue Type: Bug
lid transaction id
ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUpdaterThread.java
Line 412 (original), 440 (patched)
<https://reviews.apache.org/r/67712/#comment288367>
0 is not a valid txn id
- Eugene Koifman
On June 22, 2018, 5:29 p.m.
Eugene Koifman created HIVE-19965:
-
Summary: Make HiveEndPoint use IMetaStoreClient.add_partition
Key: HIVE-19965
URL: https://issues.apache.org/jira/browse/HIVE-19965
Project: Hive
Issue
Eugene Koifman created HIVE-19962:
-
Summary: remove hive.txn.operational.properties
Key: HIVE-19962
URL: https://issues.apache.org/jira/browse/HIVE-19962
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-19961:
-
Summary: Add partition if exists on transactional CRUD table
acquires X lock
Key: HIVE-19961
URL: https://issues.apache.org/jira/browse/HIVE-19961
Project: Hive
Eugene Koifman created HIVE-19917:
-
Summary: Import of full CRUD transactional table fails if table is
not in default database
Key: HIVE-19917
URL: https://issues.apache.org/jira/browse/HIVE-19917
Eugene Koifman created HIVE-19908:
-
Summary: Block Insert Overwrite with Union All on full CRUD ACID
tables using HIVE_UNION_SUBDIR_
Key: HIVE-19908
URL: https://issues.apache.org/jira/browse/HIVE-19908
Eugene Koifman created HIVE-19800:
-
Summary: Handle rename files post HIVE-19751
Key: HIVE-19800
URL: https://issues.apache.org/jira/browse/HIVE-19800
Project: Hive
Issue Type: Sub-task
Eugene Koifman created HIVE-19751:
-
Summary: create submodule of hive-upgrade-acid for preUpgrade and
postUpgrade
Key: HIVE-19751
URL: https://issues.apache.org/jira/browse/HIVE-19751
Project: Hive
Eugene Koifman created HIVE-19750:
-
Summary: Initialize NEXT_WRITE_ID. NWI_NEXT on converting an
existing table to full acid
Key: HIVE-19750
URL: https://issues.apache.org/jira/browse/HIVE-19750
Eugene Koifman created HIVE-19749:
-
Summary: Acid V1 to V2 upgrade
Key: HIVE-19749
URL: https://issues.apache.org/jira/browse/HIVE-19749
Project: Hive
Issue Type: Bug
Components
Eugene Koifman created HIVE-19735:
-
Summary: Transactional table: rename partition
Key: HIVE-19735
URL: https://issues.apache.org/jira/browse/HIVE-19735
Project: Hive
Issue Type: Bug
Eugene Koifman created HIVE-19714:
-
Summary: TransactionalValidationListene.conformToAcid() only
checks table level StorageDescriptor
Key: HIVE-19714
URL: https://issues.apache.org/jira/browse/HIVE-19714
Eugene Koifman created HIVE-19606:
-
Summary: Straggler thread in HS2 for rename directory operation
stuck in loop causing performance issue and cluster slowdown
Key: HIVE-19606
URL: https://issues.apache.org/jira
Eugene Koifman created HIVE-19599:
-
Summary: Release Notes : Highlighting backwards incompatible
changes
Key: HIVE-19599
URL: https://issues.apache.org/jira/browse/HIVE-19599
Project: Hive
Eugene Koifman created HIVE-19598:
-
Summary: Acid V1 to V2 upgrade
Key: HIVE-19598
URL: https://issues.apache.org/jira/browse/HIVE-19598
Project: Hive
Issue Type: Bug
Components
Eugene Koifman created HIVE-19569:
-
Summary: alter table db1.t1 rename db2.t2 generates
MetaStoreEventListener.onDropTable()
Key: HIVE-19569
URL: https://issues.apache.org/jira/browse/HIVE-19569
Eugene Koifman created HIVE-19387:
-
Summary: CLONE - Truncate table for Acid tables
Key: HIVE-19387
URL: https://issues.apache.org/jira/browse/HIVE-19387
Project: Hive
Issue Type: New
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66645/#review202231
---
Ship it!
Ship It!
- Eugene Koifman
On May 1, 2018, 2:53 p.m
ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcRecordUpdater.java
Lines 471 (patched)
<https://reviews.apache.org/r/66645/#comment283945>
if you have only 1 txn in a batch, why call flush at all? (this flush() is
called when commit() is called) . Won't closign the file do the right thing?
- E
Eugene Koifman created HIVE-19377:
-
Summary: TestTxnExIm - did not produce a TEST-*.xml file (likely
timed out) (batchId=286)
Key: HIVE-19377
URL: https://issues.apache.org/jira/browse/HIVE-19377
1 - 100 of 1862 matches
Mail list logo
