Re: Question about replacing files and about Publishing Jars

2019-02-26 Thread Arvind Pruthi
. Arvind From: Arvind Pruthi Date: Tuesday, February 26, 2019 at 11:00 AM To: "rb...@netflix.com" , Jacques Nadeau Cc: Iceberg Dev List Subject: Re: Question about replacing files and about Publishing Jars Well the question/use case has to deal with legacy with Hive Meta Store. S

Re: Question about replacing files and about Publishing Jars

2019-02-26 Thread Arvind Pruthi
his forum experienced similar pain? Arvind From: Ryan Blue Reply-To: "rb...@netflix.com" Date: Tuesday, February 26, 2019 at 9:54 AM To: Jacques Nadeau Cc: Iceberg Dev List , Arvind Pruthi Subject: Re: Question about replacing files and about Publishing Jars You could always

Question about replacing files and about Publishing Jars

2019-02-25 Thread Arvind Pruthi
Hello There, Q1. What happens In case a file is deleted and a new file is to be added with the same name, but the snapshot in which the delete was registered is still around? There is no ambiguity from listing the manifest entries point of view. However, there will be ambiguity at the Hdfs leve

Where are the jars getting published

2019-02-14 Thread Arvind Pruthi
Hello There, I was looking for iceberg jars in MavenCentral but didn’t find them. Can someone please point me to the location and the current version number? Thanks Arvind

ManifestEntry class is not public

2019-01-25 Thread Arvind Pruthi
Hi Ryan I was going over some code in iceberg and noticed that the Manifest Entry class is not public. Because of this any code outside the package cannot iterate over a ManifestFile. Any thoughts on why this is the case and is there a recommended way of iterating over entries in ManifestFile o

Re: Iceberg and Hive

2019-01-09 Thread Arvind Pruthi
t? Did you have to re-write portions of Presto to make it happen or only a new Presto connector was enough? Thanks Arvind From: Ryan Blue Reply-To: "rb...@netflix.com" Date: Tuesday, January 8, 2019 at 3:13 PM To: Vladi Feigin Cc: Arvind Pruthi , "dev@iceberg.apache.org"

Re: Iceberg and Hive

2019-01-07 Thread Arvind Pruthi
Vladi, We have similarities to what you describe. While I agree that what Owen mentioned about an implementation of Hive's Rawstore API will be really useful, I don't believe it fully answers Vladi's question. I think the main concern here is smooth migration of existing clients to iceberg tab

Question about com.netflix.iceberg.BaseTransaction class

2018-12-27 Thread Arvind Pruthi
Hi Ryan, Currently com.netflix.iceberg.BaseTransaction is not marked as a public class. From what I know this is the only class that implements “Transaction”. Is that intentional? Because of this it is not accessible outside the package com.netflix.iceberg. Thanks Arvind