Re: Mixing Puts and Deletes in a single RPC

2012-07-10 Thread Michael Segel
;> From: Ted Yu >> To: user@hbase.apache.org >> Sent: Thursday, July 5, 2012 11:28 AM >> Subject: Re: Mixing Puts and Deletes in a single RPC >> >> Take a look at HBASE-3584: Allow atomic put/delete in one call >> It is in 0.94, meaning it is not even in cdh4 &g

Re: Mixing Puts and Deletes in a single RPC

2012-07-09 Thread Jonathan Hsieh
ut I has assumed CDH4 would include > HBase 0.94. > > -- Lars > > > > > From: Ted Yu > To: user@hbase.apache.org > Sent: Thursday, July 5, 2012 11:28 AM > Subject: Re: Mixing Puts and Deletes in a single RPC > > Take a look at HBASE

Re: Mixing Puts and Deletes in a single RPC

2012-07-06 Thread Michael Segel
Well then, I guess if you really want to save space... Take your DAO... add a method that takes the fields and writes them to JSON string and converts it to a byte Array. (AVRO?) If your field is null, you just don't add it to the output string. That would take care of all of your overhead is

Re: Mixing Puts and Deletes in a single RPC

2012-07-06 Thread Keith Wyss
Hi Michael, Thank you for your reply. I will answer your questions one by one. ---I have to ask... why are you deleting anything from your columns? In the event that there is a null value in a source system, we have to reflect that somehow and assume that there could be a value in HBase and th

Re: Mixing Puts and Deletes in a single RPC

2012-07-06 Thread Michael Segel
I was going to post this yesterday, but real work got in the way... I have to ask... why are you deleting anything from your columns? The reason I ask is that you're sync'ing an object from an RDBMS to HBase. While HBase allows fields that contain NULL not to exist, your RDBMS doesn't. Your c

Re: Mixing Puts and Deletes in a single RPC

2012-07-06 Thread Ferdy Galema
> > -- Lars > > > > > From: Ted Yu > To: user@hbase.apache.org > Sent: Thursday, July 5, 2012 11:28 AM > Subject: Re: Mixing Puts and Deletes in a single RPC > > Take a look at HBASE-3584: Allow atomic put/delete in one call > It is in 0.94, me

Re: Mixing Puts and Deletes in a single RPC

2012-07-05 Thread lars hofhansl
I'll let the Cloudera folks speak, but I has assumed CDH4 would include HBase 0.94. -- Lars From: Ted Yu To: user@hbase.apache.org Sent: Thursday, July 5, 2012 11:28 AM Subject: Re: Mixing Puts and Deletes in a single RPC Take a look at HBASE-3584:

Re: Mixing Puts and Deletes in a single RPC

2012-07-05 Thread Keith Wyss
Thanks for the info Ted, Anyone tackled this problem before 0.94? Keith On 7/5/12 2:28 PM, "Ted Yu" wrote: >Take a look at HBASE-3584: Allow atomic put/delete in one call >It is in 0.94, meaning it is not even in cdh4 > >Cheers > >On Thu, Jul 5, 2012 at 11:19 AM, Keith Wyss >wrote: > >> Hi, >

Re: Mixing Puts and Deletes in a single RPC

2012-07-05 Thread Ted Yu
Take a look at HBASE-3584: Allow atomic put/delete in one call It is in 0.94, meaning it is not even in cdh4 Cheers On Thu, Jul 5, 2012 at 11:19 AM, Keith Wyss wrote: > Hi, > > My organization has been doing something zany to simulate atomic row > operations is HBase. > > We have a converter-ob

Mixing Puts and Deletes in a single RPC

2012-07-05 Thread Keith Wyss
Hi, My organization has been doing something zany to simulate atomic row operations is HBase. We have a converter-object model for the writables that are populated in an HBase table, and one of the governing assumptions is that if you are dealing with an Object record, you read all the columns