Re: Cassandra - Pig integration

2014-07-31 Thread Kevin Burton
I think you need to send that details file for us to give you more information: /home/hduser/apache-cassandra-2.0.9/examples/pig/pig_1406808480077.log pig stores its runtime exceptions in a main details file that has the guts of the problem. Also, try posting to the pig user list. I'll tell yo

Re: cassandra + pig

2012-10-11 Thread William Oberman
Thanks Jeremy! Maybe figuring out how to do paging in pig would have been easier, but I found the widerow setting first which led me where I am today. I don't mind helping to blaze trails, or contribute back when doing so, but I usually try to follow rather than lead when it comes to tools/softwa

Re: cassandra + pig

2012-10-11 Thread Jeremy Hanna
For our use case, we had a lot of narrow column families and the couple of column families that had wide rows, we did our own paging through them. I don't recall if we did paging in pig or mapreduce but you should be able to do that in both since pig allows you to specify the slice start. On O

Re: cassandra + pig

2012-10-11 Thread William Oberman
If you don't mind me asking, how are you handling the fact that pre-widerow you are only getting a static number of columns per key (default 1024)? Or am I not understanding the "limit" concept? On Thu, Oct 11, 2012 at 11:25 AM, Jeremy Hanna wrote: > The Dachis Group (where I just came from, now

Re: cassandra + pig

2012-10-11 Thread Jeremy Hanna
The Dachis Group (where I just came from, now at DataStax) uses pig with cassandra for a lot of things. However, we weren't using the widerow implementation yet since wide row support is new to 1.1.x and we were on 0.7, then 0.8, then 1.0.x. I think since it's new to 1.1's hadoop support, it s

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Jeremy Hanna
fwiw - https://issues.apache.org/jira/browse/CASSANDRA-2970 thoughts? (please post on the ticket) On Jul 29, 2011, at 7:08 PM, Ryan King wrote: > It'd be great if we had different settings for inter- and intra-DC read > repair. > > -ryan > > On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani wrot

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Ryan King
It'd be great if we had different settings for inter- and intra-DC read repair. -ryan On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani wrote: > Yes it's read repair you can lower the read repair chance to tune this. > > > > On Jul 29, 2011, at 6:31 PM, Aaron Griffith > wrote: > >> I currently hav

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Jake Luciani
Yes it's read repair you can lower the read repair chance to tune this. On Jul 29, 2011, at 6:31 PM, Aaron Griffith wrote: > I currently have a 9 node cassandra cluster setup as follows: > > DC1: Six nodes > DC2: Three nodes > > The tokens alternate between the two datacenters. > > I have

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeremy Hanna
Yes - the HadoopSupport should be updated for the functionality that is added to 0.7. It's still a little in flux. There is an output format and output streaming support on trunk/0.7 beta2. The output format has a java example in the contrib/word_count example code. The output streaming, whi

Re: Cassandra + Pig + PHP

2010-10-06 Thread Aaron Morton
AFAIK you can submit a pig job to the Hadoop job server via the pig command line interface. If you have not done so already have a read of the Hadoop Book it discusses pig as well http://bit.ly/9gGRyH Not sure how you go about monitoring the hadoop job though. There is support for hadoop to o

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeremy Hanna
> PHP: I basicaly need to start pig program from a php script (via thrift or > something..?) Can't you just execute a Pig script with PHP by calling Pig with a PHP exec function call? I'm not sure what you're trying to do with it, but that's one way you could do it. > PIG: there is a LoadFunc

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeff Zhang
Pig do not have thrift interface, But I believe you can create it. And another way I think is create a web service for your pig service, and call the web service in your php. On Wed, Oct 6, 2010 at 4:17 PM, Petr Odut wrote: > Hi, > PHP: I basicaly need to start pig program from a php script (vi

Re: Cassandra + Pig + PHP

2010-10-06 Thread Petr Odut
Hi, PHP: I basicaly need to start pig program from a php script (via thrift or something..?) PIG: there is a LoadFunc that loads data from Cassandra, is there also a StoreFunc? On Tue, Oct 5, 2010 at 9:22 PM, Aaron Morton wrote: > There is an example for pig in contrib/pig and a hadoop example i

Re: Cassandra + Pig + PHP

2010-10-05 Thread Aaron Morton
There is an example for pig in contrib/pig and a hadoop example in contrib/hadoop . What role did you want PHP to fill?AaronOn 06 Oct, 2010,at 06:05 AM, Petr Odut wrote:Is there any example / tutorial combining these technologies?Thanks-- Petr Odut [petr.o...@gmail.com]

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Jonathan Ellis
by 0.7 I meant Cassandra 0.7 On Fri, Sep 24, 2010 at 4:18 PM, Mark wrote: >  I am using Pig v0.7 and Cassandra v0.6.5. The example that comes bundles up > in Cassandra under contrib/pig uses unframed by default. When I use the > default configuration for Cassandra then the Pig contrib works as ex

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Mark
I am using Pig v0.7 and Cassandra v0.6.5. The example that comes bundles up in Cassandra under contrib/pig uses unframed by default. When I use the default configuration for Cassandra then the Pig contrib works as expected. However when I change the configuration to framed then pig just freeze

Re: Cassandra & Pig & Framed Transport

2010-09-24 Thread Jonathan Ellis
I don't think you can (although in 0.7 framed is the default for Pig like everything else). On Fri, Sep 24, 2010 at 2:14 PM, Mark wrote: >  How does one enable framed transport when using the pig loadfunc? > > Thanks > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, t

Re: Cassandra & Pig

2010-09-24 Thread Mark
Thanks Jonathan. I have this part figured out now :) Can you explain to me how I can get this to work with Framed support. It just hangs now and doesn't return anything On 9/24/10 3:39 PM, Jonathan Ellis wrote: pig doesn't have the thrift jar on its classpath On Fri, Sep 24, 2010 at 10:32 A

Re: Cassandra & Pig

2010-09-24 Thread Jonathan Ellis
pig doesn't have the thrift jar on its classpath On Fri, Sep 24, 2010 at 10:32 AM, Mark wrote: >  I am trying to run the Cassandra pig example but I keep receiving... > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to > open iterator for alias rows >    at org.apache.pi

Re: Cassandra & Pig

2010-09-13 Thread Asif Jan
Hi did you register cassandra jars with Pig. This seems like a class loading problem. aj On Sep 10, 2010, at 3:38 AM, Mark wrote: Does anyone know of any good tutorials for using Pig with Cassandra? I am trying do a basic load: rows = LOAD 'cassandra://Foo/Bar' USING CassandraStorage();

Re: Cassandra & Pig

2010-09-09 Thread Jeremy Hanna
Details of basic linkage are in the contrib/pig section of the Cassandra source in the readme. You should be able to run basic queries with just that. On Sep 9, 2010, at 8:38 PM, Mark wrote: > Does anyone know of any good tutorials for using Pig with Cassandra? > > I am trying do a basic load: