> Silly question -- but does hive/pig hadoop etc work with cassandra > 1.1.8? Or only with 1.2? all versions.
> We are using astyanax library, which seems > to fail horribly on 1.2, How does it fail ? If you think you have a bug post it at https://github.com/Netflix/astyanax Cheers ----------------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/01/2013, at 7:48 AM, James Lyons <james.ly...@gmail.com> wrote: > Silly question -- but does hive/pig hadoop etc work with cassandra > 1.1.8? Or only with 1.2? We are using astyanax library, which seems > to fail horribly on 1.2, so we're still on 1.1.8. But we're just > starting out with this and i'm still debating between cassandra and > hbase. So I just want to know if there is a limitation here or not, > as I have no idea when 1.2 support will exist in astyanax. > > That said, are there other java (scala) libraries that people use to > connect to cassandra that support 1.2? > > -James- > > On Thu, Jan 17, 2013 at 8:30 AM, <cscetbon....@orange.com> wrote: >> Ok, I understand that I need to manage both cassandra and hadoop components >> and that pig will use hadoop components to launch its tasks which will use >> Cassandra as the Storage engine. >> >> Thanks >> -- >> Cyril SCETBON >> >> On Jan 17, 2013, at 4:03 PM, James Schappet <jschap...@gmail.com> wrote: >> >> This really depends on how you design your Hadoop Cluster. The testing I >> have done, had Hadoop and Cassandra Nodes collocated on the same hosts. >> Remember that Pig code runs inside of your hadoop cluster, and connects to >> Cassandra as the Database engine. >> >> >> I have not done any testing with Hive, so someone else will have to answer >> that question. >> >> >> From: <cscetbon....@orange.com> >> Reply-To: <user@cassandra.apache.org> >> Date: Thursday, January 17, 2013 8:58 AM >> To: "user@cassandra.apache.org" <user@cassandra.apache.org> >> Subject: Re: Pig / Map Reduce on Cassandra >> >> Jimmy, >> >> I understand that CFS can replace HDFS for those who use Hadoop. I just want >> to use pig and hive on cassandra. I know that pig samples are provided and >> work now with cassandra natively (they are part of the core). However, does >> it mean that the process will be spread over nodes with >> number_of_mapper=number_of_nodes or something like that ? >> Can Hive connect to Cassandra 1.2 easily too ? >> >> -- >> Cyril Scetbon >> >> On Jan 17, 2013, at 2:42 PM, James Schappet <jschap...@gmail.com> wrote: >> >> CFS is Cassandra File System: >> http://www.datastax.com/dev/blog/cassandra-file-system-design >> >> >> But you don't need CFS to connect from PIG to Cassandra. The latest >> versions of Cassandra Source ship with examples of connecting from pig to >> cassandra. >> >> >> apache-cassandra-1.2.0-src/examples/pig -- >> http://www.apache.org/dyn/closer.cgi?path=/cassandra/1.2.0/apache-cassandra-1.2.0-src.tar.gz >> >> --Jimmy >> >> >> From: <cscetbon....@orange.com> >> Reply-To: <user@cassandra.apache.org> >> Date: Thursday, January 17, 2013 6:35 AM >> To: "user@cassandra.apache.org" <user@cassandra.apache.org> >> Subject: Re: Pig / Map Reduce on Cassandra >> >> what do you mean ? it's not needed by Pig or Hive to access Cassandra data. >> >> Regards >> >> On Jan 16, 2013, at 11:14 PM, Brandon Williams <dri...@gmail.com> wrote: >> >> You won't get CFS, >> but it's not a hard requirement, either. >> >> >> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations >> confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu >> ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages >> electroniques etant susceptibles d'alteration, >> France Telecom - Orange decline toute responsabilite si ce message a ete >> altere, deforme ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged >> information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and >> delete this message and its attachments. >> As emails may be altered, France Telecom - Orange is not liable for messages >> that have been modified, changed or falsified. >> Thank you. >> >> >> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations >> confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu >> ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages >> electroniques etant susceptibles d'alteration, >> France Telecom - Orange decline toute responsabilite si ce message a ete >> altere, deforme ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged >> information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and >> delete this message and its attachments. >> As emails may be altered, France Telecom - Orange is not liable for messages >> that have been modified, changed or falsified. >> Thank you. >> >> >> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations >> confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu >> ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages >> electroniques etant susceptibles d'alteration, >> France Telecom - Orange decline toute responsabilite si ce message a ete >> altere, deforme ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged >> information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and >> delete this message and its attachments. >> As emails may be altered, France Telecom - Orange is not liable for messages >> that have been modified, changed or falsified. >> Thank you.
