You're right Vegard! Thanks 2013/1/22 Vegard Berget <[email protected]>
> Hi, > > No, the keys are hashed to be distributed, at least if you use > RandomPartitioner. > From http://www.datastax.com/docs/1.0/cluster_architecture/partitioning: > "To distribute the data evenly across the number of nodes, a hashing > algorithm creates an MD5 hash value of the row key" > > .vegard, > > > > > > ----- Original Message ----- > From: > [email protected] > > To: > <[email protected]> > Cc: > > Sent: > Tue, 22 Jan 2013 09:40:19 -0200 > > Subject: > Re: How to store large columns? > > > But, this keys have the same prefix. So, they will be distributed on the > same node. Right? > > 2013/1/21 Jason Brown <[email protected]> > >> The reason for multiple keys (and, by extension, multiple columns) is >> to better distribute the write/read load across the cluster as keys will >> (hopefully) be distributed on different nodes. This helps to avoid hot >> spots. >> >> Hope this helps, >> >> -Jason Brown >> Netflix >> ------------------------------ >> *From:* Sávio Teles [[email protected]<[email protected]> >> ] >> *Sent:* Monday, January 21, 2013 9:51 AM >> *To:* [email protected] >> >> *Subject:* Re: How to store large columns? >> >> Astyanax split large objects into multiple keys. Is it a good idea? It >> is better to split into multiple columns? >> >> Thanks >> >> 2013/1/21 Sávio Teles <[email protected]> >> >>> >>> Thanks Keith Wright. >>> >>> >>> 2013/1/21 Keith Wright <[email protected]> >>> >>>> This may be helpful: >>>> https://github.com/Netflix/astyanax/wiki/Chunked-Object-Store >>>> >>>> From: Vegard Berget <[email protected]> >>>> Reply-To: "[email protected]" <[email protected]>, >>>> Vegard Berget <[email protected]> >>>> Date: Monday, January 21, 2013 8:35 AM >>>> To: "[email protected]" <[email protected]> >>>> Subject: Re: How to store large columns? >>>> >>>> >>>> >>>> Hi, >>>> >>>> You could split it into multiple columns on the client side: >>>> RowKeyData: Part1: [1mb], Part2: [1mb], Part3: [1mb]...PartN[1mb] >>>> >>>> Now you can use multiple get() in parallell to get the files back and >>>> then join them back to one file. >>>> >>>> I _think_ maybe the new CQL3-protocol does not have the same >>>> limitation, but I have never tried large columns there, so someone with >>>> more experience than me will have to confirm this. >>>> >>>> .vegard, >>>> >>>> >>>> ----- Original Message ----- >>>> From: >>>> [email protected] >>>> >>>> To: >>>> <[email protected]> >>>> Cc: >>>> >>>> Sent: >>>> Mon, 21 Jan 2013 11:16:40 -0200 >>>> Subject: >>>> How to store large columns? >>>> >>>> >>>> We wish to store a column in a row with size larger >>>> thanthrift_framed_transport_size_in_mb >>>> . But, Thrift has a maximum frame size configured by >>>> thrift_framed_transport_size_in_mb in cassandra.yaml. >>>> so, How to store columns with size larger than >>>> thrift_framed_transport_size_in_mb? Increasing this value does not >>>> solve the problem, since we have columns with varying sizes. >>>> >>>> -- >>>> Atenciosamente, >>>> Sávio S. Teles de Oliveira >>>> voice: +55 62 9136 6996 >>>> http://br.linkedin.com/in/savioteles >>>> Mestrando em Ciências da Computação - UFG >>>> Arquiteto de Software >>>> Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG >>>> >>>> >>> >>> >>> -- >>> Atenciosamente, >>> Sávio S. Teles de Oliveira >>> voice: +55 62 9136 6996 >>> http://br.linkedin.com/in/savioteles >>> Mestrando em Ciências da Computação - UFG >>> Arquiteto de Software >>> Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG >>> >> >> >> >> -- >> Atenciosamente, >> Sávio S. Teles de Oliveira >> voice: +55 62 9136 6996 >> http://br.linkedin.com/in/savioteles >> Mestrando em Ciências da Computação - UFG >> Arquiteto de Software >> Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG >> > > > > -- > Atenciosamente, > Sávio S. Teles de Oliveira > voice: +55 62 9136 6996 > http://br.linkedin.com/in/savioteles > Mestrando em Ciências da Computação - UFG > Arquiteto de Software > Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG > > -- Atenciosamente, Sávio S. Teles de Oliveira voice: +55 62 9136 6996 http://br.linkedin.com/in/savioteles Mestrando em Ciências da Computação - UFG Arquiteto de Software Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG
