can you tar.gz the filter/index/data files for this sstable and attach it to a ticket so we can debug?
if you can't make the data public you can send it to me off list and I can have a look. On Wed, Oct 6, 2010 at 11:37 AM, Narendra Sharma <narendra.sha...@gmail.com> wrote: > Has any one used sstable2json on 0.6.5 and noticed the issue I described in > my email below? This doesn't look like data corruption issue as sstablekeys > shows the keys. > > Thanks, > Naren > > > On Tue, Oct 5, 2010 at 8:09 PM, Narendra Sharma <narendra.sha...@gmail.com> > wrote: >> >> 0.6.5 >> >> -Naren >> >> On Tue, Oct 5, 2010 at 6:56 PM, Jonathan Ellis <jbel...@gmail.com> wrote: >>> >>> Version? >>> >>> On Tue, Oct 5, 2010 at 7:28 PM, Narendra Sharma >>> <narendra.sha...@gmail.com> wrote: >>> > Hi, >>> > >>> > I am using sstable2json to extract row data for debugging some >>> > application >>> > issue. I first ran sstablekeys to find the list of keys in the sstable. >>> > Then >>> > I use the key to fetch row from sstable. The sstable is from Lucandra >>> > deployment. I get following. >>> > >>> > -bash-3.2$ ./sstablekeys Documents-37-Data.db | more >>> > jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec >>> > jhwKcHZx���120fc562-cf9f-4204-963d-0ed0d8cd2d09 >>> > jhwKcHZx���93d78bce-7713-4ff9-bc83-b02663a1a55c >>> > jhwKcHZx���e6f6f5ef-a09f-4e84-9727-56867e81be00 >>> > jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76 >>> > jqCF6zxM���917f66a6-7a95-4789-82ca-aaa511f6b56e >>> > >>> > //This returns correct data >>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k >>> > jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec >>> > { >>> > "jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec": [["5f3a46514944", >>> > >>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380", >>> > 1296272041356884, false], ["5f3a504152454e54", >>> > >>> > "65373466316138632d313934652d343939652d383835362d64316536343939613862636180", >>> > 1296272041369884, false], ["5f3a55554944", >>> > >>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380", >>> > 1296272041342884, false], ["efbfbf4d455441efbfbf", >>> > >>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000677040000000a74002d5f3a55554944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002d5f3a46514944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002f5f3a504152454e54efbfbf65373466316138632d313934652d343939652d383835362d643165363439396138626361740032313a76706172656e746964efbfbf65373466316138632d313934652d343939652d383835362d64316536343939613862636174000e333a6e616d65efbfbf656d61696c740016333a7072696d61727954797065efbfbf31313a61707078", >>> > 1296272041458884, false]] >>> > } >>> > >>> > //Look at the key in the json output. It doesn't match the key passed >>> > as >>> > argument >>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k >>> > jhwKcHZx���120fc562-cf9f-4204-963d-0ed0d8cd2d09 >>> > { >>> > "jhwKcHZx���0df5a54a-61d8-440e-94a9-b46061ba2fec": [["5f3a46514944", >>> > >>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380", >>> > 1296272041356884, false], ["5f3a504152454e54", >>> > >>> > "65373466316138632d313934652d343939652d383835362d64316536343939613862636180", >>> > 1296272041369884, false], ["5f3a55554944", >>> > >>> > "30646635613534612d363164382d343430652d393461392d62343630363162613266656380", >>> > 1296272041342884, false], ["efbfbf4d455441efbfbf", >>> > >>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000677040000000a74002d5f3a55554944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002d5f3a46514944efbfbf30646635613534612d363164382d343430652d393461392d62343630363162613266656374002f5f3a504152454e54efbfbf65373466316138632d313934652d343939652d383835362d643165363439396138626361740032313a76706172656e746964efbfbf65373466316138632d313934652d343939652d383835362d64316536343939613862636174000e333a6e616d65efbfbf656d61696c740016333a7072696d61727954797065efbfbf31313a61707078", >>> > 1296272041458884, false]] >>> > } >>> > -bash-3.2$ >>> > >>> > //This returns correct data >>> > -bash-3.2$ ./sstable2json Documents-38-Data.db -k >>> > jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76 >>> > { >>> > "jqCF6zxM���04f2f4da-724d-40f1-95bf-4799b97ade76": >>> > [["31313a6d73732e626c6f622e73697a65", "3733333780", 1296278215537884, >>> > false], ["31313a6d73732e6d73672e3173742e7365656e2e73656373", "3080", >>> > 1296278215526884, false], ["31313a6d73732e6d73672e61727674696d65", >>> > "3132383632363630373180", 1296278215627884, false], >>> > ["31313a6d73732e6d73672e626f756e6365", "66616c736580", >>> > 1296278215653884, >>> > false], ["31313a6d73732e6d73672e64656c2e6e6472", "66616c736580", >>> > 1296278215543884, false], ["31313a6d73732e6d73672e6578702e73656373", >>> > "3080", >>> > 1296278215549884, false], ["31313a6d73732e6d73672e666c616773", "3080", >>> > 1296278215679884, false], ["31313a6d73732e6d73672e6964", >>> > >>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680", >>> > 1296278215673884, false], ["31313a6d73732e6d73672e6b6579776f726473", >>> > "80", >>> > 1296278215520884, false], ["31313a6d73732e6d73672e6c6173745f616363", >>> > "3080", >>> > 1296278215569884, false], >>> > ["31313a6d73732e6d73672e6d756c7469706c652e6d736773", "46c2900ec3a780", >>> > 1296278215691884, false], ["31313a6d73732e6d73672e7072696f72", "80", >>> > 1296278215697884, false], ["31313a6d73732e6d73672e70726976617465", >>> > "66616c736580", 1296278215592884, false], >>> > ["31313a6d73732e6d73672e73697a65", >>> > "3636383180", 1296278215532884, false], >>> > ["31313a6d73732e6d73672e74696d65317374616363", "3080", >>> > 1296278215647884, >>> > false], ["31313a6d73732e6d73672e74797065", "80", 1296278215685884, >>> > false], >>> > ["31313a6d73732e6d73672e756964", "3130303480", 1296278215563884, >>> > false], >>> > ["31313a6d73732e6d73672e756e72656164", "7472756580", 1296278215659884, >>> > false], ["31313a6d73732e766572", "3080", 1296278215633884, false], >>> > ["5f3a46514944", >>> > >>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680", >>> > 1296278215500884, false], ["5f3a504152454e54", >>> > >>> > "62646638666262622d323265392d343830302d623533612d35373032333838303436616680", >>> > 1296278215514884, false], ["5f3a55554944", >>> > >>> > "30346632663464612d373234642d343066312d393562662d34373939623937616465373680", >>> > 1296278215486884, false], ["efbfbf4d455441efbfbf", >>> > >>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000a77040000000a74002d5f3a55554944efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373674002d5f3a46514944efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373674002f5f3a504152454e54efbfbf62646638666262622d323265392d343830302d623533612d35373032333838303436616674001531313a6d73732e6d73672e756964efbfbf31303034740032313a76706172656e746964efbfbf36333131386266362d643334302d343837392d383837642d66356531393731336635653574001e333a6d6978696e5479706573efbfbf353a7265666572656e636561626c65740035313a76616e636573746f72736964efbfbf39323961306162612d383237372d343433312d626136342d383833643933623631613335740035313a76616e636573746f72736964efbfbf64326133356631312d383833612d343064312d626632362d666335613434663439373865740017333a7072696d61727954797065efbfbf31313a6974656d74003431313a6d73732e6d73672e6964efbfbf30346632663464612d373234642d343066312d393562662d34373939623937616465373678", >>> > 1296278215785884, false]] >>> > } >>> > >>> > //XXXXXX is not a valid key in my sstable >>> > -bash-3.2$ ./sstable2json >>> > /u3/cassandra/data/ScratIndex/Documents-38-Data.db >>> > -k XXXXXX >>> > { >>> > "jgKp4iw0���c6643d3f-fbe3-43a2-99a4-7a347f6a6da0": >>> > [["31313a6d73732e626c6f622e73697a65", "3331323380", 1256305183229367, >>> > false], ["31313a6d73732e6d73672e3173742e7365656e2e73656373", "3080", >>> > 1256305183224367, false], ["31313a6d73732e6d73672e61727674696d65", >>> > "3132383632373730353580", 1256305183308367, false], >>> > ["31313a6d73732e6d73672e626f756e6365", "66616c736580", >>> > 1256305183326367, >>> > false], ["31313a6d73732e6d73672e64656c2e6e6472", "66616c736580", >>> > 1256305183240367, false], ["31313a6d73732e6d73672e6578702e73656373", >>> > "3080", >>> > 1256305183245367, false], ["31313a6d73732e6d73672e666c616773", "3180", >>> > 1256305183337367, false], ["31313a6d73732e6d73672e6964", >>> > >>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080", >>> > 1256305183350367, false], ["31313a6d73732e6d73672e6b6579776f726473", >>> > "80", >>> > 1256305183219367, false], ["31313a6d73732e6d73672e6c6173745f616363", >>> > "3080", >>> > 1256305183262367, false], >>> > ["31313a6d73732e6d73672e6d756c7469706c652e6d736773", "4680", >>> > 1256305183362367, false], ["31313a6d73732e6d73672e7072696f72", "80", >>> > 1256305183367367, false], ["31313a6d73732e6d73672e70726976617465", >>> > "66616c736580", 1256305183274367, false], >>> > ["31313a6d73732e6d73672e73697a65", >>> > "3235343380", 1256305183235367, false], >>> > ["31313a6d73732e6d73672e74696d65317374616363", "3080", >>> > 1256305183321367, >>> > false], ["31313a6d73732e6d73672e74797065", "80", 1256305183356367, >>> > false], >>> > ["31313a6d73732e6d73672e756964", "3130303780", 1256305183257367, >>> > false], >>> > ["31313a6d73732e6d73672e756e72656164", "7472756580", 1256305183331367, >>> > false], ["31313a6d73732e766572", "3080", 1256305183302367, false], >>> > ["5f3a46514944", >>> > >>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080", >>> > 1256305183202367, false], ["5f3a504152454e54", >>> > >>> > "30656365383930332d313162652d343934362d396136342d62663230323537313336643180", >>> > 1256305183214367, false], ["5f3a55554944", >>> > >>> > "63363634336433662d666265332d343361322d393961342d37613334376636613664613080", >>> > 1256305183191367, false], ["efbfbf4d455441efbfbf", >>> > >>> > "aced0005737200136a6176612e7574696c2e41727261794c6973747881d21d99c7619d03000149000473697a6578700000000a77040000000a74002d5f3a55554944efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613074002d5f3a46514944efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613074002f5f3a504152454e54efbfbf30656365383930332d313162652d343934362d396136342d62663230323537313336643174001531313a6d73732e6d73672e756964efbfbf31303037740032313a76706172656e746964efbfbf64633766656164642d663634652d346165362d613763352d36343637396238373331313874001e333a6d6978696e5479706573efbfbf353a7265666572656e636561626c65740035313a76616e636573746f72736964efbfbf62353334393064312d333665352d343539632d623839632d383862323635323161363463740035313a76616e636573746f72736964efbfbf65616232323639642d353935372d346130312d623666392d666162656230376339623433740017333a7072696d61727954797065efbfbf31313a6974656d74003431313a6d73732e6d73672e6964efbfbf63363634336433662d666265332d343361322d393961342d37613334376636613664613078", >>> > 1256305183396367, false]] >>> > } >>> > -bash-3.2$ >>> > >>> > What is wrong here? Is this a bug in sstable2json? >>> > >>> > Thanks, >>> > Naren >>> > >>> >>> >>> >>> -- >>> Jonathan Ellis >>> Project Chair, Apache Cassandra >>> co-founder of Riptano, the source for professional Cassandra support >>> http://riptano.com >> > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com