I know that 2i requires leveldb, but I'm not using my custom index, I'm
using $bucket, I thought $bucket index is some kind of special internal
index?
On 11 March 2016 at 18:28, Russell Brown <russell.br...@me.com> wrote:
> You can’t…can you? I mean, 2i requires level. It requires ordered keys.
> Which explains your problem, but you should have failed a lot earlier.
>
> On 11 Mar 2016, at 16:26, Oleksiy Krivoshey <oleks...@gmail.com> wrote:
>
> > Hi Magnus,
> >
> > The bucket type has the following properties:
> >
> >
> '{"props":{"backend":"fs_chunks","allow_mult":"false","r":1,"notfound_ok":"false","basic_quorum":"false"}}'
> >
> > fs_chunks backend is configured as part of riak_kv_multi_backend:
> >
> > {<<"fs_chunks">>, riak_kv_bitcask_backend, [
> > {data_root, "/var/lib/riak/fs_chunks"}
> > ]},
> >
> > Objects stored are chunks of binary data
> (ContentType=binary/octet-stream) with a maximum size of 256Kb. Each object
> also has a single key/value pair in user metadata (usermeta).
> >
> > I'm not able to replicate this on my local single node setup, it only
> happens on a production 5 node cluster.
> >
> >
> > On 11 March 2016 at 15:53, Magnus Kessler <mkess...@basho.com> wrote:
> > Hi Oleksiy,
> >
> > Could you please share the bucket or bucket-type properties for that
> small bucket? If you open an issue on github, please add the properties
> there, too.
> >
> > Many Thanks,
> >
> > On 11 March 2016 at 13:46, Oleksiy Krivoshey <oleks...@gmail.com> wrote:
> > I got the recursive behavior with other, larger buckets but I had no
> logging so when I enabled debugging this was the first bucket to replicate
> the problem. I have a lot of buckets of the same type, some have many
> thousands keys some are small. My task is to iterate the keys (once only)
> of all buckets. Either with 2i or with Yokozuna.
> > On Fri, Mar 11, 2016 at 15:32 Russell Brown <russell.br...@me.com>
> wrote:
> > Not the answer, by why pagination for 200 keys? Why the cost of doing
> the query 20 times vs once?
> >
> > On 11 Mar 2016, at 13:28, Oleksiy Krivoshey <oleks...@gmail.com> wrote:
> >
> > > Unfortunately there are just 200 keys in that bucket. So with larger
> max_results I just get all the keys without continuation. I'll try to
> replicate this with a bigger bucket.
> > > On Fri, Mar 11, 2016 at 15:21 Russell Brown <russell.br...@me.com>
> wrote:
> > > That seems very wrong. Can you do me a favour and try with a larger
> max_results. I remember a bug with small results set, I thought it was
> fixed, I’m looking into the past issues, but can you try “max_results=1000”
> or something, and let me know what you see?
> > >
> > > On 11 Mar 2016, at 13:03, Oleksiy Krivoshey <oleks...@gmail.com>
> wrote:
> > >
> > > > Here it is without the `value` part of request:
> > > >
> > > > curl '
> http://127.0.0.1:8098/types/fs_chunks/buckets/0r0e5wahrhsgpolk9stbnrqmp77fjjye.chunks/index/$bucket/_?max_results=10&continuation=g20AAAAja1AzdzJwOXpYcVoyb0F4NDhTMVNnRUpBbGJ0ZkhVdkk6MjU=
> '
> > > >
> > > >
> {"keys":["4rpG2PwRTs3YqasGGYrhACBvZqTg7mQW:0","4rpG2PwRTs3YqasGGYrhACBvZqTg7mQW:2","FSEky50kr2TLkBuo1JKv6sphINYwnJfV:1","F3KcwtjG9VAtM5u8vbwBuCjuGBrPTnfq:0","RToMNlsnVKvXcawQK6BGnCAKx58pC9xX:1","UMiHx4qDR5pHWT9OgLAu1KMlFeEKbISm:0","F3KcwtjG9VAtM5u8vbwBuCjuGBrPTnfq:2","YQlRWkJPFYiLlAwhvgqOysJC3ycmQ9OA:0","kP3w2p9zXqZ2oAx48S1SgEJAlbtfHUvI:15","kP3w2p9zXqZ2oAx48S1SgEJAlbtfHUvI:25"],"continuation":"g20AAAAja1AzdzJwOXpYcVoyb0F4NDhTMVNnRUpBbGJ0ZkhVdkk6MjU="}
> > > >
> > > > On 11 March 2016 at 14:58, Oleksiy Krivoshey <oleks...@gmail.com>
> wrote:
> > > > I'm actually using PB interface, but I can replicate the problem
> with HTTP as in my previous email. Request with '&continuation=AAAA'
> returns the result set with the same continuation AAAA.
> > > >
> > > > On 11 March 2016 at 14:55, Magnus Kessler <mkess...@basho.com>
> wrote:
> > > > Hi Oleksiy,
> > > >
> > > > How are you performing your 2i-based key listing? Querying with
> pagination as shown in the documentation[0] should work.
> > > >
> > > > As an example here is the HTTP invocation:
> > > >
> > > > curl "
> https://localhost:8098/types/default/buckets/test/index/\$bucket/_?max_results=10&continuation=g20AAAACNTM=
> "
> > > >
> > > > Once the end of the key list is reached, the server returns an empty
> keys list and no further continuation value.
> > > >
> > > > Please let me know if this works for you.
> > > >
> > > > Kind Regards,
> > > >
> > > > Magnus
> > > >
> > > >
> > > > [0]: http://docs.basho.com/riak/latest/dev/using/2i/#Querying
> > > >
> > > > On 11 March 2016 at 10:06, Oleksiy Krivoshey <oleks...@gmail.com>
> wrote:
> > > > Anyone?
> > > >
> > > > On 4 March 2016 at 19:11, Oleksiy Krivoshey <oleks...@gmail.com>
> wrote:
> > > > I have a bucket with ~200 keys in it and I wanted to iterate them
> with the help of $bucket index and 2i request, however I'm facing the
> recursive behaviour, for example I send the following 2i request:
> > > >
> > > > {
> > > > bucket: 'BUCKET_NAME',
> > > > type: 'BUCKET_TYPE',
> > > > index: '$bucket',
> > > > key: 'BUCKET_NAME',
> > > > qtype: 0,
> > > > max_results: 10,
> > > > continuation: 'AAAA'
> > > > }
> > > >
> > > > I receive 10 keys and continuation 'BBBB', I then repeat the request
> with continuation 'BBBB' and at this point I can receive a reply with
> continuation 'CCCC' or 'AAAA' or even 'BBBB' and its going in never ending
> recursion.
> > > >
> > > > I'm running this on a 5 node 2.1.3 cluster.
> > > >
> > > > What I'm doing wrong? Or is this not supported at all?
> > > >
> > > > Thanks!
> > > >
> > > >
> > > > _______________________________________________
> > > > riak-users mailing list
> > > > riak-users@lists.basho.com
> > > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Magnus Kessler
> > > > Client Services Engineer
> > > > Basho Technologies Limited
> > > >
> > > > Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg
> 07970431
> > > >
> > > >
> > > > _______________________________________________
> > > > riak-users mailing list
> > > > riak-users@lists.basho.com
> > > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> > >
> >
> >
> > _______________________________________________
> > riak-users mailing list
> > riak-users@lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >
> >
> >
> >
> > --
> > Magnus Kessler
> > Client Services Engineer
> > Basho Technologies Limited
> >
> > Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
> >
>
>
_______________________________________________
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
