API for Creation of Bucket Types
Hi all, I am running Riak 2.0.1 in a Docker container on each physical host in the cluster. I need to programatically create bucket types from an application running in a separate Docker container. This was easy before using Docker, as I would just execute the riak-admin tool from my application. With Docker there is now no direct shell access possible between the Riak container and the application container, so I cannot run riak-admin. Each container in Docker has a virtual ethernet interface with its own IP address, so obviously I can still access the HTTP and Protobuf APIs remotely from the application container. Is there any API available, or on the roadmap, to create bucket types ? If not how would you suggest I create bucket types in this situation ? Thanks, Isaac -- View this message in context: http://riak-users.197444.n3.nabble.com/API-for-Creation-of-Bucket-Types-tp4031932.html Sent from the Riak Users mailing list archive at Nabble.com. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Solution for Riak 500 Internal Server Error
http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Memory-backend TTL
Hi Luke.
An update about the memory consumption in my 1 server "cluster" after about
10 hours after my last email. Remember, with max_memory_per_vnode = 250MB
and ring_size=16. Sadly, I had to restart the riak daemon:
# riak-admin diag -d debug
[debug] Local RPC: os:getpid([]) [5000]
[debug] Running shell command: ps -o pmem,rss -p 17521
[debug] Shell command output:
%MEM RSS
93.2 30599792
[debug] Local RPC: riak_core_ring_util:check_ring([]) [5000]
[debug] Cluster RPC: application:get_env([riak_search,enabled]) [5000]
[critical] Riak memory usage is HIGH: 93.2% of available RAM
[info] Riak process is using 93.2% of available RAM, totalling 30599792 KB
of real memory.
# riak-admin status|grep memory
memory_total : 36546708552
memory_processes : 410573688
memory_processes_used : 405268472
memory_system : 36136134864
memory_atom : 561761
memory_atom_used : 561285
memory_binary : 14322847352
memory_code : 14371292
memory_ets : 21738236080
# riak-admin vnode-status
VNode: 1370157784997721485815954530671515330927436759040
Backend: riak_kv_multi_backend
Status:
[{<<"one_minute_ttl">>,
[{mod,riak_kv_memory_backend},
{data_table_status,[{compressed,false},
{memory,1366727},
{owner,<8343.9466.104>},
{heir,none},
{name,riak_kv_1370157784997721485815954530671515330927436759040},
{size,35042},
{node,'riak@xx'},
{named_table,false},
{type,ordered_set},
{keypos,1},
{protection,protected}]},
{index_table_status,[{compressed,false},
{memory,89},
{owner,<8343.9466.104>},
{heir,none},
{name,riak_kv_1370157784997721485815954530671515330927436759040_i},
{size,0},
{node,'riak@xxx'},
{named_table,false},
{type,ordered_set},
{keypos,1},
{protection,protected}]},
{time_table_status,[{compressed,false},
{memory,161493542},
{owner,<8343.9466.104>},
{heir,none},
{name,riak_kv_1370157784997721485815954530671515330927436759040_t},
{size,5981239},
{node,'riak@'},
{named_table,false},
{type,ordered_set},
{keypos,1},
{protection,protected}]}]}]
2014-10-14 2:02 GMT+02:00 Lucas Grijander :
> Hi Luke.
>
> I really appreciate your efforts to attempt to reproduce the problem. I
> think that the configs are right. I have been doing also a lot of tests and
> with 1 server/node, the memory bucket works flawlessly, as your test. The
> Riak cluster where we have the problem has a multi_backend with 1 memory
> backend, 2 bitcask backends and 2 leveldb backends. I have only changed the
> parameter connection of the memory backend in our production code to
> another new "cluster" with only 1 node, with the same config of Riak but
> with only 1 memory backend under the multi configuration and, as I said,
> all fine, the problem vanished. I deduce that the problem appears only with
> more than 1 node and with a lot of requests.
>
> In my tests with the production cluster with the problem ( 4 nodes),
> finally I realized that the TTL is working but, randomly and suddenly, KEYS
> already deleted appear, and KEYS with correct TTL disappear :-? (Maybe
> something related with the some ETS internal table? ) This is the moment
> when I can obtain KEYS already expired.
>
> In summary:
>
> - With cluster with 4 nodes (config below): All OK for a while and
> suddenly we lost the last 20 seconds approx. of keys and OLD keys appear in
> the list: curl -X GET http://localhost:8098/buckets/ttl_stg/keys?keys=true
>
> buckets.default.last_write_wins = true
> bitcask.io_mode = erlang
> multi_backend.ttl_stg.storage_backend = memory
> multi_backend.ttl_stg.memory_backend.ttl = 90s
> multi_backend.ttl_stg.memory_backend.max_memory_per_vnode = 25MB
> anti_entropy = passive
> ring_size = 256
>
> - With 1 node: All OK
>
> buckets.default.n_val = 1
> buckets.default.last_write_wins = true
> buckets.default.r = 1
> buckets.default.w = 1
> multi_backend. ttl_stg.storage_backend = memory
> multi_backend. ttl_stg.memory_backend.ttl = 90s
> multi_backend. ttl_stg.memory_backend.max_memory_per_vnode = 250MB
> ring_size = 16
>
>
>
> Another note: With this 1 node (32GB RAM) and only activated the memory
> backend I have realized than the memory consumption grows without control:
>
>
> # riak-admin status|grep memory
> memory_total : 17323130960
> memory_processes : 235043016
> memory_processes_used : 233078456
> memory_system : 17088087944
> memory_atom : 561761
> memory_atom_used : 561127
> memory_binary :
Riak Ruby client cannot connect to server
Hi,
I just started to learn Riak, but encounter a problem.
I have installed Riak on my mac os using the official mac distribution.
After starting the Riak server, I can interact with it via http interface
properly.
Then I tried using Ruby client, and problem came. Below is the code I extract
from Riak Ruby client github page:
> require 'riak'
>
> client = Riak::Client.new(pb_port: 8098)
> bucket = client.bucket('rooms')
>
> # Get an object from the bucket
> object = bucket.get_or_new("index.html") # a Riak::RObject
>
> # Change the object's data and save
> object.raw_data = "Hello, world!"
> object.content_type = "text/html"
> object.store
>
When I run this program, it just hung there. After a little bit debugging, I
found it hung in file lib/riak/client/beefcake/protocol.rb:44, which said:
> header = socket.read 5
My Ruby version is 2.1.1, Riak version is 2.0.1, Ruby client version is 2.1.0
Any ideas about this?
--
Cui Liqiang
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Ruby client cannot connect to server
You are connecting the binary client to the HTTP port. Use port 8087 instead.
On Tue, Oct 14, 2014 at 8:50 AM, Cui Liqiang wrote:
> Hi,
>
> I just started to learn Riak, but encounter a problem.
>
> I have installed Riak on my mac os using the official mac distribution.
> After starting the Riak server, I can interact with it via http interface
> properly.
> Then I tried using Ruby client, and problem came. Below is the code I
> extract from Riak Ruby client github page:
>
> require 'riak'
>
> client = Riak::Client.new(pb_port: 8098)
> bucket = client.bucket('rooms')
>
> # Get an object from the bucket
> object = bucket.get_or_new("index.html") # a Riak::RObject
>
> # Change the object's data and save
> object.raw_data = "Hello, world!"
> object.content_type = "text/html"
> object.store
>
>
>
> When I run this program, it just hung there. After a little bit debugging, I
> found it hung in file lib/riak/client/beefcake/protocol.rb:44, which said:
>
> header = socket.read 5
>
>
> My Ruby version is 2.1.1, Riak version is 2.0.1, Ruby client version is
> 2.1.0
>
> Any ideas about this?
>
> --
> Cui Liqiang
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
--
Sean Cribbs
Sr. Software Engineer
Basho Technologies, Inc.
http://basho.com/
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Solution for Riak 500 Internal Server Error
On Oct 14, 2014, at 3:53 AM, ayush mishra wrote: > http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html > ___ > I recommend _not_ using legacy Riak Search on Riak 2.x. Why was the legacy search pre-commit hook installed in the first place? Are you trying to use search? Documentation for new search: http://docs.basho.com/riak/latest/dev/using/search/ -Z ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Not able to store data in original riak bucket
Hi Ayush, By making that change, you are enabling Riak Search 1.0, which I assume you don't want to do. This is a "workaround" but not a fix. * Did you upgrade from a previous version of Riak to 2.0.1? * What client library and version of that library are you using? * Can you run this command and send me the output? tar czf /tmp/riak-config-$(hostname).tgz /var/lib/riak/generated.configs Thanks! -- Luke Bakken Engineer / CSE lbak...@basho.com On Tue, Oct 14, 2014 at 12:52 AM, ayush mishra wrote: > http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html > > On Mon, Oct 13, 2014 at 10:13 PM, Luke Bakken wrote: >> >> Hi Ayush, >> >> If you have time, please let me know what you changed. >> -- >> Luke Bakken >> Engineer / CSE >> lbak...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: API for Creation of Bucket Types
Hi Isaac, Is the lack of shell access due to how you've configured Docker? I'm not familiar with it, however it does appear that access is possible: https://docs.docker.com/articles/basics/#running-an-interactive-shell Providing a bucket type API is planned for a future Riak 2.X release. -- Luke Bakken Engineer / CSE lbak...@basho.com On Tue, Oct 14, 2014 at 12:41 AM, superstructor wrote: > Hi all, > > I am running Riak 2.0.1 in a Docker container on each physical host in the > cluster. > > I need to programatically create bucket types from an application running in > a separate Docker container. > > This was easy before using Docker, as I would just execute the riak-admin > tool from my application. > > With Docker there is now no direct shell access possible between the Riak > container and the application container, so I cannot run riak-admin. > > Each container in Docker has a virtual ethernet interface with its own IP > address, so obviously I can still access the HTTP and Protobuf APIs remotely > from the application container. > > Is there any API available, or on the roadmap, to create bucket types ? > > If not how would you suggest I create bucket types in this situation ? > > Thanks, > > Isaac > > > > > > -- > View this message in context: > http://riak-users.197444.n3.nabble.com/API-for-Creation-of-Bucket-Types-tp4031932.html > Sent from the Riak Users mailing list archive at Nabble.com. > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: API for Creation of Bucket Types
Hi Isaac, Adding an API for bucket types is high on our list of priorities, but we do not have a timeline for availability at the moment. I'm no Docker expert either, but I wondered if you could wrap a version of riak-admin with nsenter until we deliver it? http://jpetazzo.github.io/2014/06/23/docker-ssh-considered-evil/ On Tue, Oct 14, 2014 at 8:55 AM, Luke Bakken wrote: > Hi Isaac, > > Is the lack of shell access due to how you've configured Docker? I'm > not familiar with it, however it does appear that access is possible: > > https://docs.docker.com/articles/basics/#running-an-interactive-shell > > Providing a bucket type API is planned for a future Riak 2.X release. > > -- > Luke Bakken > Engineer / CSE > lbak...@basho.com > > > On Tue, Oct 14, 2014 at 12:41 AM, superstructor > wrote: > > Hi all, > > > > I am running Riak 2.0.1 in a Docker container on each physical host in > the > > cluster. > > > > I need to programatically create bucket types from an application > running in > > a separate Docker container. > > > > This was easy before using Docker, as I would just execute the riak-admin > > tool from my application. > > > > With Docker there is now no direct shell access possible between the Riak > > container and the application container, so I cannot run riak-admin. > > > > Each container in Docker has a virtual ethernet interface with its own IP > > address, so obviously I can still access the HTTP and Protobuf APIs > remotely > > from the application container. > > > > Is there any API available, or on the roadmap, to create bucket types ? > > > > If not how would you suggest I create bucket types in this situation ? > > > > Thanks, > > > > Isaac > > > > > > > > > > > > -- > > View this message in context: > http://riak-users.197444.n3.nabble.com/API-for-Creation-of-Bucket-Types-tp4031932.html > > Sent from the Riak Users mailing list archive at Nabble.com. > > > > ___ > > riak-users mailing list > > riak-users@lists.basho.com > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > -- Jon Meredith Chief Architect Basho Technologies, Inc. jmered...@basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak-CS Not Inheriting Permissions?
Does anyone have an idea why this is working this way or if it is functioning as designed? Am I expecting it to do something that it doesn't do? If so, then how can I get it do what I am expecting. We are running Riak-CS on version 1.4.8. Here is the situation. We have a bucket that is owned by Acct1 that has folders in it. Acct2 has been granted all permissions to the bucket and all sub-folders. Acct2 puts a file in one of the subfolders, but Acct1 has no permissions at all for the file. Acct1 puts a file in the same folder and Acct2 automatically has all of the same permissions to the file as it has to the parent folder. Why is it working this way and how do I get it to inherit permissions automatically? Thanks, Anthony Inmar Confidentiality Note: This e-mail and any attachments are confidential and intended to be viewed and used solely by the intended recipient. If you are not the intended recipient, be aware that any disclosure, dissemination, distribution, copying or use of this e-mail or any attachment is prohibited. If you received this e-mail in error, please notify us immediately by returning it to the sender and delete this copy and all attachments from your system and destroy any printed copies. Thank you for your cooperation. Notice of Protected Rights: The removal of any copyright, trademark, or proprietary legend contained in this e-mail or any attachment is prohibited without the express, written permission of Inmar, Inc. Furthermore, the intended recipient must maintain all copyright notices, trademarks, and proprietary legends within this e-mail and any attachments in their original form and location if the e-mail or any attachments are reproduced, printed or distributed. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: API for Creation of Bucket Types
Luke,
Docker interactive shells are only used when running a docker image locally
for testing. When running in production Docker images typically do not run
SSH server, making ssh connections to the running image impossible.
Isaac,
What you may consider doing is looking at using nsenter. This utility
allows you to switch to the containers namespace and execute commands from
within the container without forcing you to run ssh server and and init
process just to try and do riak-admin.
https://github.com/jpetazzo/nsenter
Cheers,
John
*John Kline*
P:314-495-3391 | E: jkl...@riotgames.com | sh: :(){ :|:& };:
On Tue, Oct 14, 2014 at 9:55 AM, Luke Bakken wrote:
> Hi Isaac,
>
> Is the lack of shell access due to how you've configured Docker? I'm
> not familiar with it, however it does appear that access is possible:
>
> https://docs.docker.com/articles/basics/#running-an-interactive-shell
>
> Providing a bucket type API is planned for a future Riak 2.X release.
>
> --
> Luke Bakken
> Engineer / CSE
> lbak...@basho.com
>
>
> On Tue, Oct 14, 2014 at 12:41 AM, superstructor
> wrote:
> > Hi all,
> >
> > I am running Riak 2.0.1 in a Docker container on each physical host in
> the
> > cluster.
> >
> > I need to programatically create bucket types from an application
> running in
> > a separate Docker container.
> >
> > This was easy before using Docker, as I would just execute the riak-admin
> > tool from my application.
> >
> > With Docker there is now no direct shell access possible between the Riak
> > container and the application container, so I cannot run riak-admin.
> >
> > Each container in Docker has a virtual ethernet interface with its own IP
> > address, so obviously I can still access the HTTP and Protobuf APIs
> remotely
> > from the application container.
> >
> > Is there any API available, or on the roadmap, to create bucket types ?
> >
> > If not how would you suggest I create bucket types in this situation ?
> >
> > Thanks,
> >
> > Isaac
> >
> >
> >
> >
> >
> > --
> > View this message in context:
> http://riak-users.197444.n3.nabble.com/API-for-Creation-of-Bucket-Types-tp4031932.html
> > Sent from the Riak Users mailing list archive at Nabble.com.
> >
> > ___
> > riak-users mailing list
> > riak-users@lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak-CS Not Inheriting Permissions?
Hi Anthony, When you put files, are you also including any ACL information? http://docs.basho.com/riakcs/latest/cookbooks/Access-Control-Lists/ -- Luke Bakken Engineer / CSE lbak...@basho.com On Tue, Oct 14, 2014 at 8:07 AM, Valenti, Anthony wrote: > Does anyone have an idea why this is working this way or if it is > functioning as designed? Am I expecting it to do something that it doesn’t > do? If so, then how can I get it do what I am expecting. > > > > > > We are running Riak-CS on version 1.4.8. > > Here is the situation. We have a bucket that is owned by Acct1 that has > folders in it. Acct2 has been granted all permissions to the bucket and all > sub-folders. > > Acct2 puts a file in one of the subfolders, but Acct1 has no permissions at > all for the file. > > Acct1 puts a file in the same folder and Acct2 automatically has all of the > same permissions to the file as it has to the parent folder. > > Why is it working this way and how do I get it to inherit permissions > automatically? > > > > Thanks, > > Anthony > > > > > > Inmar Confidentiality Note: This e-mail and any attachments are > confidential and intended to be viewed and used solely by the intended > recipient. If you are not the intended recipient, be aware that any > disclosure, dissemination, distribution, copying or use of this e-mail or > any attachment is prohibited. If you received this e-mail in error, please > notify us immediately by returning it to the sender and delete this copy and > all attachments from your system and destroy any printed copies. Thank you > for your cooperation. > > > > Notice of Protected Rights: The removal of any copyright, trademark, or > proprietary legend contained in this e-mail or any attachment is prohibited > without the express, written permission of Inmar, Inc. Furthermore, the > intended recipient must maintain all copyright notices, trademarks, and > proprietary legends within this e-mail and any attachments in their original > form and location if the e-mail or any attachments are reproduced, printed > or distributed. > > > > > > > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Solution for Riak 500 Internal Server Error
I updated it from previous version to 2.0.1. I think that might be the reason. On Tue, Oct 14, 2014 at 7:53 PM, Ryan Zezeski wrote: > > On Oct 14, 2014, at 3:53 AM, ayush mishra > wrote: > > > http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html > ___ > > > I recommend _not_ using legacy Riak Search on Riak 2.x. Why was the > legacy search pre-commit hook installed in the first place? Are you trying > to use search? > > Documentation for new search: > > http://docs.basho.com/riak/latest/dev/using/search/ > > -Z > > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Not able to store data in original riak bucket
Hi Ayush, Just so I'm clear and can reproduce this: * You were using Riak 1.4 and had Riak Search enabled. * You put some data into this environment. * You then upgraded to 2.0.1 and saw the search hook being added to buckets. Thanks! -- Luke Bakken Engineer / CSE lbak...@basho.com On Tue, Oct 14, 2014 at 9:45 AM, ayush mishra wrote: > Hi Luke, > > You are right. This is just a workaround not a fix. I had some urgency in my > project. That's why I followed this approach. I updated it from previous > version to 2.0.1. > > Regards, > Ayush > > > On Tue, Oct 14, 2014 at 8:05 PM, Luke Bakken wrote: >> >> Hi Ayush, >> >> By making that change, you are enabling Riak Search 1.0, which I >> assume you don't want to do. This is a "workaround" but not a fix. >> >> * Did you upgrade from a previous version of Riak to 2.0.1? >> >> * What client library and version of that library are you using? >> >> * Can you run this command and send me the output? tar czf >> /tmp/riak-config-$(hostname).tgz /var/lib/riak/generated.configs >> >> Thanks! >> >> -- >> Luke Bakken >> Engineer / CSE >> lbak...@basho.com >> >> >> On Tue, Oct 14, 2014 at 12:52 AM, ayush mishra >> wrote: >> > >> > http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Not able to store data in original riak bucket
Ohhh This is the reason. Thanks Luke for finding root cause. I will take care of this in future. Since I am new to Riak, so I am not aware of this. Regards, Ayush On Tue, Oct 14, 2014 at 10:23 PM, Luke Bakken wrote: > Hi Ayush, > > Just so I'm clear and can reproduce this: > > * You were using Riak 1.4 and had Riak Search enabled. > * You put some data into this environment. > * You then upgraded to 2.0.1 and saw the search hook being added to > buckets. > > Thanks! > > -- > Luke Bakken > Engineer / CSE > lbak...@basho.com > > > On Tue, Oct 14, 2014 at 9:45 AM, ayush mishra > wrote: > > Hi Luke, > > > > You are right. This is just a workaround not a fix. I had some urgency > in my > > project. That's why I followed this approach. I updated it from previous > > version to 2.0.1. > > > > Regards, > > Ayush > > > > > > On Tue, Oct 14, 2014 at 8:05 PM, Luke Bakken wrote: > >> > >> Hi Ayush, > >> > >> By making that change, you are enabling Riak Search 1.0, which I > >> assume you don't want to do. This is a "workaround" but not a fix. > >> > >> * Did you upgrade from a previous version of Riak to 2.0.1? > >> > >> * What client library and version of that library are you using? > >> > >> * Can you run this command and send me the output? tar czf > >> /tmp/riak-config-$(hostname).tgz /var/lib/riak/generated.configs > >> > >> Thanks! > >> > >> -- > >> Luke Bakken > >> Engineer / CSE > >> lbak...@basho.com > >> > >> > >> On Tue, Oct 14, 2014 at 12:52 AM, ayush mishra > >> wrote: > >> > > >> > > http://www.dzone.com/links/r/solution_for_riak_500_internal_server_error.html > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
RE: Riak-CS Not Inheriting Permissions?
The application (VB.Net) appears to only be executing a CopyFromLocal method to upload the file and doing nothing with ACLs. So, should the application be Getting the ACL for the target folder and then applying the ACL to the file that was uploaded? -Original Message- From: Luke Bakken [mailto:lbak...@basho.com] Sent: Tuesday, October 14, 2014 11:52 AM To: Valenti, Anthony Cc: riak-users@lists.basho.com Subject: Re: Riak-CS Not Inheriting Permissions? Hi Anthony, When you put files, are you also including any ACL information? http://docs.basho.com/riakcs/latest/cookbooks/Access-Control-Lists/ -- Luke Bakken Engineer / CSE lbak...@basho.com On Tue, Oct 14, 2014 at 8:07 AM, Valenti, Anthony wrote: > Does anyone have an idea why this is working this way or if it is > functioning as designed? Am I expecting it to do something that it > doesn’t do? If so, then how can I get it do what I am expecting. > > > > > > We are running Riak-CS on version 1.4.8. > > Here is the situation. We have a bucket that is owned by Acct1 that > has folders in it. Acct2 has been granted all permissions to the > bucket and all sub-folders. > > Acct2 puts a file in one of the subfolders, but Acct1 has no > permissions at all for the file. > > Acct1 puts a file in the same folder and Acct2 automatically has all > of the same permissions to the file as it has to the parent folder. > > Why is it working this way and how do I get it to inherit permissions > automatically? > > > > Thanks, > > Anthony > > > > > > Inmar Confidentiality Note: This e-mail and any attachments are > confidential and intended to be viewed and used solely by the intended > recipient. If you are not the intended recipient, be aware that any > disclosure, dissemination, distribution, copying or use of this e-mail > or any attachment is prohibited. If you received this e-mail in > error, please notify us immediately by returning it to the sender and > delete this copy and all attachments from your system and destroy any > printed copies. Thank you for your cooperation. > > > > Notice of Protected Rights: The removal of any copyright, trademark, > or proprietary legend contained in this e-mail or any attachment is > prohibited without the express, written permission of Inmar, Inc. > Furthermore, the intended recipient must maintain all copyright > notices, trademarks, and proprietary legends within this e-mail and > any attachments in their original form and location if the e-mail or > any attachments are reproduced, printed or distributed. > > > > > > > > > ___ > riak-users mailing list > riak-users@lists.basho.com > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com > ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: API for Creation of Bucket Types
Thanks everyone for your replies. I have used nsenter for interactive debugging from the host, but I havn't tried to use it for intra-container shell access. I will look into it albeit not an ideal solution. Just to explore possibilities further, how does riak-admin actually communicate with the Riak daemon process ? Is it possible that I could install riak-admin in both containers, and share a file or network resource between the containers that riak-admin could use to connect to the Riak daemon from the application container ? What is it exactly that riak-admin needs to connect to Riak ? Thanks, Isaac -- View this message in context: http://riak-users.197444.n3.nabble.com/API-for-Creation-of-Bucket-Types-tp4031932p4031948.html Sent from the Riak Users mailing list archive at Nabble.com. ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: serving files from riak-cs to public via url
Thank you Kota, by setting content type in the boto call I got the policy
to work.
...
prp_json = json.dumps(public_read_policy)
bucket.set_policy(prp_json, headers={'Content-Type': 'application/json'})
...
Setting read-public acl on the buckets would not work for me because that
only allows the bucket to be listed, and not each object to be read. But
the policy works to give all objects in the bucket public read access.
On Tue, Oct 14, 2014 at 12:57 AM, Kota Uenishi wrote:
> How about setting read-public acl to buckets instead of setting it each
> object?
>
> BTW that seems valid JSON, or did you correctly put 'application/json'
> as content-type when you put the policy?
>
> On Tue, Oct 14, 2014 at 5:19 AM, Michael Grauer
> wrote:
> > Thanks Ali.
> >
> > I now am having a permissions issue it seems in accessing the objects.
> >
> > I try to curl the object
> >
> >
> http://10.x.x.x/test-bucket/pointclouds/4f55ed40ca08aeb57bf19257aa6601e85436ff0684aa2/static/metadata.ini
> >
> > and I get
> >
> > > encoding="UTF-8"?>AccessDeniedAccess
> >
> Denied/test-bucket/pointclouds/4f55ed40ca08aeb57bf19257aa6601e85436ff0684aa2/static/metadata.ini
> >
> >
> > When I request the ACL for this bucket from boto I get:
> >
> > http://acs.amazonaws.com/groups/global/AllUsers = READ,
> > michael.grauer (owner) = FULL_CONTROL>
> >
> > I would like to not have to set ACLs on each object in my bucket, as I
> > expect a large number of objects. I tried to set a bucket policy like
> this:
> >
> > {
> > "Version":"2008-10-17",
> > "Statement":[{
> > "Sid":"AllowPublicRead",
> > "Effect":"Allow",
> > "Principal": {
> > "AWS": "*"
> > },
> > "Action":["s3:GetObject"],
> > "Resource":["arn:aws:s3:::test-bucket/*"
> > ]
> > }
> > ]
> > }
> >
> >
> >
> > But this was not accepted by boto or s3cmd . boto told me
> > boto.exception.S3ResponseError: S3ResponseError: 415 Unsupported Media
> Type
> > , but there weren't any errors that I could see in the riak-cs logs.
> >
> > Can anyone point the way?
> >
> >
> > Thanks again
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Mon, Oct 13, 2014 at 2:53 PM, Ali Nikkhah >
> > wrote:
> >>
> >> Hi Mike,
> >>
> >> You are trying to resolve a domain name 'test-bucket.10.x.x.x,' which is
> >> invalid. This is the part that is incorrect. There are a couple options:
> >>
> >> 0) You should be able to access the bucket by using
> >> http://ip/bucket-name, like:
> >>
> >> http://10.x.x.x/test-bucket/my_key_path
> >>
> >> 1) For easier public access, you can then set up a resolvable domain
> >> name in your DNS configuration for the bucket, i.e. add a dns entry
> >> like:
> >>
> >> test-bucket..com
> >>
> >> pointing to the riak-cs proxy ip. As long as your proxy is set up
> >> properly, you should then be able to access the object using:
> >>
> >> http://test-bucket..com/my_key_path
> >>
> >>
> >>
> >> -Ali
> >>
> >>
> >> On Mon, 2014-10-13 at 14:11 -0400, Michael Grauer wrote:
> >> > Hi,
> >> >
> >> >
> >> > I'm very new to Riak-CS, and am investigating using it as a standin
> >> > for S3. I'd like to have a url that allows an anonymous
> >> > (unauthenticated) user to download an object from a bucket.
> >> >
> >> >
> >> > Riak 2.0.0-1
> >> > Riak CS 1.5.0-1
> >> > Stanchion 1.5.0-1
> >> > Ubuntu 14.04
> >> >
> >> >
> >> > I have test-bucket set up, and can connect to it, and upload and
> >> > download a file there all using an authenticated user that owns the
> >> > bucket, via boto.
> >> >
> >> >
> >> > My Riak CS is running as 10.x.x.x , the internal IP of my AWS
> >> > instance, and proxied behind nginx.
> >> >
> >> >
> >> > When I try to curl
> >> >
> >> >
> >> > curl -v http://test-bucket.10.x.x.x/my_key_path
> >> >
> >> >
> >> > I'm getting "could not resolve host: test-bucket.10.x.x.x"
> >> >
> >> >
> >> > My configuration is incorrect, but I'm uncertain of how to fix it.
> >> >
> >> >
> >> > Any help is appreciated!
> >> >
> >> >
> >> > Thanks,
> >> > Mike
> >> > ___
> >> > riak-users mailing list
> >> > riak-users@lists.basho.com
> >> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >>
> >>
> >>
> >
> >
> > ___
> > riak-users mailing list
> > riak-users@lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >
>
>
>
> --
> Kota UENISHI / @kuenishi
> Basho Japan KK
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
