hay, folks:
i use ceph source code to install a ceph cluster. ceph version
0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b)
After finish install, i can't find radosgw command?
i use below paramter in ceph's installation:
install package:
|#apt-get install automake autoconf gcc g++ libboost
Hi Sam
in the meantime, the output of ceph pg 0.cfa query has become quite a bit
longer (for better or worse) - see: http://pastebin.com/0Jxmm353
I have restarted osd.23 with the debug log settings and have extracted these
0.cfa related log lines - I can't interpret them. There might be more,
I'm following different threads here, mainly the poor radosgw performance one.
And what I see there are often recommendation to put a certain config to
ceph.conf, but often it's unclear to me where exactly to put them
- does it matter if I put a config for all OSD's in [global] or [osd] ?
Examp
On Fri, Sep 20, 2013 at 3:58 PM, Gruher, Joseph R
wrote:
> Sorry, not trying to repost or bump my thread, but I think I can restate my
> question here and for better clarity. I am confused about the "--cluster"
> argument used when "ceph-deploy mon create" invokes "ceph-mon" on the target
> sy
Hi folks, I am Dafan from Yahoo! corp. We are really interested in Ceph now. I
wish to know where I can get some performance report about new released
DUMPLING? Like throughput, latency with different cluster scale and hardware
type? Thanks.
Dafan
Hi,
just a short question to which I couldn't find an answer in the
documentation:
When I run a cluster with public and cluster network seperated, would it
still be possible to have clients accessing the cluster (ie. RBDs) from
within the cluster network?
Thanks for your help,
best regards,
Kurt
Hi all,
trying to test ceph with hadoop without success.
I deployed the ceph cluster using ceph-deploy.
Hadoop - 1.1.3
ceph version 0.67.3
Does anyone had success on making this work?
ceph.conf
[global]
fsid = d9ca74d0-d9f4-436d-92de-762af67c6534
mon initial members = hyrax1, hyrax2, hyrax3, hyra
Hi all,
something with ceph-deploy doesen't work at all anymore.
After an upgrade ceph-depoly failed to roll out a new monitor
with "permission denied. are you root?"
(obviously there shouldn't be a root login so I had another user
for ceph-deploy before which worked perfectly, why not now?)
ceph
>
> ceph.root.dir
> /mnt/mycephfs
>
This is probably causing the issue. Is this meant to be a local mount
point? The 'ceph.root.dir' property specifies the root directory
/inside/ CephFS, and the Hadoop implementation doesn't require a local
CephFS mount--it uses a client library
Clients use the public network. The cluster network is principally for
OSD-to-OSD communication--heartbeats, replication, backfill, etc.
On Mon, Sep 23, 2013 at 7:42 AM, Kurt Bauer wrote:
> Hi,
> just a short question to which I couldn't find an answer in the
> documentation:
> When I run a clus
Shoot, I thought I had it figured out :)
There is a default admin user created when you first create your
cluster. After a typical install via ceph-deploy, there should be a
file called 'ceph.client.admin.keyring', usually sibling to ceph.conf.
If this is in a standard location (e.g. /etc/ceph) yo
Hi Noah,
updated the core-site.xml (bellow).
All the nodes have the same files. But the problem remains the same.
What is the value for "ceph.auth.keyring"? Is the path containing the
file "ceph.mon.keyring"?
Thanks,
Rolando
P.S.: I have the cephFS mounted locally, so the cluster is ok.
cluste
Hi Noah,
I enabled the debugging and got:
2013-09-23 18:59:34.705894 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 18:59:34.706106 7f0b58de7700 20 client.-1 trim_cache size 0 max 0
2013-09-23 18:59:34.706225 7f0b58de7700 10 jni: ceph_mou
>-Original Message-
>From: Alfredo Deza [mailto:alfredo.d...@inktank.com]
>Sent: Monday, September 23, 2013 5:45 AM
>To: Gruher, Joseph R
>Cc: ceph-users@lists.ceph.com
>Subject: Re: [ceph-users] monitor deployment during quick start
>
>On Fri, Sep 20, 2013 at 3:58 PM, Gruher, Joseph R
>
How are you invoking Hadoop? Also, I forgot to ask, are you using the
wrappers located in github.com/ceph/hadoop-common (or the jar linked
to on http://ceph.com/docs/master/cephfs/hadoop/)?
On Mon, Sep 23, 2013 at 12:05 PM, Rolando Martins
wrote:
> Hi Noah,
> I enabled the debugging and got:
>
>
I am trying to start hadoop using bin/start-mapred.sh.
In the HADOOP_HOME/lib, I have:
lib/hadoop-cephfs.jar lib/libcephfs.jar lib/libcephfs_jni.so
(the first I downloaded from
http://ceph.com/docs/master/cephfs/hadoop/ and the other two, I copied
from my system (after installing the ubuntu packa
On Mon, 23 Sep 2013, Alfredo Deza wrote:
> On Fri, Sep 20, 2013 at 3:58 PM, Gruher, Joseph R
> wrote:
> > Sorry, not trying to repost or bump my thread, but I think I can restate my
> > question here and for better clarity. I am confused about the "--cluster"
> > argument used when "ceph-deploy
I think some dependency is missing.. For example, I can see the libcurl package
is missing..See the build prerequisite.
http://ceph.com/docs/next/install/build-prerequisites/
The configure/autogen script is checking the packages installed in your system
and accordingly creating the makefiles.
What happens when you run `bin/hadoop fs -ls` ? This is entirely
local, and a bit simpler and easier to grok.
On Mon, Sep 23, 2013 at 12:23 PM, Rolando Martins
wrote:
> I am trying to start hadoop using bin/start-mapred.sh.
> In the HADOOP_HOME/lib, I have:
> lib/hadoop-cephfs.jar lib/libcephfs.
In the log file that you showing, do you see where the keyring file is
being set by Hadoop? You can find it by grepping for: "jni: conf_set"
On Mon, Sep 23, 2013 at 12:43 PM, Rolando Martins
wrote:
> bin/hadoop fs -ls
>
> Bad connection to FS. command aborted. exception:
>
> (no other information
bin/hadoop fs -ls
Bad connection to FS. command aborted. exception:
(no other information is thrown)
ceph log:
2013-09-23 19:42:27.545402 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 19:42:27.545619 7f0b58de7700 20 client.-1 trim_cach
2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0
2013-09-23 19:42:22.515893 7f0b58de7700 10 jni: ceph_mount: /
2013-09-23 19:42:22.516643 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 19:42:22.516969 7f0b58de7700
On Mon, Sep 23, 2013 at 11:23 AM, Bernhard Glomm wrote:
> Hi all,
>
> something with ceph-deploy doesen't work at all anymore.
> After an upgrade ceph-depoly failed to roll out a new monitor
> with "permission denied. are you root?"
> (obviously there shouldn't be a root login so I had another us
On Mon, Sep 23, 2013 at 1:18 AM, yy-nm wrote:
> hay, folks:
> i use ceph source code to install a ceph cluster. ceph version 0.61.8
> (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b)
> After finish install, i can't find radosgw command?
> i use below paramter in ceph's installation:
>
> install pack
I modified /etc/ceph.conf for no authentication and to specify both private and
public networks. /etc/ceph/ceph.conf was distributed to all nodes in the cluster
ceph was restarted on all nodes using "service ceph -a restart".
After that authentication is still required and no ports are open on th
I did the same thing recently.
From: ceph-users-boun...@lists.ceph.com
[mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Snider, Tim
Sent: Monday, September 23, 2013 4:10 PM
To: ceph-users@lists.ceph.com
Subject: [ceph-users] ceph.conf changes and restarting ceph.
I modified /etc/ceph.conf
I'm not sure what you grepped for. Does this output mean that the
string "conf_set" didn't show up in the log?
On Mon, Sep 23, 2013 at 12:52 PM, Rolando Martins
wrote:
> 2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0
> 2013-09-23 19:42:22.515893 7f0b58de7700 10 jni: ce
My bad, I associated conf_read_file with conf_set.
No, it does not appear in the logs.
On Mon, Sep 23, 2013 at 4:20 PM, Noah Watkins wrote:
> I'm not sure what you grepped for. Does this output mean that the
> string "conf_set" didn't show up in the log?
>
> On Mon, Sep 23, 2013 at 12:52 PM, Rola
Ok thanks. That narrows things down a lot. It seems like the keyring
property is not being recognized, and I don't see so I'm wondering if
it is possible that the jar file is out of date and doesn't include
these configuration features.
If you clone http://github.com/ceph/hadoop-common/ and check
On Sun, Sep 22, 2013 at 2:35 AM, Dafan Dong wrote:
>
>
> Hi folks, I am Dafan from Yahoo! corp. We are really interested in Ceph now.
> I wish to know where I can get some performance report about new released
> DUMPLING? Like throughput, latency with different cluster scale and hardware
> type?
I tried to compile it, but the compilation failed.
The error log starts with:
compile-core-classes:
[taskdef] 2013-09-23 20:59:25,540 INFO mortbay.log
(Slf4jLog.java:info(67)) - Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
[javac] /home/ubuntu/Pr
You need to stick the CephFS jar files in the hadoop lib folder.
On Mon, Sep 23, 2013 at 2:02 PM, Rolando Martins
wrote:
> I tried to compile it, but the compilation failed.
> The error log starts with:
> compile-core-classes:
> [taskdef] 2013-09-23 20:59:25,540 INFO mortbay.log
> (Slf4jLog.ja
Thanks Noah!
It worked!
I managed to run the wordcount example!
Can you remove the jar that is posted online? It is misleading...
Thanks!
Rolando
On Mon, Sep 23, 2013 at 5:07 PM, Noah Watkins wrote:
> You need to stick the CephFS jar files in the hadoop lib folder.
>
> On Mon, Sep 23, 2013 a
Yeh, it should be updating automatically, so it looks like there is an
issue with that. So sorry about the headache figuring this out!
On Mon, Sep 23, 2013 at 2:25 PM, Rolando Martins
wrote:
> Thanks Noah!
> It worked!
> I managed to run the wordcount example!
>
> Can you remove the jar that is
Tim
Did it work with authentication enabled ?
-gary
On Mon, Sep 23, 2013 at 2:10 PM, Snider, Tim wrote:
> I modified /etc/ceph.conf for no authentication and to specify both
> private and public networks. /etc/ceph/ceph.conf was distributed to all
> nodes in the cluster
>
> ceph was res
You might need to tell cyberduck the location of your endpoint.
-Sam
On Tue, Sep 17, 2013 at 9:16 PM, lixuehui wrote:
> Hi,all
> I installed rgw with a healthy ceph cluster .Although it works well with S3
> api ,can it be connected by Cyberduck ?
> I've tried with the rgw user configure,but fail
Can you restart those osds with
debug osd = 20
debug filestore = 20
debug ms = 1
in the [osd] section of the ceph.conf file on the respective machines
and upload the logs? Sounds like a bug.
-Sam
On Tue, Sep 17, 2013 at 2:05 PM, Matt Thompson wrote:
> Hi All,
>
> I set up a new cluster today w
On 2013/9/24 1:32, Yehuda Sadeh wrote:
On Mon, Sep 23, 2013 at 1:18 AM, yy-nm wrote:
hay, folks:
i use ceph source code to install a ceph cluster. ceph version 0.61.8
(a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b)
After finish install, i can't find radosgw command?
i use below paramter in ceph
I will update the Cephx docs. The usage in those docs for restarting
is for Debian/Ubuntu deployed with mkcephfs. If you are using
Dumpling and deployed with ceph-deploy, you will need to use Upstart.
See
http://ceph.com/docs/master/rados/operations/operating/#running-ceph-with-upstart
for detail
Hi John
Why ? do the 'service' scripts not work ? (sorry I don't have access to the
systems from my location) I used dumpling and ceph-deploy on debian.
-gary
On Mon, Sep 23, 2013 at 11:25 PM, John Wilkins wrote:
> I will update the Cephx docs. The usage in those docs for restarting
> is fo
40 matches
Mail list logo
