Re: [ceph-users] Debian Squeeze - Ceph and RBD Kernel Modules Missing

[Matt Chipman]

On Sun, May 5, 2013 at 2:37 PM, Gregory Farnum  wrote:

> Squeeze is running 2.6.32, and the Ceph filesystem client was first
> merged in 2.6.33 (rbd in 2.6.37 I think). We don't have any backports
> to that far, sorry.
>
> Apart from that, if using the kernel clients you really want to be
> using very up-to-date kernels (eg, new Ubuntu) — somebody else will
> have to speak up about precisely how new. Otherwise I'd try for a
> userspace solution. :)
> -Greg
> Software Engineer #42 @ http://inktank.com | http://ceph.com
>
>

Thats ok and thanks for the explanation. I'm thinking it would be a good
addition to the 5 minute quickstart to say wheezy is a better bet than
squeeze??

cheers,

-Matt
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Salam Sahajetra

[Widiyana Samudra]

Assalamualaikum Wr.Wb...

Sebelum dan sesudahnya saya ingin memperkenalkan diri saya,nama saya WIDIYANA 
SAMUDRA berasal dari Indonesia dan bekerja di London (United Kingdom), ingin 
berkenalan dengan anda di sana.
Saya ingin menawarkan satu peluang bisnis yang begitu bagus,dan  bagi Anda yang 
berminat dengan bisnis ... Inilah kesempatan Anda,kapan lagi kalau bukan 
sekarang bukan.???
Produk ini di namakan (MULITE CLEANSER) kegunaannya untuk mencuci barangan yang 
sangat berharga sekali seperti batu intan permata yg masih mentah.
Dan pada waktu yang sama perusahaan di tempat saya bekerja membutuhkan MULITE 
CLEANSER dimana mineral tersbut tersedia dari operator yg di Indonesia.
Jadi bagi anda yang berminat dengan bisnis ini, saya ingin Anda menjadi Agent 
untuk menjual produk tersebut ke pada perusahaan tempat saya bekerja, (Anda 
membeli produk tersebut dari operator yang di Indonesia terlebih dahulu dengan 
harga 500USD(Lima Juta Rupiah) per karton dan dijualnya kembali ke pada 
perusahaan  di tempat saya bekerja dengan harga 1,500USD(Lima belas Juta per 
karton)
Yang paling penting Niat dan ikhlas untuk mencari rezeki semata-mata karena 
Allah. Insya Allah, Allah akan membantu kita untuk mencari rezeki yang halal 
dan berkat,saya ingin Anda buat keputusan yang bijak, Anda bisa merubahnya .. 
Insya Allah '
Apa bila ada berminat atau ada pertanyaan, silahkan balas email terus ke saya 
berdasarkan alamat di bawah atau silahkan berikan number supaya bisa di hubungi 
dan saya akan menerangkannya lebih lanjut di telepon: Insya Allah saya mencoba 
membantu Anda. Semoga ikatan silaturahmi sesama kita diberkati Allah. Selamat 
berkenalan.
widiyan...@yahoo.com
Yang benar...
WIDIYANA SAMUDRA___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Debian Squeeze - Ceph and RBD Kernel Modules Missing

[Michael Lowe]

Well, Debian stable is now wheezy, so 



On May 5, 2013, at 7:16 AM, Matt Chipman  wrote:

> 
> 
> 
> 
> On Sun, May 5, 2013 at 2:37 PM, Gregory Farnum  wrote:
>> Squeeze is running 2.6.32, and the Ceph filesystem client was first
>> merged in 2.6.33 (rbd in 2.6.37 I think). We don't have any backports
>> to that far, sorry.
>> 
>> Apart from that, if using the kernel clients you really want to be
>> using very up-to-date kernels (eg, new Ubuntu) — somebody else will
>> have to speak up about precisely how new. Otherwise I'd try for a
>> userspace solution. :)
>> -Greg
>> Software Engineer #42 @ http://inktank.com | http://ceph.com
> 
> 
> Thats ok and thanks for the explanation. I'm thinking it would be a good 
> addition to the 5 minute quickstart to say wheezy is a better bet than 
> squeeze??
> 
> cheers,
> 
> -Matt
> 
> 
> 
>  
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] HEALTH WARN: clock skew detected

[Varun Chandramouli]

Hi All,

I have a cluster of 4 nodes with 1 mds, 3 mons and 4 osds. Whenever I do
ceph health or ceph -s, it shows a health warning saying clock skew
detected in 2 of the 3 mons. When I run a mapreduce application on the
cluster, one of the monitors crashes (the one in which the skew is not
detected) soon after the application is started. Sometimes the application
completes, sometimes, it fails. I would like to know what this warning
means. Is it responsible for the failing of the application. If yes, how to
remove the warning?

Here is my ceph.conf:

[global]
auth client required = none
auth cluster required = none
auth service required = none

[osd]
osd journal data = 1000
filestore xattr use omap = true

[mon.a]
host = lnx147-73
mon addr = 10.72.147.73:6789

[mon.b]
host = lnx148-20
mon addr = 10.72.148.20:6789

[mon.c]
host = lnx-148-27
mon addr = 10.72.148.27:6789

[mds.a]
host = lnx147-73

[osd.0]
host = lnx147-73

[osd.1]
host = lnx148-20

[osd.2]
host = lnx-148-27

[osd.3]
host = ln148-28

I can mail the mon logs and the output of ceph -w for the duration of the
application.

Regards
Varun
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] HEALTH WARN: clock skew detected

[Michael Lowe]

Are you running ntpd?  If so you may need to stop, run ntpdate, and restart 
ntpd.  Sometimes if the clock is too far out of sync ntp won't update the time.

On May 5, 2013, at 8:52 AM, Varun Chandramouli  wrote:

> Hi All,
> 
> I have a cluster of 4 nodes with 1 mds, 3 mons and 4 osds. Whenever I do ceph 
> health or ceph -s, it shows a health warning saying clock skew detected in 2 
> of the 3 mons. When I run a mapreduce application on the cluster, one of the 
> monitors crashes (the one in which the skew is not detected) soon after the 
> application is started. Sometimes the application completes, sometimes, it 
> fails. I would like to know what this warning means. Is it responsible for 
> the failing of the application. If yes, how to remove the warning?
> 
> Here is my ceph.conf:
> 
> [global]
> auth client required = none
> auth cluster required = none
> auth service required = none
> 
> [osd]
> osd journal data = 1000
> filestore xattr use omap = true
> 
> [mon.a]
> host = lnx147-73
> mon addr = 10.72.147.73:6789
> 
> [mon.b]
> host = lnx148-20
> mon addr = 10.72.148.20:6789
> 
> [mon.c]
> host = lnx-148-27
> mon addr = 10.72.148.27:6789
> 
> [mds.a]
> host = lnx147-73
> 
> [osd.0]
> host = lnx147-73
> 
> [osd.1]
> host = lnx148-20
> 
> [osd.2]
> host = lnx-148-27
> 
> [osd.3]
> host = ln148-28
> 
> I can mail the mon logs and the output of ceph -w for the duration of the 
> application. 
> 
> Regards
> Varun
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Mounting CephFS - mount error 5 = Input/output error

[Wyatt Gorman]

Hi everyone,

Thank you for clearing up the issue with the kernel not containing the
ceph.ko or rbd.ko modules (and I take that thank you back from the guy who
said "oh, you need to load it with modprobe!" because he didn't see that I
got the error I sent you from modprobe...)

Anyway, I upgraded to the new kernel WITH those modules, and now I'm trying
to load the CephFS again with the following command (from the wiki):
mount -t ceph 10.81.2.100:6789:/ /mnt/mycephfs

which gives me this:
mount error 22 = Invalid argument

a little searching led me to add the following options:
mount -t ceph 10.81.2.100:6789:/ /mnt/mycephfs -o
name=admin,secret=`ceph-authtool -p /etc/ceph/ceph.keyring`

which eliminated the mount error 22, but brought up the following one:
mount error 5 = Input/output error

Anyone have any ideas what this is all about? I have the use_xattr option
turned on in my OSD's fstab, which one bug report suggested could be the
problem. I'm running this on ext3, however. I read here: (
http://tracker.ceph.com/issues/479) that BTRFS without journaling works.
Should I try again on BTRFS?

- Wyatt Gorman
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting CephFS - mount error 5 = Input/output error

[Jens Kristian Søgaard]

Hi,

Anyone have any ideas what this is all about? I have the use_xattr 


Could you post the output from "ceph -s"?

First make sure that your mons and mds are indeed running.

Another thing to check: Do you have firewall rules in place that could 
hinder communication between the servers involved?


--
Jens Kristian Søgaard, Mermaid Consulting ApS,
j...@mermaidconsulting.dk,
http://www.mermaidconsulting.com/
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] v0.56.5 released

[Jens Kristian Søgaard]

Hi,


The release notes for qemu 1.4 doesn't seem to mention this, so perhaps
it is not yet in the newest version? - if so, could someone please
direct me to a patch?


http://git.qemu.org/?p=qemu.git;a=commitdiff;h=dc7588c1eb3008bda53dde1d6b890cd299758155 


Thanks a lot!

I have now tested qemu from the git repository and it works very well!

I reported my problems with qemu-kvm reponsiveness on the ceph-devel 
list back in December, and after trying all sorts of suggestions without 
any luck, I was about to reconsider using Ceph. But with this patch the 
problems are gone!


It makes a huge impact on the perceived performance of the guests!

--
Jens Kristian Søgaard, Mermaid Consulting ApS,
j...@mermaidconsulting.dk,
http://www.mermaidconsulting.com/
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting CephFS - mount error 5 = Input/output error

[Jens Kristian Søgaard]

Hi Wyatt,

[You sent me this email off list, I'm assuming that was an error, so I'm 
bringing it back on the list]



ceph -s
   health HEALTH_WARN mds a is laggy



What does this mean, and what can be done to fix it? Thanks, Jens!


It means that the mds hasn't responded to the monitor for too long.

This can happen for example when the mds has crashed, if it is too busy 
or if the network has problems.


Check that the server running the mds is still alive. Use for example 
"top" to determine that the server isn't terribly loaded or swapping, 
and that the mds process is still running.


Then check the mds logfile to see if it has logged errors or a crash 
message.


If you still haven't found any problems, try checking the network to see 
if you connectivity between the servers. Ensure that you haven't 
firewalled the mds so that it cannot talk to the monitors.


--
Jens Kristian Søgaard, Mermaid Consulting ApS,
j...@mermaidconsulting.dk,
http://www.mermaidconsulting.com/
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] HEALTH WARN: clock skew detected

[Matthew Roy]

Instead of installing ntpupdate, you can just tell ntpd that it's okay
to shift the clock a lot using the '-g' parameter. See:
http://superuser.com/questions/518694/ubuntu-12-10-clock-is-wrong

I also find it useful to configure the NTP daemons on my monitors as NTP
peers so they exchange time directly with each other as well as
reference servers.

Matthew


On 05/05/2013 09:29 AM, Michael Lowe wrote:
> Are you running ntpd?  If so you may need to stop, run ntpdate, and
> restart ntpd.  Sometimes if the clock is too far out of sync ntp won't
> update the time.
> 
> On May 5, 2013, at 8:52 AM, Varun Chandramouli  > wrote:
> 
>> Hi All,
>>
>> I have a cluster of 4 nodes with 1 mds, 3 mons and 4 osds. Whenever I
>> do ceph health or ceph -s, it shows a health warning saying clock skew
>> detected in 2 of the 3 mons. When I run a mapreduce application on the
>> cluster, one of the monitors crashes (the one in which the skew is not
>> detected) soon after the application is started. Sometimes the
>> application completes, sometimes, it fails. I would like to know what
>> this warning means. Is it responsible for the failing of the
>> application. If yes, how to remove the warning?
>>
>> Here is my ceph.conf:
>>
>> [global]
>> auth client required = none
>> auth cluster required = none
>> auth service required = none
>>
>> [osd]
>> osd journal data = 1000
>> filestore xattr use omap = true
>>
>> [mon.a]
>> host = lnx147-73
>> mon addr = 10.72.147.73:6789 
>>
>> [mon.b]
>> host = lnx148-20
>> mon addr = 10.72.148.20:6789 
>>
>> [mon.c]
>> host = lnx-148-27
>> mon addr = 10.72.148.27:6789 
>>
>> [mds.a]
>> host = lnx147-73
>>
>> [osd.0]
>> host = lnx147-73
>>
>> [osd.1]
>> host = lnx148-20
>>
>> [osd.2]
>> host = lnx-148-27
>>
>> [osd.3]
>> host = ln148-28
>>
>> I can mail the mon logs and the output of ceph -w for the duration of
>> the application. 
>>
>> Regards
>> Varun
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com 
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 


-- 
Matthew
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] HEALTH WARN: clock skew detected

[Varun Chandramouli]

Hi Michael,

Thanks for your response. No, the ntp daemon is not running. Any other
suggestions?

Regards
Varun
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com