[ceph-users] Re: Massive Mon DB Size with noout on 14.2.11

2020-10-02 Thread Martin Verges
As long as the cluster is no healthy, the OSD will require much more space, depending on the cluster size and other factors. Yes this is somewhat normal. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH

[ceph-users] Re: ceph iscsi latency too high for esxi?

2020-10-04 Thread Martin Verges
hat system 200 PGs per OSD is to much, I would suggest 75-100 PGs per OSD You can improve latency on HDD clusters using external DB/WAL on NVMe. That might help you -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit G

[ceph-users] Re: ceph iscsi latency too high for esxi?

2020-10-04 Thread Martin Verges
ch a small amount that it makes no sense in my eyes. > Does that mean that occasional iSCSI path drop-outs are somewhat expected? Not that I'm aware of, but I have no HDD based ISCSI cluster at hand to check. Sorry. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: mart

[ceph-users] Re: Monitor recovery

2020-10-10 Thread Martin Verges
more details and commands at https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-mon/#recovering-a-monitor-s-broken-monmap . -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h,

[ceph-users] Re: Ceph test cluster, how to estimate performance.

2020-10-12 Thread Martin Verges
Hello Daniel, just throw away your crappy Samsung SSD 860 Pro. It won't work in an acceptable way. See https://docs.google.com/spreadsheets/d/1E9-eXjzsKboiCCX-0u0r5fAjjufLKayaut_FOPxYZjc/edit?usp=sharing for a performance indication of individual disks. -- Martin Verges Managing dir

[ceph-users] Re: Ceph Octopus and Snapshot Schedules

2020-10-22 Thread Martin Verges
Hello Adam, in our croit Ceph Management Software, we have a snapshot manager feature that is capable of doing that. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin

[ceph-users] Re: which of cpu frequency and number of threads servers osd better?

2020-11-12 Thread Martin Verges
Hello Tony, as it is HDD, your CPU won't be a bottleneck at all. Both CPUs are overprovisioned. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - V

[ceph-users] Re: Ceph on ARM ?

2020-11-24 Thread Martin Verges
ou are one of very very few people and will most properly hit some crazy bugs that will cause trouble. A high price to pay in my opinion just for an "imaginary" performance or power reduction benefit. Storage has to run 24*7 all year long without a single incident. Everything else in

[ceph-users] Re: Centos 8 2021 with ceph, how to move forward?

2021-01-14 Thread Martin Verges
Hello, we from croit use Ceph on Debian and deploy all our clusters with it. It works like a charm and I personally have quite good experience with it since ~20 years. It is a fantastic solid OS for Servers. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver

[ceph-users] Re: Using RBD to pack billions of small files

2021-01-31 Thread Martin Verges
Hello, source code should be compressible, maybe just creating something like a tar.gz per repo or so? That way you would get much bigger objects that could improve speed and make it easier to store on any storage system. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail

[ceph-users] Re: Worst thing that can happen if I have size= 2

2021-02-03 Thread Martin Verges
general we consider even a 2 copy setup not secure enough. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich

[ceph-users] Re: reinstalling node with orchestrator/cephadm

2021-02-08 Thread Martin Verges
Hello, you could switch to croit. We can overtake existing clusters without much pain and then you have a single button to upgrade in the future ;) -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr

[ceph-users] Re: How's the maturity of CephFS and how's the maturity of Ceph erasure code?

2021-02-08 Thread Martin Verges
Hello Fred, from hundreds of installations, we can say it is production ready and working fine if deployed and maintained correctly. As always it depends, but it works for a huge amount of use cases. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat

[ceph-users] Re: 10G stackabe lacp switches

2021-02-15 Thread Martin Verges
Hello, you can buy Arista 7050QX-32S are 40G Switches. They come for around 500-700€ each and can be stacked using MLAG. They work great. If you like to spend more money, 7060QX-32S are 100G Switches available for around 1500€. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail

[ceph-users] Re: Upgrading Ceph luminous to mimic on debian-buster

2021-02-16 Thread Martin Verges
Hello, you can migrate to nautilus and skip the outdated mimic. Save yourself the trouble of mimic it's not worth. You find packages on debian-backports (https://packages.debian.org/buster-backports/ceph) or the croit debian mirror. -- Martin Verges Managing director Mobile: +49 174 9335

[ceph-users] Re: 10G stackabe lacp switches

2021-02-21 Thread Martin Verges
like to bundle with a specific mlag id On both switches as an example: - interface Port-Channel1 switchport access vlan 101 mlag 1 ! interface Ethernet7/1 description "MLAG bonding to Server XXX" channel-group 1 mode active !

[ceph-users] Re: Gradually Increasing PG/PGP

2021-02-21 Thread Martin Verges
Hello Mark, Ceph itself does it incremental. Just select the value you will have at the end, and wait for Ceph to do so. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO

[ceph-users] Re: Slow cluster / misplaced objects - Ceph 15.2.9

2021-02-26 Thread Martin Verges
throughput. This in turn leads to a higher impact during replication work, which is particularly prevalent in EC. In EC, not only write accesses but also read accesses must be loaded from several OSDs. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https

[ceph-users] Re: How big an OSD disk could be?

2021-03-12 Thread Martin Verges
want to do some specific Ceph workload benchmarks, feel free to drop me a mail. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com

[ceph-users] Re: How big an OSD disk could be?

2021-03-13 Thread Martin Verges
> failure-domain=host yes (or rack/room/datacenter/..), for regular clusters it's therefore absolute no problem as you correctly assumed. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Fresenius

[ceph-users] Re: How big an OSD disk could be?

2021-03-13 Thread Martin Verges
the same as to having multiple OSDs per NVMe as some people do it. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register

[ceph-users] Re: How big an OSD disk could be?

2021-03-13 Thread Martin Verges
> So perhaps we'll need to change the OSD to allow for 500 or 1000 PGs We had a support case last year where we where forced to set the OSD limit to >4000 for a few days, and had more then 4k active PGs on that single OSD. You can do that, however it is quite uncommon. -- Martin Verg

[ceph-users] Re: Diskless boot for Ceph nodes

2021-03-17 Thread Martin Verges
, you simply press the reboot button and get a nice fresh and clean OS booted in your memory. Besides that, It is easy to maintain, solid, and all your hosts run on exactly the same software and configuration state (kernel, libs, Ceph, everything). -- Martin Verges Managing director Mobile: +4

[ceph-users] Re: ceph-ansible in Pacific and beyond?

2021-03-17 Thread Martin Verges
ncounter cluster that fall apart or have a meltdown just because they run out of memory and we use tricks like zram to help them out and recover their clusters. If I now go and do it per container/osd in a finer grained way, it will just blow up even more. -- Martin Verges Managing director Mobile:

[ceph-users] Re: ceph-ansible in Pacific and beyond?

2021-03-17 Thread Martin Verges
t a single one. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: ht

[ceph-users] Re: Email alerts from Ceph

2021-03-18 Thread Martin Verges
by adding a hook script within croit "onHealthDegrate" and "onHealthRecover" that notifies us using telegram/slack/... ;) -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 3

[ceph-users] Re: ceph-ansible in Pacific and beyond?

2021-03-18 Thread Martin Verges
> So no, I am not convinced yet. Not against it, but personally I would say it's not the only way forward. 100% agree to your whole answer -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Fresenius

[ceph-users] Re: Can I create 8+2 Erasure coding pool on 5 node?

2021-03-25 Thread Martin Verges
You can change the crush rule to be OSD instead of HOST specific. That way Ceph will put a chunk per OSD and multiple Chunks per Host. Please keep in mind, that will cause an outage if one of your hosts are offline. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver

[ceph-users] Re: How's the maturity of CephFS and how's the maturity of Ceph erasure code?

2021-03-31 Thread Martin Verges
e my confidence. Sorry I can't. But as Stefan Kooman wrote, "Best way is to find out for yourself and your use case(s) with a PoC cluster" We use it for our own stuff and customers of croit use it in lot of installations. However nothing is better then a PoC to gain more confidence. -- M

[ceph-users] Re: [Ceph-maintainers] v16.2.0 Pacific released

2021-04-01 Thread Martin Verges
pain for Debian users and if it's still possible we should try to avoid that. Is there something we could help to make it happen? -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 8124

[ceph-users] Re: RGW failed to start after upgrade to pacific

2021-04-05 Thread Martin Verges
do...@rgw.new-croit-host-C0DE01.service: Failed with result 'exit-code'. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com

[ceph-users] Re: Best distro to run ceph.

2021-05-01 Thread Martin Verges
free forever version. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-06-02 Thread Martin Verges
m ones, as they are often harder to debug. But of course we do it anyways :). To have a perfect storage, strip away anything unneccessary. Avoid any complexity, avoid anything that might affect your system. Keep it simply stupid. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: ma

[ceph-users] Re: Rolling upgrade model to new OS

2021-06-04 Thread Martin Verges
services will come up without a problem when you have all configs in place. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register

[ceph-users] Re: Connect ceph to proxmox

2021-06-05 Thread Martin Verges
Hello Szabo, you can try it with our docs at https://croit.io/docs/master/hypervisors/proxmox, maybe it helps you to connect your Ceph cluster to Proxmox. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-06-19 Thread Martin Verges
ou can turn to open source alternatives that are massively cheaper per IO and only minimally more expensive per GB. I therefore believe, stripping out overhead is also an important topic for the future of Ceph. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@c

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-06-22 Thread Martin Verges
are even problems with containers if you don't use version X from docker. That's what the past told us, why should it be better in the future with even more container environments. Have you tried running rancher on debian in the past? It breaks apart due to iptables or other stuff. -

[ceph-users] Re: Ceph with BGP?

2021-07-05 Thread Martin Verges
red supported clusters, we never encountered a BGP deployment in the field. It's always just the theoretical or testing where we hear from BGP. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Martin Verges
e to new temporary file in pool remove old file rename temp file to old file location -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-I

[ceph-users] Re: Migrating CEPH OS looking for suggestions

2021-09-30 Thread Martin Verges
Just PXE boot whatever OS you like at the time. If you need to switch to another, a reboot is enough to switch OS. It's even possible without containers, so absolute no problem at all. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit

[ceph-users] Re: RFP for arm64 test nodes

2021-10-11 Thread Martin Verges
. In addition put 2*25GbE/40GbE in the servers and you need only a few of them to simulate a lot. This would save costs, makes it easier to maintain, and you are much more flexible. For example running tests on different OS, injecting latency, simulating errors and more. -- Martin Verges Managing

[ceph-users] Re: Stretch cluster experiences in production?

2021-10-18 Thread Martin Verges
be a litte bit faster as well. We have quite some experience with that and can be of help if you need more details and vendor suggestions. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - V

[ceph-users] Re: Which verison of ceph is better

2021-10-18 Thread Martin Verges
Use pacific for new deployments. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io | YouTube: https

[ceph-users] Re: Open discussing: Designing 50GB/s CephFS or S3 ceph cluster

2021-10-21 Thread Martin Verges
active number to your liking. > From the perspective of getting the maximum bandwidth, which one should i choose, CephFS or Ceph S3? Choose what's best for your application / use case scenario. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerg

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-11-17 Thread Martin Verges
croit would happily support that. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io | YouTube: https:

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-11-17 Thread Martin Verges
ome super old release to Octopus to get them running again or have propper tooling to fix the issue. But I agree, we as croit are still afraid of pushing our users to Pacific, as we encounter bugs in our tests. This however will change soon, as we are close to a stable enough Pacific release as we

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-11-17 Thread Martin Verges
for public service. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: htt

[ceph-users] Re: Why you might want packages not containers for Ceph deployments

2021-11-17 Thread Martin Verges
s important. However when adding complexity, you endangering that. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgeric

[ceph-users] Re: how many developers are working on ceph?

2021-11-19 Thread Martin Verges
absolute no processes, personell or structure to be a support organization. Therefore companies like ours do the support around Ceph. -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges

[ceph-users] Re: Is ceph itself a single point of failure?

2021-11-22 Thread Martin Verges
not lose data, and to run even if one datacenter burns down without a downtime. But this all come with costs, sometimes quite high costs. Often it's cheaper to live with a short interruption or to build 2 separated systems than to get more nines to your availability on a single one. -- Mar

[ceph-users] Re: SATA SSD recommendations.

2021-11-22 Thread Martin Verges
As the price for SSDs is the same regardless of the interface, I would not invest so much money in a still slow and outdated platform. Just buy some new chassis as well and go NVMe. It adds only a little cost but will increase performance drastically. -- Martin Verges Managing director Mobile

[ceph-users] Re: Experience reducing size 3 to 2 on production cluster?

2021-12-11 Thread Martin Verges
. Leave min_size on 2 as well and accept the potential downtime! -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https

[ceph-users] Re: Cephadm is stable or not in product?

2022-03-07 Thread Martin Verges
Some say it is, some say it's not. Every time I try it, it's buggy as hell and I can destroy my test clusters with ease. That's why I still avoid it. But as you can see in my signature, I am biased ;). -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.

[ceph-users] Re: Migration Nautilus to Pacifi : Very high latencies (EC profile)

2022-05-15 Thread Martin Verges
on it should be faster than pacific. Maybe try to jump away from the pacific release into the unknown! -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. reg

[ceph-users] Re: Migration Nautilus to Pacifi : Very high latencies (EC profile)

2022-05-15 Thread Martin Verges
artin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io | YouTube: https://goo.gl/PGE1Bx On Sun, 15 May 2022 at

[ceph-users] Re: Dear Abby: Why Is Architecting CEPH So Hard?

2020-04-22 Thread Martin Verges
ed, please feel free to contact me and I will show you how we do it. We also have reseller options, maybe that's something for you. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247

[ceph-users] Re: Dear Abby: Why Is Architecting CEPH So Hard?

2020-04-22 Thread Martin Verges
the TCO even more and if you have a way, I would love to hear about it. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register

[ceph-users] Re: Dear Abby: Why Is Architecting CEPH So Hard?

2020-04-23 Thread Martin Verges
cheap but capable HDD node. I never saw a better offer for big fat systems on a price per TB and TCO. Please remember, there is no best node for everyone, this node is not the best or fastest out on the market and just an example ;) -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail

[ceph-users] Re: Data loss by adding 2OSD causing Long heartbeat ping times

2020-05-07 Thread Martin Verges
Hello XuYun, In my experience, I would always disable swap, it won't do any good. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE31063849

[ceph-users] Re: Cluster network and public network

2020-05-08 Thread Martin Verges
Hello Nghia, just use one network interface card and use frontend and backend traffic on the same. No problem with that. If you have a dual port card, use both ports as an LACP channel and maybe separate it using VLANs if you want to, but not required as well. -- Martin Verges Managing director

[ceph-users] Re: Ceph as a Fileserver for 3D Content Production

2020-05-17 Thread Martin Verges
Hello Moritz, drop the EVO disk and use a SSD that is working with Ceph. For example just use PM883 / PM983 from the same vendor and you will have a huge performance increase. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me

[ceph-users] Re: Ceph Nautius not working after setting MTU 9000

2020-05-24 Thread Martin Verges
t the maximum peak performance), then drop the MTU to default ;). Please if anyone has other real world benchmarks showing huge differences in regular Ceph clusters, please feel free to post it here. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https:/

[ceph-users] Re: looking for telegram group in English or Chinese

2020-05-26 Thread Martin Verges
Hello, as I find it a good idea and couldn't find another, I just created https://t.me/ceph_users. Please feel free to join and let's see to get this channel startet ;) -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/Ma

[ceph-users] Re: Octopus: orchestrator not working correctly with nfs

2020-06-11 Thread Martin Verges
Hello, you could use another deployment and management solution to have NFS and everything with ease. Take a look into https://croit.io/docs/croit/master/gateways/nfs.html#services how easy it would be to deploy NFS. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver

[ceph-users] Re: Ceph deployment and Managing suite

2020-06-13 Thread Martin Verges
Hello, take a look at croit.io, we believe to have the most sophisticated Ceph deployment and management solution. If something is missing, please let us know. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH

[ceph-users] Re: advantage separate cluster network on single interface

2020-06-17 Thread Martin Verges
network packet loss monitoring into our Ceph management solution to help customers track down their network issues. Therefore choosing a single network strongly increases your reliability and availability of your cluster. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver

[ceph-users] Re: OSD node OS upgrade strategy

2020-06-21 Thread Martin Verges
tricky and not suggested to inexperienced users. If you don't touch the Ceph disks at all, the service will come up again without anything to change from your side. Sometimes it's better to clean up some old mess and do it the way you currently work. -- Martin Verges Managing direct

[ceph-users] Re: Nautilus 14.2.10 mon_warn_on_pool_no_redundancy

2020-06-29 Thread Martin Verges
I agree, please check for min_size to cover min 1 max 2 configs as we have done in our software for our users since years. It is important and it can prevent lot's of issues. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinV

[ceph-users] Re: Monitor IPs

2020-07-15 Thread Martin Verges
Hello, just delete the old one and deploy a new one. Make sure to have a quorum (2 of 3 or 3 of 5) online while doing so. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO

[ceph-users] Re: I can just add 4Kn drives, not?

2020-08-06 Thread Martin Verges
Yes, no problem -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io

[ceph-users] Re: add debian buster stable support for ceph-deploy

2020-09-07 Thread Martin Verges
Hello, yes this is correct. Sorry for the inconvenience. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht

[ceph-users] Re: Choosing suitable SSD for Ceph cluster

2020-09-14 Thread Martin Verges
art. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo

[ceph-users] Re: NVMe's

2020-09-24 Thread Martin Verges
I did not see 10 cores, but 7 cores per osd over a long period on pm1725a disks with around 60k IO/s according to sysstat of each disk. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247

[ceph-users] Re: NVMe's

2020-09-24 Thread Martin Verges
PCIe PM1725a NVMe OSDs and 12 HDD OSDs). Unfortunately I have no console log output that would show more details like IO pattern. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich

[ceph-users] Re: rebalancing adapted during rebalancing with new updates?

2020-09-26 Thread Martin Verges
Without knowing the source code and just from my observations, I would say everytime the osd map changes, the crush/pgmap tries to fix that. However a running backfill is not stopped and only backfill_wait would be reconsidered. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail

[ceph-users] Re: Feedback for proof of concept OSD Node

2020-10-02 Thread Martin Verges
well. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://g

[ceph-users] Re: Comercial support - Brazil

2019-10-04 Thread Martin Verges
Hello Gesiel, we as croit do provide worldwide services in english but we are not located in brazil. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID

[ceph-users] Re: iSCSI write performance

2019-10-24 Thread Martin Verges
Hello, we did some local testing a few days ago on a new installation of a small cluster. Performance of our iSCSI implementation showed a performance drop of 20-30% against krbd. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me

[ceph-users] Re: Choosing suitable SSD for Ceph cluster

2019-10-24 Thread Martin Verges
drives, take a look at the uncached write latency. The lower the value is, the better will be the drive. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID

[ceph-users] Re: multiple pgs down with all disks online

2019-11-03 Thread Martin Verges
We had this with older Ceph versions, maybe just try to restart all OSDs of affected PGs. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID

[ceph-users] Re: Slow write speed on 3-node cluster with 6* SATA Harddisks (~ 3.5 MB/s)

2019-11-04 Thread Martin Verges
loads spinning media is never an option, use Flash! -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263

[ceph-users] Re: v13.2.7 mimic released

2019-11-27 Thread Martin Verges
. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl

[ceph-users] Re: v13.2.7 mimic released

2019-11-28 Thread Martin Verges
Hello, we (croit GmbH) are a founding member of the Ceph foundation and we build the packages from the official git repository to ship it with our own solution. However, we are not Ceph itself and so this is not an official mirror. -- Martin Verges Managing director Mobile: +49 174 9335695 E

[ceph-users] Re: Building a petabyte cluster from scratch

2019-12-03 Thread Martin Verges
.ceph.com/docs/master/dev/cephfs-snapshots/ If you do have questions or want some consulting to get the best Ceph cluster for the job. Please feel free to contact us. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges

[ceph-users] Re: High swap usage on one replication node

2019-12-07 Thread Martin Verges
have in a Server as it is very slow and can cause long downtimes. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht

[ceph-users] Re: High swap usage on one replication node

2019-12-08 Thread Martin Verges
. btw, all multiple hundred croit based ceph deployments are 100% swap free. As we boot over the network directly into the ram, there is no swap disk that would be available. We don't have any issues with this and I doubt we will ever encounter such. -- Martin Verges Managing director Mobile: +4

[ceph-users] Re: ceph mgr daemon multiple ip addresses

2019-12-09 Thread Martin Verges
There should be no issue and we have a lot of systems with multiple IPs. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register

[ceph-users] Re: Ceph on CentOS 8?

2019-12-13 Thread Martin Verges
assle, no pain, no OS trouble. It all comes to with absolutely no costs! -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. reg

[ceph-users] Re: Benchmark results for Seagate Exos2X14 Dual Actuator HDDs

2020-01-16 Thread Martin Verges
Hello, according to some prices we have heard so far, the Seagate dual actuator HDD will cost around 15-20% more than a single actuator. We can help with a good hardware selection if interested. -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph

[ceph-users] Re: Micron SSD/Basic Config

2020-01-31 Thread Martin Verges
. Before I think about 40 vs 25/50/100 GbE, I would reduce latency of these disks. -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://croit.io/training/4-days-ceph-in-depth-training. Mobile: +49 174 9335695 E-Mail:

[ceph-users] Re: Questions on Erasure Coding

2020-02-02 Thread Martin Verges
Hello Dave, you can configure Ceph to pick multiple OSDs per Host and therefore work like a classic raid. It will cause a downtime whenever you have to do maintenance on a system, but when you plan to grow it quite fast, it's maybe an option for you. -- Martin Verges Managing director

[ceph-users] Re: ceph positions

2020-02-03 Thread Martin Verges
Hello Frank, we are always looking for Ceph/Linux consultants. -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://croit.io/training/4-days-ceph-in-depth-training. Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io

[ceph-users] Re: EC Pools w/ RBD - IOPs

2020-02-13 Thread Martin Verges
than replica, but cost efficient and more then ok on most workloads. If you split generic VMs and Databases (or similar workloads), you can save a lot of money with EC. -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://cro

[ceph-users] Re: Performance of old vs new hw?

2020-02-18 Thread Martin Verges
Depends on your current SSDs and the new SSDs. It is highly likely that most performance increase will come from choosing good new NVMe. In addition higher clock frequency will increase IO as well but only if it is a bottleneck. -- Martin Verges Managing director Hint: Secure one of the last

[ceph-users] Re: Nautilus 14.2.8

2020-03-03 Thread Martin Verges
*cough* use croit to deploy your cluster, then you have a well tested OS+Ceph image and no random version change ;) *cough* -- Martin Verges Managing director Hint: Secure one of the last slots in the upcoming 4-day Ceph Intensive Training at https://croit.io/training/4-days-ceph-in-depth

[ceph-users] Re: Is there a better way to make a samba/nfs gateway?

2020-03-13 Thread Martin Verges
eph.8.html. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube:

[ceph-users] Re: Is there a better way to make a samba/nfs gateway? (Marc Roos)

2020-03-14 Thread Martin Verges
Hello Chad, starting with the Problems from lost connections with the kernel CephFS mount to a much simpler service setup, there are plenty. But what would be the point in stacking different tools (kernel mount, smb service,..) untested together just because you can? -- Martin Verges Managing

[ceph-users] Re: New 3 node Ceph cluster

2020-03-14 Thread Martin Verges
for object size, metadata when using cephfs? > Leave it by the defaults unless you know what special case you have. A lot of issues we see in the wild coming from bad configurations, copy pasted from a random page found on google. -- Martin Verges Managing director Mobile: +49 174 9335695 E-

[ceph-users] Re: New 3 node Ceph cluster

2020-03-15 Thread Martin Verges
This is too little memory. We have already seen MDS with well over 50 GB Ram requirements. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID

[ceph-users] Re: Questions on Ceph cluster without OS disks

2020-03-22 Thread Martin Verges
u boot 3 oder 300 nodes, all boot the exact same image in a few seconds. .. lots more Please do not hesitate to contact us directly. We always try to offer an excellent service and are strongly customer oriented. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@

  1   2   >