[CentOS] distributed storage/home-made cloud recommendations
Hello listmates, This is not specifically CentOS-related - though I will probably execute this design on CentOS if I decide to do so. It will certainly be some kind of Linux. At any rate, here's my situation. I would like to build a fairly large storage solution (let us say, 100 TB). I want this solution to be distributed and redundant. I want to be able to lose part of the machines involved and still stay operational (the bigger part, the better). I would prefer to avoid having to buy large servers to accomplish this task. What I am soliciting here is thoughts, reports from experience, recommendations, etc. Thanks in advance. Boris. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Building CentOS 6.2 custom install media
On Fri, Feb 3, 2012 at 11:54 AM, Karanbir Singh wrote: > We only use that scripts included in the anaconda-runtime stack - I'm > away to Fosdem this weekend ( are you guys around ? ) back in town on > Monday, would love to help you guys make this transition. > > Essentially, the repo included on disk/in-media/in-mirror is a snapshot > in time from the buildsys, with a bunch of tests run against it and an > install image built around it. Depending on what you are trying to do > and what the most desirable goal might be, I'll be happy to help build a > process for that. Thanks for the warm welcome and quick response! Have fun at FOSDEM, unfortunately I don't think anyone from OLPC will be there. I guess you're referring to the install DVD(s) here - which include the entire contents of the mirror, makes sense. In this case I think we want something more akin the minimal install CD - a specific subset of the packages available, plus installer. Could you point me towards the scripts used to build that? To answer your question about the most desirable goal, I guess it is something like this: we provide a kickstart file that lists the CentOS repos and our own repo, with the "base" and "core" package groups selected (plus our own packages listed too), and then we use a tool to then download all the required packages (but no more), and compose them onto an anaconda-based install CD. I guess I have just described pungi there - and maybe that is our answer. But I have yet to find a report of someone using pungi to rebuild C6, and pungi is not included in RHEL/CentOS and isn't in EPEL either. I'd welcome your input on the best way to achieve this. Thanks, Daniel ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] distributed storage/home-made cloud recommendations
Boris Epstein writes: > Hello listmates, > > This is not specifically CentOS-related - though I will probably execute > this design on CentOS if I decide to do so. It will certainly be some kind > of Linux. > > At any rate, here's my situation. I would like to build a fairly large > storage solution (let us say, 100 TB). I want this solution to be > distributed and redundant. I want to be able to lose part of the machines > involved and still stay operational (the bigger part, the better). I would > prefer to avoid having to buy large servers to accomplish this task. > > What I am soliciting here is thoughts, reports from experience, > recommendations, etc. > > Thanks in advance. > > Boris. Hello Boris, I'm in a similar search for a scalable and resilient solution. So far I like glusterfs, relatively easy to setup, no meta-server required, decent performance, but I haven't tested it thoroughly. Been playing with their latest beta release in a raid0+1 setup; haven't managed to lose any data yet. I'll also be interested in opinions from other people. -- Nux! www.nux.ro ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] distributed storage/home-made cloud recommendations
Hi, I'm happily running moosefs (packages available in rpmforge repo) for a year and a half, 120TB, soon 200. So easy to setup and grow it's indecent :) Laurent. pgpVVykG4B19E.pgp Description: PGP signature ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] distributed storage/home-made cloud recommendations
> > > Hello Boris, > > I'm in a similar search for a scalable and resilient solution. So far I > like > glusterfs, relatively easy to setup, no meta-server required, decent > performance, but I haven't tested it thoroughly. Been playing with their > latest beta release in a raid0+1 setup; haven't managed to lose any data > yet. > > I'll also be interested in opinions from other people. > > -- > Nux! > www.nux.ro > > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos Nux, Thanks for your response. I have looked into glusterfs and I like it too. I just haven't found the hardware to try it on. What is RAID0+1? The flat RAID with one parity disk? Boris. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Building CentOS 6.2 custom install media
On Sat, Feb 4, 2012 at 10:28 AM, Daniel Drake wrote: > > > To answer your question about the most desirable goal, I guess it is > something like this: we provide a kickstart file that lists the CentOS > repos and our own repo, with the "base" and "core" package groups > selected (plus our own packages listed too), and then we use a tool to > then download all the required packages (but no more), and compose > them onto an anaconda-based install CD. > > I guess I have just described pungi there - and maybe that is our > answer. But I have yet to find a report of someone using pungi to > rebuild C6, and pungi is not included in RHEL/CentOS and isn't in EPEL > either. I'd welcome your input on the best way to achieve this. Would the revisor tool from Scientific Linux work to spin CentOS? http://www.scientificlinux.org/distributions/6x/build/sites -- Les Mikesell lesmikes...@gmail.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] distributed storage/home-made cloud recommendations
On Sat, Feb 4, 2012 at 11:41 AM, Laurent Wandrebeck wrote: > Hi, > > I'm happily running moosefs (packages available in rpmforge repo) for a > year and a half, 120TB, soon 200. So easy to setup and grow it's > indecent :) > > Laurent. > > ___ > CentOS mailing list > CentOS@centos.org > http://lists.centos.org/mailman/listinfo/centos > > Hello Laurent, Thanks! Very useful info, I never even heard of MooseFS and it sounds very nice. One question: what happens if you lose your master server in their designation? Or is it possible to make the master server redundant as well? Boris. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] install detecting disk as sdb not sda
wwp writes: > > Hello Ross, > > On Fri, 3 Feb 2012 16:01:53 -0500 Ross Walker wrote: > > > On Feb 3, 2012, at 1:34 PM, wwp wrote: > > > > > Hello Jerry, > > > > > > > > > On Fri, 03 Feb 2012 12:24:14 -0500 Jerry Geis wrote: > > > > > >> I am trying to install 6.2 on a machine. > > >> Doing " dmesg | grep sda" does say SCSI removable disk. > > >> > > >> So how can I tell linux to NOT include that when installing? > > > > > > > You can try disabling USB disk support in the bios. > > Right, but I can't make such settings permanent, as I need to boot from > a USB disk from time to time, thus, entering BIOS and changing settings > costs more than unplugging stuff . > > An aspect of the problem w/ that behaviour change introduced w/ recent > kernel updates, is that some mount mapping tables (fstab for instance) > are broken if they rely on mount order (sda, hda, etc.) instead of > device ID or label. > > Regards, > This seems to be BIOS dependent. I use an external USB hard disk as my portable computer. On my personal laptop the external drive shows up as /dev/sdb even if I boot from the external. If I recall correctly, it's /dev/sda on my work laptop. Doing mounts using UUIDs means everything "just works" regardless of drive lettering. Bottom line is play with the BIOS settings. You may find a combination that gets you the right drive letters and lets you boot from the USB when you need to. On the other hand, my personal laptop BIOS "forgets" about the boot from external USB drive if I boot with the drive not present. I have to go into the BIOS and reset to boot from external the next time I try to use it. Cheers, Dave ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Double Copies Double Copies [SOLVED] itself
On 02/04/2012 07:06 AM, Darr247 wrote: > On Saturday, February 04, 2012 @00:44 UTC, > Ljubomir Ljubojevic spake thusly: > >> As far as I can see, it looks like your Windows Mail client made a >> copy of those 4 mails. You can notice that duplicates do not have >> "Account" information (last/right column), so they look like ghosts, >> not belonging to any account. > > That's nice, but I just scrolled back up through 2 months of messages in here > and those were the only 4. > > What a coincidence they appeared just as Mark mentioned seeing some dupes. > > Why don't any of you tell Reindl to stop replying to the emails CC'd to him > and reply to the list instead, by the way? Oh, I thought you were the OP. Wasn't looking, sorry. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] a cloud VM under CentOS
Hello everyone, Does anyone know if it is possible to construct a cloud of sorts out of several CentOS machines so as to enable a VM (or several VM's) that would run on top of that cloud and have failover capability? Boris. ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] distributed storage/home-made cloud recommendations
Boris Epstein writes: >> >> >> Hello Boris, >> >> I'm in a similar search for a scalable and resilient solution. So far I >> like >> glusterfs, relatively easy to setup, no meta-server required, decent >> performance, but I haven't tested it thoroughly. Been playing with their >> latest beta release in a raid0+1 setup; haven't managed to lose any data >> yet. >> >> I'll also be interested in opinions from other people. >> >> -- >> Nux! >> www.nux.ro >> >> >> ___ >> CentOS mailing list >> CentOS@centos.org >> http://lists.centos.org/mailman/listinfo/centos > > > > Nux, > > Thanks for your response. I have looked into glusterfs and I like it too. I > just haven't found the hardware to try it on. I "tested" it on 4 VMs.. The performance was crap as expected, but wanted to see how it behaves when I suddenly remove a node from the setup and so on. (it went well, the setup froze for a second but after that kept working at normal parameters) > > What is RAID0+1? The flat RAID with one parity disk? No, I should've rephrased this, I meant the likes of raid10, of course, in Glusterfs "speak". Basically I had 2 pairs of replicated nodes and files stripped across all this. I even ran a VM on top of this VM based glusterfs setup.. not the speediest VM, but was usable. :-) -- Nux! www.nux.ro ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] configure network bridge listing bridged intefaces
On Feb 3, 2012, at 11:56 PM, Robert Spangler wrote: > On Friday 03 February 2012 09:10, the following was written: > >> On 02/03/2012 08:07 AM, Mihamina Rakotomandimby wrote: >>> Hi all, >>> >>> Having a 4 NIC server, I want to bridge eth2 and eth3, with a bridge >>> named br0. >>> >>> Searching the web I only found about creating a file >>> /etc/sysconfig/network-scripts/ifcfg-br0, but did not find where to >>> explicitely list what ports will be bridged. >>> >>> Where is it configured? >>> >>> Thank you. >> >> All packets appear on both interfaces, unless you use ebtables/iptables to >> restrict them. > > Really? Only hubs present packets to all interfaces. Linux work as a router > not a hub. It would be intetesting to know if the bridging in Linux is routed, switched or repeated. It would be nice if it were switched, but I suspect it's repeated (like a hub). -Ross ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] CentOS 6.2 New Kernel Issues
CentOS 6.2 Community / Developers, Are there any known issues with the latest Kernel on CentOS 6.2? I performed a yum update and the kernel downloaded. When the system rebooted I started having intermittent latency issues when trying to perform certain commands on the system such as top or ls -ltr, etc. I was having extreme latency getting to root. I am unsure if there is a hardware compat issue but I found my server in kernel PANIC mode the next day and was unable to login entirely. Has this been reported before? ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] mysql won't start with service, but starts with mysqld_safe
Just installed mysql on centos 6.2. When I try to start it with service I get: #service mysqld start MySQL Daemon failed to start. Starting mysqld: [FAILED] Nothing at all is written to the error log. But if I start it with mysqld_safe it comes up and works fine. Anyone know what's going on here? -larry ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] configure network bridge listing bridged intefaces
On 02/03/2012 11:56 PM, Robert Spangler wrote: > On Friday 03 February 2012 09:10, the following was written: > >> On 02/03/2012 08:07 AM, Mihamina Rakotomandimby wrote: >> > Hi all, >> > >> > Having a 4 NIC server, I want to bridge eth2 and eth3, with a bridge >> > named br0. >> > >> > Searching the web I only found about creating a file >> > /etc/sysconfig/network-scripts/ifcfg-br0, but did not find where to >> > explicitely list what ports will be bridged. >> > >> > Where is it configured? >> > >> > Thank you. >> >> All packets appear on both interfaces, unless you use ebtables/iptables to >> restrict them. > Really? Only hubs present packets to all interfaces. Linux work as a router > not a hub. > A network bridge connects multiple network segments at the data link layer (Layer 2) of the OSI model. In Ethernet networks, the term bridge formally means a device that behaves according to the IEEE 802.1D standard. A bridge and a switch are very much alike; a switch being a bridge with numerous ports. Switch or Layer 2 switch is often used interchangeably with bridge. -- Stephen Clark *NetWolves* Director of Technology Phone: 813-579-3200 Fax: 813-882-0209 Email: steve.cl...@netwolves.com http://www.netwolves.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] a cloud VM under CentOS
On 02/04/2012 06:15 PM, Boris Epstein wrote: > Hello everyone, > > Does anyone know if it is possible to construct a cloud of sorts out of > several CentOS machines so as to enable a VM (or several VM's) that would > run on top of that cloud and have failover capability? > > Boris. I suppose this might fit your needs, on a small scale; https://alteeve.com/w/2-Node_Red_Hat_KVM_Cluster_Tutorial -- Digimer E-Mail: digi...@alteeve.com Papers and Projects: https://alteeve.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
