[DNG] install on a raid 1 array
Greetings When the parts get here I'm going to be installing Devuan testing on the system. I have not ever installed like this so first the configuration. Ryzen 7 3800X Asus TUF Gaming X570-Pro mobo 64 GB ram 2 - 1 TB M2 drives 2 - 1 TB SSDs I want to set the system up so that the drives are 2 sets of Raid-1 with (proposed) set 1 /efi, /boot, /, /usr, /usr/local, /var, swap set 2 /home How do I set up the raid arrays? Are they set up first and then the system is installed? Or do I set up what I want on one of each of the sets and the copy that setup to the second (of the set) and make it raid after system install? I can't seem to find anything done within the last 2 years talking about this. Don't see where it should be difficult but then - - - well I've thought that before() and had a boat load of male bovine excrement to wade through! (So I'm asking before doing to forestall issues - - - I hope!) TIA ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On Wed, 1 Jun 2022 16:34:21 -0500 o1bigtenor via Dng wrote: > Greetings > > When the parts get here I'm going to be installing Devuan testing on > the system. > > I have not ever installed like this so first the configuration. > > Ryzen 7 3800X > Asus TUF Gaming X570-Pro mobo > 64 GB ram > 2 - 1 TB M2 drives > 2 - 1 TB SSDs > > I want to set the system up so that the drives are 2 sets of Raid-1 with > (proposed) > set 1 > /efi, /boot, /, /usr, /usr/local, /var, swap > set 2 > /home > > How do I set up the raid arrays? They could be easily setup during installation process in the disk partitioning step if I recall it correctly. See https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot for more info (just the first part). > Are they set up first and then the system is installed? Yes, in the installer. > Or do I set up what I want on one of each of the sets and the copy > that setup to the second (of the set) and make it raid after system > install? No. > I can't seem to find anything done within the last 2 years talking about this. > Don't see where it should be difficult but then - - - well I've > thought that before() and had a boat load of male bovine excrement > to wade through! > (So I'm asking before doing to forestall issues - - - I hope!) > > TIA > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On Wed, Jun 1, 2022 at 4:57 PM tito via Dng wrote: > > On Wed, 1 Jun 2022 16:34:21 -0500 > o1bigtenor via Dng wrote: > > > Greetings > > > > When the parts get here I'm going to be installing Devuan testing on > > the system. > > > > I have not ever installed like this so first the configuration. > > > > Ryzen 7 3800X > > Asus TUF Gaming X570-Pro mobo > > 64 GB ram > > 2 - 1 TB M2 drives > > 2 - 1 TB SSDs > > > > I want to set the system up so that the drives are 2 sets of Raid-1 with > > (proposed) > > set 1 > > /efi, /boot, /, /usr, /usr/local, /var, swap > > set 2 > > /home > > > > How do I set up the raid arrays? > > They could be easily setup during installation process in the disk > partitioning step if I recall > it correctly. See https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > for more info (just the first part). Interesting - - - that wiki is current as of 2012. That's why I wasn't trusting the information - - - - the newest stuff I could find was some 3 or 4 years old and I've found that newer stuff has different gotchas than the older versions. The assumption is that LLVM is used on top of the array. (from the wiki) Is that necessary? (I've never used LLVM to date!) My idea was to partition the disks just like normal after the array was built. Is that possible? TIA ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
Hi, On Wed, 2022-06-01 at 17:16 -0500, o1bigtenor via Dng wrote: > On Wed, Jun 1, 2022 at 4:57 PM tito via Dng > wrote: > > > > On Wed, 1 Jun 2022 16:34:21 -0500 > > o1bigtenor via Dng wrote: > > > > > Greetings > > > > > > When the parts get here I'm going to be installing Devuan testing > > > on > > > the system. > > > > > > I have not ever installed like this so first the configuration. > > > > > > Ryzen 7 3800X > > > Asus TUF Gaming X570-Pro mobo > > > 64 GB ram > > > 2 - 1 TB M2 drives > > > 2 - 1 TB SSDs > > > > > > I want to set the system up so that the drives are 2 sets of > > > Raid-1 with > > > (proposed) > > > set 1 > > > /efi, /boot, /, /usr, /usr/local, /var, swap > > > set 2 > > > /home > > > > > > How do I set up the raid arrays? > > > > They could be easily setup during installation process in the disk > > partitioning step if I recall > > it correctly. See > > https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > > for more info (just the first part). > > Interesting - - - that wiki is current as of 2012. > That's why I wasn't trusting the information - - - - the newest stuff > I could find was > some 3 or 4 years old and I've found that newer stuff has different > gotchas than > the older versions. > > The assumption is that LLVM is used on top of the array. (from the > wiki) > Is that necessary? > (I've never used LLVM to date!) > > My idea was to partition the disks just like normal after the array > was built. > Is that possible? > I recently rebuilt my principal Devuan instance as a LVM2 on top of a mdadm RAID1 array. Previously I had three mdadm RAID1 arrays md0 (/ root), md1 (/home) and md2 Swap) on the two disks. I now have 1 mdadm RAID array with a LVM physical partition containing a logical volume group with / root /home and swap partitions in it. The advantage of LVM is that I can resize the partitions easily and I can also schedule backups from LVM snapshots, effectively off a consistent version of the live system. I also backed up the original / root and /home partitions and restored then to their new homes. The UUIDs hadn't even changed though obviously their location had (so fstab was OK). I chrooted into the new root to run update-grub and grub-install. Anyway as you can see you can do it either way I did it or you could, as you suggest, just have a normal set of partitions on your new RAID1 disk. NB. When I set up my original layout I did that as a new install using the Devuan installer in expert mode (this was soe years ago), albeit I then found the partitioning stage somewhat confusing as you have to first create identical linux-raid members on the two disks first and then assemble them into a raid array. -- Marjorie ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On Wed, Jun 01, 2022 at 05:16:05PM -0500, o1bigtenor via Dng wrote: > On Wed, Jun 1, 2022 at 4:57 PM tito via Dng wrote: > > > > On Wed, 1 Jun 2022 16:34:21 -0500 > > o1bigtenor via Dng wrote: > > > > > Greetings > > > > > > When the parts get here I'm going to be installing Devuan testing on > > > the system. > > > > > > I have not ever installed like this so first the configuration. > > > > > > Ryzen 7 3800X > > > Asus TUF Gaming X570-Pro mobo > > > 64 GB ram > > > 2 - 1 TB M2 drives > > > 2 - 1 TB SSDs > > > > > > I want to set the system up so that the drives are 2 sets of Raid-1 with > > > (proposed) > > > set 1 > > > /efi, /boot, /, /usr, /usr/local, /var, swap > > > set 2 > > > /home > > > > > > How do I set up the raid arrays? > > > > They could be easily setup during installation process in the disk > > partitioning step if I recall > > it correctly. See https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > > for more info (just the first part). > > Interesting - - - that wiki is current as of 2012. > That's why I wasn't trusting the information - - - - the newest stuff > I could find was > some 3 or 4 years old and I've found that newer stuff has different > gotchas than > the older versions. > > The assumption is that LLVM is used on top of the array. (from the wiki) > Is that necessary? > (I've never used LLVM to date!) > > My idea was to partition the disks just like normal after the array was built. > Is that possible? Yes, it is possible. I use LVM over RAID on my system because it offers more flexibility if I have to repartition. In fact, I have two separate RAID 1's -- one for partitions that are divided up the traditional way, and the other for partitions that are done with LVM. /boot is on the traditionally divided RAID. Back when I set it up, if /boot was on a RAID it had to be a RAID of the old format, not the new. I don't know if that still applies. And, LVM is the Logical Vomume Manager. LLVM is the Low Level Virtual Machine, used by some compilers (such as clang) in generating object code. -- hendrik > > TIA > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On 2022-06-01 19:07:24, Hendrik Boom wrote: > On Wed, Jun 01, 2022 at 05:16:05PM -0500, o1bigtenor via Dng wrote: > > On Wed, Jun 1, 2022 at 4:57 PM tito via Dng wrote: > > > > > > On Wed, 1 Jun 2022 16:34:21 -0500 > > > o1bigtenor via Dng wrote: > > > > > > > Greetings > > > > > > > > When the parts get here I'm going to be installing Devuan testing on > > > > the system. > > > > > > > > I have not ever installed like this so first the configuration. > > > > > > > > Ryzen 7 3800X > > > > Asus TUF Gaming X570-Pro mobo > > > > 64 GB ram > > > > 2 - 1 TB M2 drives > > > > 2 - 1 TB SSDs > > > > > > > > I want to set the system up so that the drives are 2 sets of Raid-1 with > > > > (proposed) > > > > set 1 > > > > /efi, /boot, /, /usr, /usr/local, /var, swap From memory /efi has to be read by the BIOS / UEFI, and has to be a FAT partition. It later gets mounted to /boot/efi. > > > > set 2 > > > > /home > > > > > > > > How do I set up the raid arrays? > > > > > > They could be easily setup during installation process in the disk > > > partitioning step if I recall > > > it correctly. See https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > > > for more info (just the first part). > > > > Interesting - - - that wiki is current as of 2012. > > That's why I wasn't trusting the information - - - - the newest stuff > > I could find was > > some 3 or 4 years old and I've found that newer stuff has different > > gotchas than > > the older versions. > > > > The assumption is that LLVM is used on top of the array. (from the wiki) > > Is that necessary? > > (I've never used LLVM to date!) > > > > My idea was to partition the disks just like normal after the array was > > built. > > Is that possible? > > Yes, it is possible. I use LVM over RAID on my system because it offers more > flexibility if I have to repartition. > > In fact, I have two separate RAID 1's -- one for partitions that are divided > up the traditional way, and the other for partitions that are done with LVM. > > /boot is on the traditionally divided RAID. Back when I set it up, if /boot > was on a RAID it had to be a RAID of the old format, not the new. I don't > know if that still applies. > > And, LVM is the Logical Vomume Manager. LLVM is the Low Level Virtual > Machine, used by some compilers (such as clang) in generating object code. > > -- hendrik Note that you can use mdadm, or LVM on top of mdadm. I stick with mdadm RAID on my server coz I don't need the extra flexibility, and it's less complex. -- A big old stinking pile of genius that no one wants coz there are too many silver coated monkeys in the world. ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On Thu, Jun 02, 2022 at 09:26:21AM +1000, onefang wrote: > On 2022-06-01 19:07:24, Hendrik Boom wrote: > > On Wed, Jun 01, 2022 at 05:16:05PM -0500, o1bigtenor via Dng wrote: > > > On Wed, Jun 1, 2022 at 4:57 PM tito via Dng wrote: > > > > > > > > On Wed, 1 Jun 2022 16:34:21 -0500 > > > > o1bigtenor via Dng wrote: > > > > > > > > > Greetings > > > > > > > > > > When the parts get here I'm going to be installing Devuan testing on > > > > > the system. > > > > > > > > > > I have not ever installed like this so first the configuration. > > > > > > > > > > Ryzen 7 3800X > > > > > Asus TUF Gaming X570-Pro mobo > > > > > 64 GB ram > > > > > 2 - 1 TB M2 drives > > > > > 2 - 1 TB SSDs > > > > > > > > > > I want to set the system up so that the drives are 2 sets of Raid-1 > > > > > with > > > > > (proposed) > > > > > set 1 > > > > > /efi, /boot, /, /usr, /usr/local, /var, swap > > From memory /efi has to be read by the BIOS / UEFI, and has to be a FAT > partition. It later gets mounted to /boot/efi. > > > > > > set 2 > > > > > /home > > > > > > > > > > How do I set up the raid arrays? > > > > > > > > They could be easily setup during installation process in the disk > > > > partitioning step if I recall > > > > it correctly. See > > > > https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > > > > for more info (just the first part). > > > > > > Interesting - - - that wiki is current as of 2012. > > > That's why I wasn't trusting the information - - - - the newest stuff > > > I could find was > > > some 3 or 4 years old and I've found that newer stuff has different > > > gotchas than > > > the older versions. > > > > > > The assumption is that LLVM is used on top of the array. (from the wiki) > > > Is that necessary? > > > (I've never used LLVM to date!) > > > > > > My idea was to partition the disks just like normal after the array was > > > built. > > > Is that possible? > > > > Yes, it is possible. I use LVM over RAID on my system because it offers > > more flexibility if I have to repartition. > > > > In fact, I have two separate RAID 1's -- one for partitions that are > > divided up the traditional way, and the other for partitions that are done > > with LVM. > > > > /boot is on the traditionally divided RAID. Back when I set it up, if > > /boot was on a RAID it had to be a RAID of the old format, not the new. I > > don't know if that still applies. > > > > And, LVM is the Logical Vomume Manager. LLVM is the Low Level Virtual > > Machine, used by some compilers (such as clang) in generating object code. > > > > -- hendrik > > Note that you can use mdadm, or LVM on top of mdadm. I stick with mdadm > RAID on my server coz I don't need the extra flexibility, and it's less > complex. mdadm is what I use for my RAIDs too, One has LVM on it; the other a normal partition. And I have another tiny partition on each disk, outside the RAID, in which i have a file whose name is the same as the label I've taped to the physical drive. This saves a lot of confusion when one of my physical drives is failing and I have to figure out which physical rive it is. -- hendrik > > -- > A big old stinking pile of genius that no one wants > coz there are too many silver coated monkeys in the world. > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
[DNG] NFS rookie mistake?
Here is the story: I needed to do some server maintenance so I issued $init 1. After the maintenance was done I issued $init 5. Everything was fine except no nfs-server-kernel running. No problem. Issue $sudo /etc/init.d/nfs-kernel-server restart System response: Stopping NFS kernel daemon: mountd nfsd. Unexporting directories for NFS kernel daemon Exporting directories for NFS kernel daemon Starting NFS kernel daemon: nfsd Not starting: portmapper is not running ... (warning). Problem to be investigated LATER. Issue $ /etc/init.d/rpcbind restart System response: Stopping RPC port mapper daemon: rpcbind. Starting RPC port mapper daemon: rpcbind. No problem. Try nfs server again. $sudo /etc/init.d/nfs-kernel-server restart System response: Stopping NFS kernel daemon: mountd nfsd. Unexporting directories for NFS kernel daemon Exporting directories for NFS kernel daemon Starting NFS kernel daemon: nfsd mountd. no problem. So, Now it is LATER. So obviously when I went to runlevel 1, rpcbind was stopped and didn't come back up when I went back to runlevel 5. Investigate: /etc$ sudo find . -name *nfs-kernel-server ./rc2.d/S04nfs-kernel-server ./rc0.d/K01nfs-kernel-server ./rc1.d/K01nfs-kernel-server ./default/nfs-kernel-server ./init.d/nfs-kernel-server ./rc3.d/S04nfs-kernel-server ./rc4.d/S04nfs-kernel-server ./rc6.d/K01nfs-kernel-server ./rc5.d/S04nfs-kernel-server Observation: nfs-kernel-server gets killed at 0,1,6 and gets started at runlevels 2-5 /etc$ sudo find . -name *rpcbind ./rc0.d/K06rpcbind ./rc1.d/K06rpcbind ./rcS.d/S17rpcbind ./default/rpcbind ./init.d/rpcbind ./rc6.d/K06rpcbind ./insserv.conf.d/rpcbind Observation: The only time rpcbind is brought up is at system start. RUNLEVEL 1 kills it. Conclusion: So either rpcbind shouldn't be killed at runlevel 1 or it should be started prior to nfs-kernel-server on runlevels 2-5. OR . I have no clue about something here. Regards, Ken ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
Hi TIA In der Nachricht vom Thursday, 2 June 2022 00:16:05 CEST steht: > My idea was to partition the disks just like normal after the array was > built. Is that possible? Yes, it's possible: You may set up a partionable md array. The installer does not offer partionable arrays, it just offers arrays of partions. Partionable arrays are built over the whole device and then the md device is partionned. With this, if a disk fails, you can just replace it without cloning the partition table fist. See man 8 mdadm under --auto mdp for a description. You can boot a live system prior to installing and set up your mdp array. I use grml since it has all tools onboard. Then start the installer and install Devuan. Your mdp device will appear in the partion manager. Add your partions as you like and install. Don't forget to tell your ext4 the correct settings for stride and stripe-width using tune2fs afterwards. I've just tested this in a VM with chimaera and it worked, The Installer created DOS disk labels, although I had previously written a GPT disk label to the mdp device. The reason might be my KVM doesn't have UEFI Support. I don't know if it is possible with GPT/UEFI, which was at times of ascii or jessie not working with mdp arrays, if I remember right. Regards, Adrian. BTW: I would combine one M2 and one SATA SSD to a RAID1 using the mdadm --write-mostly flag for the SATA drives. I like to have a fast /home aswell. BBTW: Another possibility would be to use btrfs instead of mdadm, which has built-in raid functionality. signature.asc Description: This is a digitally signed message part. ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] NFS rookie mistake?
Sorry, I pushed the wrong button and did not reply to list. Apologize. Is this related to http://kb.unixservertech.com/start/debugging/linux? Summary: NFS would not start after upgrade to Devuan Beowulf. Appears to be an issue with Debian. Looking in the logs, I saw '/run/rpcbind not owned by root failed' Solution: echo 'PATH="$PATH:/usr/bin"' >> /etc/default/rpcbind Read the (short) article if you want links and a little more info (it is my notes). Rod On 6/1/22 20:04, Ken Dibble wrote: Here is the story: I needed to do some server maintenance so I issued $init 1. After the maintenance was done I issued $init 5. Everything was fine except no nfs-server-kernel running. No problem. Issue $sudo /etc/init.d/nfs-kernel-server restart System response: Stopping NFS kernel daemon: mountd nfsd. Unexporting directories for NFS kernel daemon Exporting directories for NFS kernel daemon Starting NFS kernel daemon: nfsd Not starting: portmapper is not running ... (warning). Problem to be investigated LATER. Issue $ /etc/init.d/rpcbind restart System response: Stopping RPC port mapper daemon: rpcbind. Starting RPC port mapper daemon: rpcbind. No problem. Try nfs server again. $sudo /etc/init.d/nfs-kernel-server restart System response: Stopping NFS kernel daemon: mountd nfsd. Unexporting directories for NFS kernel daemon Exporting directories for NFS kernel daemon Starting NFS kernel daemon: nfsd mountd. no problem. So, Now it is LATER. So obviously when I went to runlevel 1, rpcbind was stopped and didn't come back up when I went back to runlevel 5. Investigate: /etc$ sudo find . -name *nfs-kernel-server ./rc2.d/S04nfs-kernel-server ./rc0.d/K01nfs-kernel-server ./rc1.d/K01nfs-kernel-server ./default/nfs-kernel-server ./init.d/nfs-kernel-server ./rc3.d/S04nfs-kernel-server ./rc4.d/S04nfs-kernel-server ./rc6.d/K01nfs-kernel-server ./rc5.d/S04nfs-kernel-server Observation: nfs-kernel-server gets killed at 0,1,6 and gets started at runlevels 2-5 /etc$ sudo find . -name *rpcbind ./rc0.d/K06rpcbind ./rc1.d/K06rpcbind ./rcS.d/S17rpcbind ./default/rpcbind ./init.d/rpcbind ./rc6.d/K06rpcbind ./insserv.conf.d/rpcbind Observation: The only time rpcbind is brought up is at system start. RUNLEVEL 1 kills it. Conclusion: So either rpcbind shouldn't be killed at runlevel 1 or it should be started prior to nfs-kernel-server on runlevels 2-5. OR . I have no clue about something here. Regards, Ken ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng -- Rod Rodolico Daily Data, Inc. POB 140465 Dallas TX 75214-0465 US https://dailydata.net 214.827.2170 ext 100 ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
Re: [DNG] install on a raid 1 array
On Wed, 1 Jun 2022 17:16:05 -0500 o1bigtenor via Dng wrote: > On Wed, Jun 1, 2022 at 4:57 PM tito via Dng wrote: > > > > On Wed, 1 Jun 2022 16:34:21 -0500 > > o1bigtenor via Dng wrote: > > > > > Greetings > > > > > > When the parts get here I'm going to be installing Devuan testing on > > > the system. > > > > > > I have not ever installed like this so first the configuration. > > > > > > Ryzen 7 3800X > > > Asus TUF Gaming X570-Pro mobo > > > 64 GB ram > > > 2 - 1 TB M2 drives > > > 2 - 1 TB SSDs > > > > > > I want to set the system up so that the drives are 2 sets of Raid-1 with > > > (proposed) > > > set 1 > > > /efi, /boot, /, /usr, /usr/local, /var, swap > > > set 2 > > > /home > > > > > > How do I set up the raid arrays? > > > > They could be easily setup during installation process in the disk > > partitioning step if I recall > > it correctly. See https://wiki.debian.org/DebianInstaller/SoftwareRaidRoot > > for more info (just the first part). > > Interesting - - - that wiki is current as of 2012. > That's why I wasn't trusting the information - - - - the newest stuff > I could find was > some 3 or 4 years old and I've found that newer stuff has different > gotchas than > the older versions. > > The assumption is that LLVM is used on top of the array. (from the wiki) > Is that necessary? > (I've never used LLVM to date!) No. > > My idea was to partition the disks just like normal after the array was built. > Is that possible? Yes. > TIA > ___ > Dng mailing list > Dng@lists.dyne.org > https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng ___ Dng mailing list Dng@lists.dyne.org https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng
