missing files from different formats of the .iso files
here's the truth table for debian-11.6.0 source .iso: present: o missing: x DLBD BD DVD file --- --- --- --- o x x pepperflashplugin-nonfree_1.8.8.dsc x o x frogatto_1.3.1+dfsg-5.dsc x o x openjazz_20190106-3.dsc x o x torbrowser-launcher_0.3.3-6.dsc o o x alien-arena_7.66+dfsg-6.dsc x x o cbedic_4.0-4.diff.gz x x o crafty-bitmaps_1.0-1.debian.tar.gz x x o esix_1-3.dsc x x o freespace2-launcher-wxlauncher_0.11.0+dfsg-3.debian.tar.xz x x o game-data-packager_67.dsc x x o hts-voice-nitech-jp-atr503-m001_1.05-5.dsc x x o lutris_0.5.8.3-2.dsc x x o magma_2.5.4+ds-3.debian.tar.xz x x o nvidia-settings-legacy-390xx_390.144-1.dsc x x o openjazz_20190106-3.dsc x x o publicfile-installer_0.15.dsc x x o r4d_1.7-1.debian.tar.xz x x o spectemu_0.94a-20.dsc x x o thunar-dropbox-plugin_0.3.1-1.dsc x x o torbrowser-launcher_0.3.3-6.dsc x x o vmware-manager_0.2.0-4.dsc is there a reason for these few files being missing, depending on which format the .iso is in? i can't help but feel i'm missing something obvious for why the formats slightly differ in content missing: DLBD -> BD BD1 none BD2 /debian/pool/contrib/f/frogatto/frogatto_1.3.1+dfsg-5.dsc BD3 /debian/pool/contrib/o/openjazz/openjazz_20190106-3.dsc BD4 /debian/pool/contrib/t/torbrowser-launcher/torbrowser-launcher_0.3.3-6.dsc DLBD -> DVD DVD1/debian/pool/contrib/a/alien-arena/alien-arena_7.66+dfsg-6.dsc DVD2/debian/pool/contrib/c/cbedic/cbedic_4.0-4.diff.gz DVD3/debian/pool/contrib/c/crafty-bitmaps/crafty-bitmaps_1.0-1.debian.tar.gz DVD4/debian/pool/contrib/e/esix/esix_1-3.dsc DVD5 /debian/pool/contrib/f/freespace2-launcher-wxlauncher/freespace2-launcher-wxlauncher_0.11.0+dfsg-3.debian.tar.xz DVD6/debian/pool/contrib/g/game-data-packager/game-data-packager_67.dsc DVD7 /debian/pool/contrib/h/hts-voice-nitech-jp-atr503-m001/hts-voice-nitech-jp-atr503-m001_1.05-5.dsc DVD8/debian/pool/contrib/l/lutris/lutris_0.5.8.3-2.dsc DVD9/debian/pool/contrib/m/magma/magma_2.5.4+ds-3.debian.tar.xz DVD10 /debian/pool/contrib/n/nvidia-settings-legacy-390xx/nvidia-settings-legacy-390xx_390.144-1.dsc DVD11 /debian/pool/contrib/o/openjazz/openjazz_20190106-3.dsc DVD12 /debian/pool/contrib/p/publicfile-installer/publicfile-installer_0.15.dsc DVD13 /debian/pool/contrib/r/r4d/r4d_1.7-1.debian.tar.xz DVD14 /debian/pool/contrib/s/spectemu/spectemu_0.94a-20.dsc DVD15 /debian/pool/contrib/t/thunar-dropbox-plugin/thunar-dropbox-plugin_0.3.1-1.dsc DVD16 /debian/pool/contrib/t/torbrowser-launcher/torbrowser-launcher_0.3.3-6.dsc DVD17 /debian/pool/contrib/v/vmware-manager/vmware-manager_0.2.0-4.dsc BD -> DVD DVD1/debian/pool/contrib/a/alien-arena/alien-arena_7.66+dfsg-6.dsc DVD2/debian/pool/contrib/c/cbedic/cbedic_4.0-4.diff.gz DVD3/debian/pool/contrib/c/crafty-bitmaps/crafty-bitmaps_1.0-1.debian.tar.gz DVD4/debian/pool/contrib/e/esix/esix_1-3.dsc DVD5 /debian/pool/contrib/f/freespace2-launcher-wxlauncher/freespace2-launcher-wxlauncher_0.11.0+dfsg-3.debian.tar.xz DVD6/debian/pool/contrib/g/game-data-packager/game-data-packager_67.dsc DVD7 /debian/pool/contrib/h/hts-voice-nitech-jp-atr503-m001/hts-voice-nitech-jp-atr503-m001_1.05-5.dsc DVD8/debian/pool/contrib/l/lutris/lutris_0.5.8.3-2.dsc DVD9/debian/pool/contrib/m/magma/magma_2.5.4+ds-3.debian.tar.xz DVD10 /debian/pool/contrib/n/nvidia-settings-legacy-390xx/nvidia-settings-legacy-390xx_390.144-1.dsc DVD11 /debian/pool/contrib/o/openjazz/openjazz_20190106-3.dsc DVD12 /debian/pool/contrib/p/publicfile-installer/publicfile-installer_0.15.dsc DVD13 /debian/pool/contrib/r/r4d/r4d_1.7-1.debian.tar.xz DVD14 /debian/pool/contrib/s/spectemu/spectemu_0.94a-20.dsc DVD15 /debian/pool/contrib/t/thunar-dropbox-plugin/thunar-dropbox-plugin_0.3.1-1.dsc DVD16 /debian/pool/contrib/t/torbrowser-launcher/torbrowser-launcher_0.3.3-6.dsc DVD17 /debian/pool/contrib/v/vmware-manager/vmware-manager_0.2.0-4.dsc BD -> DLBD DLBD1 none DLBD2 /debian/pool/contrib/p/pepperflashplugin-nonfree/pepperflashplugin-nonfree_1.8.8.dsc DVD -> DLBD DLBD1 none DLBD2 /debian/pool/contrib/p/pepperflashplugin-nonfree/pepperflashplugin-nonfree_1.8.8.dsc DVD -> BD BD1 /debian/pool/contrib/a/alien-arena/alien-arena_7.66+dfsg-6.dsc BD2 /debian/pool/contrib/f/frogatto/frogatto_1.3.1+dfsg-5.dsc BD3 /debian/pool/contrib/o/openjazz/openjazz_20190106-3.dsc BD4 /debian/pool/contrib/t/torbrowser-launcher/torbrowser-launcher_0.3.3-6.dsc
Re: missing files from different formats of the .iso files
i figured this out. i think. there's a bug in jigdo that makes it occasionally skip files from the source and then it will request the online source. i'm not sure why. obviously there's no missing files depending on the format, which is why i didn't get a response from anyone. On Fri, 21 Apr 2023 at 19:29, griffin tucker < debianeidiaen24...@griffintucker.id.au> wrote: > here's the truth table for debian-11.6.0 source .iso: > > present: o > missing: x > > DLBD BD DVD file > --- --- --- --- > o x x pepperflashplugin-nonfree_1.8.8.dsc > x o x frogatto_1.3.1+dfsg-5.dsc > x o x openjazz_20190106-3.dsc > x o x torbrowser-launcher_0.3.3-6.dsc > o o x alien-arena_7.66+dfsg-6.dsc > x x o cbedic_4.0-4.diff.gz > x x o crafty-bitmaps_1.0-1.debian.tar.gz > x x o esix_1-3.dsc > x x o freespace2-launcher-wxlauncher_0.11.0+dfsg-3.debian.tar.xz > x x o game-data-packager_67.dsc > x x o hts-voice-nitech-jp-atr503-m001_1.05-5.dsc > x x o lutris_0.5.8.3-2.dsc > x x o magma_2.5.4+ds-3.debian.tar.xz > x x o nvidia-settings-legacy-390xx_390.144-1.dsc > x x o openjazz_20190106-3.dsc > x x o publicfile-installer_0.15.dsc > x x o r4d_1.7-1.debian.tar.xz > x x o spectemu_0.94a-20.dsc > x x o thunar-dropbox-plugin_0.3.1-1.dsc > x x o torbrowser-launcher_0.3.3-6.dsc > x x o vmware-manager_0.2.0-4.dsc > > is there a reason for these few files being missing, depending on > which format the .iso is in? > > i can't help but feel i'm missing something obvious for why the > formats slightly differ in content >
Re: missing files from different formats of the .iso files
hi, On Sun, 18 Jun 2023 at 18:24, Thomas Schmitt wrote: > > Hi, > > griffin tucker wrote: > > there's a bug in jigdo that makes it occasionally skip files > > In that case the missing files woule be present but filled with zeros > when you mount the incompletely composed ISO. > Can you confirm ? > sorry, i must've misexplained; the .iso's are made from the same version, but a different format, (eg. between DVD, BD, and DLBD) jigdo-lite runs in batch mode, and usually the reconstruction of the first .iso is completely reconstructed from a directory of mounted .iso's from another format, however, the next few .iso's will consistently have 1 file missing that it couldn't find from the mounted .iso's, when it should, and i am unable to determine the pattern or reason for this jigdo-lite will write everything except that missing file which is written with 0's, then request an online source, which it does successfully, then it fills in the 0's and verifies the md5 also successfully there is no corruption to the reconstructed .iso's. > > Not picking a file of a jigdo image may have various reasons. > Temporary download problems should become visible by error messages. > Consider to catch the output of jigdo-lite in a file for inspection. > > Persistent problems could be (possibly among others): > > - File is missing on the chosen Debian mirror. > > In this case it is supposed to be fetched from fallback servers which > are mentioned at the end of the .jigdo file: > > $ gunzip > T__clXB4rmLIbFvoblKNqA=Debian:pool/main/b/bin-prot/bin-prot_0.14.0-1.debian.tar.xz > > [Servers] > Debian=http://us.cdimage.debian.org/cdimage/snapshot/Debian/ > Debian=http://snapshot.debian.org/archive/debian/20221218T124218Z/ > --try-last > > Assuming that bin-prot_0.14.0-1.debian.tar.xz would be missing, you > could check by a web browser whether > > http://us.cdimage.debian.org/cdimage/snapshot/Debian/pool/main/b/bin-prot/bin-prot_0.14.0-1.debian.tar.xz > exists. > > > - The checksum of the file in .jidgo does not match the checksum of the > file on the mirror server. > > The checksum is listed in .jigdo before the '=', encoded in a variant of > base64. > For decoding append enough "=" to get a number of characters which is > divisible by 4, replace "-" and "_" by their base64 equivalents, decode > base64, format to hex, and remove od's decorations: > > $ echo 'T__clXB4rmLIbFvoblKNqA'== | sed -e 's/-/+/g' -e 's/_/\//g' | > base64 -d | od -t x1 | sed -e 's/^...//' -e 's/ //g' > 4fffdc957078ae62c86c5be86e528da8 > > In this case the checksum is MD5. Expect to see SHA256 in newer .jigdo. > i look forward to the sha256 or sha512 implementation > > > from the source > > and then it will request the online source. i'm not sure why. > > What is the difference between "the source" and "the online source" ? > I'd normally expect that all jigdo sources of files are online. > Do you have your own local Debian mirror or a set of older ISOs ? > no local mirror, just a set of the same version of debian in a different format, as explained above i tried with v12.0.0 source this time, and got similar results i'm running it in a virtual machine, if that makes a difference (afaik, it shouldn't) > > Have a nice day :) > likewise > Thomas >
UHD-BD
hi, are there any plans to introduce triple-layer blu-rays for debian? it'd be nice to have everything fit (currently just over 80gb) in one .iso9660 file even if it's just the .jigdo files and hashes that are distributed, it'd be nice to have this as an official .iso9660 file for security/hashing purposes when debian grows to over 100gb, i'd expect yet another single-file option, if the community agrees thoughts? --griffin
Re: UHD-BD
very useful, thanks thomas not just useful for debian or linux distros, but any consecutively named .iso9660 files On Thu, 27 Jul 2023 at 19:21, Thomas Schmitt wrote: > > Hi, > > griffin tucker wrote: > > are there any plans to introduce triple-layer blu-rays for debian? > > I guess not: > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1011343 > > But there is a workaround: > https://wiki.debian.org/MergeDebianIsos > > Possibly it is not yet tested with Debian 12. So reports about success or > failure would be welcome. > > > Have a nice day :) > > Thomas >
