[gentoo-user] Re: Fast checksumming of whole partitions
On 06/05/2010 09:39 AM, meino.cra...@gmx.de wrote: Hi, this night dd copies the contents of my first 1TB disk to my second 1TB disk (same Model). (dd if=/devsda of=/dev/sdb bs=4096) I want to verify, that the copy is identical. I tried (or: I am still trying) to checksum the first disk with whirlpooldeep /dev/sda whch seems to work but is DAMN slow (in relation to checksumming 1TB in whole). Is there any faster and reliable way to checksum whole paritions (not on "per file" base)??? Thank you very much in advance for any help! Best regards, mcc Constructing a checksum means reading every byte off the partition. So it's slower as a copy to /dev/null, never faster (because the checksum calculation also needs time.) So in order to determine whether it's really slow, compare the time needed to dd the whole partition to /dev/null to the time needed for checksumming it. Then post the times here and an expert might then tell whether this can be improved at all or not.
Re: [gentoo-user] Fast checksumming of whole partitions
> Is there any faster and reliable way to checksum > whole paritions (not on "per file" base)??? It depends on where your bottleneck is... If you're cpu-bound you can try with a faster hash: md5sum or even md4sum would be a good choice (collision resistance is irrelevant in this application). On the other hand, if you're limited by disk throughput (which is most likely) there is not much you can do. After all, you have to read the data in order to hash it, and that takes time. andrea
[gentoo-user] Re: [OT sphinx] Any users of sphinx here
On Fri, 04 Jun 2010 17:52:05 -0500, Harry Putnam wrote: > Googling lead to a tool called Sphinx that apparently is coupled with a > data base tool like mysql. It is advertised as the kind of search tool > I'm after and has a perl front-end also available in portage > (dev-perl/Sphinx-Search). > > The call it a `full text search engine', but never really say what that > means. It means that you can dump a lot of text "documents" into it (based on html pages, database records, actual documents, etc). sphinx efficiently indexes all the text in it, and then allows you to retrieve it again, supporting things that are useful for searching in text such as stemming. It can use MySQL but this isn't needed to use it. It should be able to help you with the task you want to solve, although I'm not familiar with the capabilities of the Sphinx-Search front-end/ binding. Kind regards, Hans
Re: [gentoo-user] Re: One hard drive much slower for some reason.
You could still be looking at a hardware failure situation here. I have seen hard drives with absolutely perfect SMART attributes pass all the tests but still show the classic signs of a hard drive beginning to fail. A significant slowdown is one of those signs. What I would suggest is that you find some way to observe the hard drive over a long period of time at considerable load. If there is a problem, eventually it will show up in the SMART attributes. It's not an ideal solution, and your problem may not be hardware failure, but it would be a good idea to rule that out before pursuing any other diagnostic methodologies.
Re: [gentoo-user] Re: One hard drive much slower for some reason.
Dan Cowsill wrote: You could still be looking at a hardware failure situation here. I have seen hard drives with absolutely perfect SMART attributes pass all the tests but still show the classic signs of a hard drive beginning to fail. A significant slowdown is one of those signs. What I would suggest is that you find some way to observe the hard drive over a long period of time at considerable load. If there is a problem, eventually it will show up in the SMART attributes. It's not an ideal solution, and your problem may not be hardware failure, but it would be a good idea to rule that out before pursuing any other diagnostic methodologies. That's my thoughts. It about has to be hardware at this point. The other drive on the same cable is doing fine. It's not like I picked the wrong driver in the kernel, the other drive would be slow to if that was the case. The drive is pretty old to. Of course, it's not as old as the others but it is a different brand too. Thinking about getting a new 1Tb drive. ;-) Dale :-) :-)
Re: [gentoo-user] Re: problems with rsync (emerge --sync)
On Friday 04 June 2010 08:37:00 Mick wrote: > On Thursday 03 June 2010 19:55:29 walt wrote: > > On 06/03/2010 05:43 AM, Rod wrote: > > > Hi, has anyone had this problem with trying to update the database > > > for portage? > > > > > > It was doing this a while ago, then it stopped (I don't know why) now > > > its doing it again.. > > > > > > # emerge --sync > > > > > > >>> Starting rsync with rsync://91.186.30.235/gentoo-portage... > > > >>> Checking server timestamp ... > > > > > > timed out > > > > If you don't specify a list of mirrors you want, portage will rotate > > randomly through its list. You'll probably get better results if you > > pick a handful of servers that are close to you and not overloaded. > > Emerge mirrorselect and see if you can get better servers. > > I'm also getting this. Initially I thought that DNS could not resolve for > some ISP related reason, but it is more involved than that. It seems like > a $SYNC not a $GENTOO_MIRRORS problem. > > I changed the rsync.europe.gentoo.org to rsync.de.gentoo.org and rsync > worked. So, could it be that something is wrong with the way the rsync > rsync.europe mirrors are meant to be rotated? Any progress with this guys? Should we be filling in a bug report? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] One hard drive much slower for some reason.
Hi Dale, On Thu, Jun 3, 2010 at 5:46 AM, Dale wrote: > > Here is that info. I included all the IDE drives. Sort of see if there is > something different about them. > > smoker-new ~ # smartctl -A /dev/hda > 5 Reallocated_Sector_Ct 0x0033 253 253 063 Pre-fail Always > - 0 > 7 Seek_Error_Rate 0x000a 253 252 000 Old_age Always > - 0 > 9 Power_On_Minutes 0x0032 210 210 000 Old_age Always > - 1025h+05m > 199 UDMA_CRC_Error_Count 0x0008 199 196 000 Old_age Offline > - 3 > > smoker-new ~ # smartctl -A /dev/hdb > 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always > - 0 > 7 Seek_Error_Rate 0x000b 200 200 051 Pre-fail Always > - 0 > 9 Power_On_Hours 0x0032 032 032 000 Old_age Always > - 50209 > 199 UDMA_CRC_Error_Count 0x000a 200 253 000 Old_age Always > - 1155 > > smoker-new ~ # smartctl -A /dev/hdc > 5 Reallocated_Sector_Ct 0x0033 253 253 063 Pre-fail Always > - 0 > 7 Seek_Error_Rate 0x000a 253 252 000 Old_age Always > - 0 > 9 Power_On_Minutes 0x0032 134 134 000 Old_age Always > - 1004h+16m > 199 UDMA_CRC_Error_Count 0x0008 199 193 000 Old_age Offline > - 6 >From the above, the reallocated sector count is fine, none of the disk seem to be having surface problems. The UDMA errors are MUCH higher for sdb, as is the power-on hours. It is claiming about 6 years powered on, which is a bit weird alright. If it is having to recover UDMA errors, it will be much slower to operate. Cheers, RobbieAB
[gentoo-user] Re: A very strange problem with rc-update
On 06/04/2010 10:11 AM, Chen Huan wrote: Hi,everybody, I got a very very strange problems. I have install gnome, and when I try to add hal to default runlevel, use command "rc-update add hald default", it is normal and output of rc-update show is right but when I restart computer, the hald doesn't auto start, when I log in the system, and exec "/etc/init.d/hald start", it is started normally There is no any information about hald when the system starting..It is very strange...Could somebody help me... And NetworkManager and xdm have the same problem. What version of baselayout are you using?
[gentoo-user] Re: Fast checksumming of whole partitions
On 06/05/10 02:39, meino.cra...@gmx.de wrote: [] > > Is there any faster and reliable way to checksum whole paritions (not > on "per file" base)??? FWIW, portage has a tool called "dcfldd" that works well for me. It is dd with the addition of: * Hashing on-the-fly - dcfldd can hash the input data as it is being transferred, helping to ensure data integrity. * Status output - dcfldd can update the user of its progress in terms of the amount of data transferred and how much longer operation will take. * Flexible disk wipes - dcfldd can be used to wipe disks quickly and with a known pattern if desired. * Image/wipe Verify - dcfldd can verify that a target drive is a bit-for-bit match of the specified input file or pattern. * Multiple outputs - dcfldd can output to multiple files or disks at the same time. * Split output - dcfldd can split output to multiple files with more configurability than the split command. * Piped output and logs - dcfldd can send all its log data and output to commands as well as files natively. e.g. when I copy my HD, I get a copy status report and hash by using the following commands: #!/bin/bash dcfldd if=/dev/sda bs=4096k sizeprobe=if status=on hashwindow=0 of=/dev/sdb dcfldd if=/dev/sdb bs=4096k sizeprobe=if status=on hashwindow=0 of=/dev/null When they've completed, I'll visually compare the two hashes (you can automate this.) You can get fancier and do the Verify instead of the hashes. HTH (p.s. Part of your answer is setting the best blocksize for dd or dcfldd. I'd presume it the smaller of your available memory, or the buffer size on your HD?.. someone please correct me on this!?)
[gentoo-user] Fatal problem: Pyton-updater "kills" PC
hallo, This morning I updated my newly installed Gentoo. Via "eselect read news" I was told, that a new python version (3.1.*) was installed and I should run python-updater, which I did. while compiling boost, the PC was killed. It looks like it was told to switch off itsself. I rebooted the PC into runlevel 2 and repeated the whole thing. Again compiling/merging boost kills the PC the same way. I rebooted the PC into runlevel "S". After starting python-updater compiling/mergeing boost kills the PC. Each time it looks like someone has switched off the power. From emerge log: 1275759027: Started emerge on: Jun 05, 2010 19:30:27 1275759027: *** emerge --deep --oneshot --keep-going --verbose app-office/gnumeric:0 dev-libs/boost:1.41 dev-python/lxml:0 dev-python/setuptools:0 1275759031: >>> emerge (1 of 4) dev-python/setuptools-0.6.10 to / 1275759033: === (1 of 4) Cleaning (dev-python/setuptools-0.6.10::/usr/portage/dev-python/setuptools/setuptools-0.6.10.ebuild) 1275759033: === (1 of 4) Compiling/Merging (dev-python/setuptools-0.6.10::/usr/portage/dev-python/setuptools/setuptools-0.6.10.ebuild) 1275759046: >>> emerge (1 of 3) dev-libs/boost-1.41.0-r3 to / 1275759048: === (1 of 3) Cleaning (dev-libs/boost-1.41.0-r3::/usr/portage/dev-libs/boost/boost-1.41.0-r3.ebuild) 1275759048: === (1 of 3) Compiling/Merging (dev-libs/boost-1.41.0-r3::/usr/portage/dev-libs/boost/boost-1.41.0-r3.ebuild) 1275760538: Started emerge on: Jun 05, 2010 19:55:38 1275760538: *** emerge --deep --oneshot --keep-going --verbose app-office/gnumeric:0 dev-libs/boost:1.41 dev-python/lxml:0 dev-python/setuptools:0 1275760552: >>> emerge (1 of 4) dev-python/setuptools-0.6.10 to / 1275760553: === (1 of 4) Cleaning (dev-python/setuptools-0.6.10::/usr/portage/dev-python/setuptools/setuptools-0.6.10.ebuild) 1275760553: === (1 of 4) Compiling/Merging (dev-python/setuptools-0.6.10::/usr/portage/dev-python/setuptools/setuptools-0.6.10.ebuild) 1275760566: >>> emerge (1 of 3) dev-libs/boost-1.41.0-r3 to / 1275760569: === (1 of 3) Cleaning (dev-libs/boost-1.41.0-r3::/usr/portage/dev-libs/boost/boost-1.41.0-r3.ebuild) 1275760569: === (1 of 3) Compiling/Merging (dev-libs/boost-1.41.0-r3::/usr/portage/dev-libs/boost/boost-1.41.0-r3.ebuild) From summary.log: >>> Messages generated by process 12966 on 2010-06-05 19:30:43 CEST for package >>> dev-python/setuptools-0.6.10: ERROR: compile ERROR: dev-python/setuptools-0.6.10 failed: Building failed with CPython 3.1 in distutils_building() function Call stack: ebuild.sh, line 54: Called src_compile environment, line 4635: Called distutils_src_compile environment, line 1255: Called python_execute_function 'distutils_building' environment, line 3413: Called die The specific snippet of code: die "${failure_message}"; If you need support, post the output of 'emerge --info =dev-python/setuptools-0.6.10', the complete build log and the output of 'emerge -pqv =dev-python/setuptools-0.6.10'. The complete build log is located at '/var/tmp/portage/dev-python/setuptools-0.6.10/temp/build.log'. The ebuild environment file is located at '/var/tmp/portage/dev-python/setuptools-0.6.10/temp/environment'. S: '/var/tmp/portage/dev-python/setuptools-0.6.10/work/distribute-0.6.10' >>> Messages generated by process 6885 on 2010-06-05 19:56:04 CEST for package >>> dev-python/setuptools-0.6.10: ERROR: compile ERROR: dev-python/setuptools-0.6.10 failed: Building failed with CPython 3.1 in distutils_building() function Call stack: ebuild.sh, line 54: Called src_compile environment, line 4643: Called distutils_src_compile environment, line 1263: Called python_execute_function 'distutils_building' environment, line 3421: Called die The specific snippet of code: die "${failure_message}"; If you need support, post the output of 'emerge --info =dev-python/setuptools-0.6.10', the complete build log and the output of 'emerge -pqv =dev-python/setuptools-0.6.10'. The complete build log is located at '/var/tmp/portage/dev-python/setuptools-0.6.10/temp/build.log'. The ebuild environment file is located at '/var/tmp/portage/dev-python/setuptools-0.6.10/temp/environment'. S: '/var/tmp/portage/dev-python/setuptools-0.6.10/work/distribute-0.6.10' From the build.log: copying tests/shlib_test/hello.c -> build/src/tests/shlib_test copying tests/shlib_test/hellolib.c -> build/src/tests/shlib_test copying tests/shlib_test/hello.pyx -> build/src/tests/shlib_test copying tests/api_tests.txt -> build/src/tests Traceback (most recent call last): File "setup.py", line 24, in from lib2to3.main import main File "/usr/lib/python3.1/lib2to3/main.py", line 12, in from . import refactor File "/usr/lib/python3.1/lib2to3/refactor.py", line 25, in from . import pytree, pygram File "/usr/lib/python3.1/lib2to3/pygram.py", line 35, in del python_grammar_no_print_statement.keywords["print"] KeyError: 'print' *
[gentoo-user] Re: Blurred bold characters in urxvt
On Saturday 05 June 2010 19:13:24 Mick wrote: > Hi All, > > I emerged rxvt-unicode because aterm which I have been using faithfully for > years does not do UTF8, but as you can see in the attachment all bold > characters look distorted. In xterm and aterm they look nice and clear > when bold. > > How can I fix this? It seems that it was a limitation of the fixed font that I had defined for aterm in .Xresources: aterm*font:-*-fixed-*-*-*-*-20-*-100-*-*-*-*-* Setting a different font and using xft seems to overcome this problem: /usr/bin/urxvt -pe tabbed -fn "x:Bitstream Vera Sans Mono:pixelsize=15" No idea why aterm copes with fixed font and urxvt does not ... -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Re: Fast checksumming of whole partitions
7v5w7go9ub0o <7v5w7go9u...@gmail.com> [10-06-05 20:22]: > On 06/05/10 02:39, meino.cra...@gmx.de wrote: > [] > > > > Is there any faster and reliable way to checksum whole paritions (not > > on "per file" base)??? > > > FWIW, portage has a tool called "dcfldd" that works well for me. It is > dd with the addition of: > > * Hashing on-the-fly - dcfldd can hash the input data as it is > being transferred, helping to ensure data integrity. > * Status output - dcfldd can update the user of its progress in > terms of the amount of data transferred and how much longer operation > will take. > * Flexible disk wipes - dcfldd can be used to wipe disks quickly and > with a known pattern if desired. > * Image/wipe Verify - dcfldd can verify that a target drive is a > bit-for-bit match of the specified input file or pattern. > * Multiple outputs - dcfldd can output to multiple files or disks at > the same time. > * Split output - dcfldd can split output to multiple files with more > configurability than the split command. > * Piped output and logs - dcfldd can send all its log data and > output to commands as well as files natively. > > > e.g. when I copy my HD, I get a copy status report and hash by using the > following commands: > > #!/bin/bash > dcfldd if=/dev/sda bs=4096k sizeprobe=if status=on hashwindow=0 of=/dev/sdb > dcfldd if=/dev/sdb bs=4096k sizeprobe=if status=on hashwindow=0 of=/dev/null > > When they've completed, I'll visually compare the two hashes (you can > automate this.) You can get fancier and do the Verify instead of the hashes. > > HTH > > (p.s. Part of your answer is setting the best blocksize for dd or > dcfldd. > > I'd presume it the smaller of your available memory, or the buffer size > on your HD?.. someone please correct me on this!?) > > That looks really interesting. The only problem I have with this is that I have to have /dev/sda as /dev/sdb idle (not mounted) and because of that I use knoppix as temporary system to boot. And I dont think that knoppix has this tool "on board". Or is there a way to do such copies from a one disk to another while one disk is booted??? Best regards, mcc -- Please don't send me any Word- or Powerpoint-Attachments unless it's absolutely neccessary. - Send simply Text. See http://www.gnu.org/philosophy/no-word-attachments.html In a world without fences and walls nobody needs gates and windows.
Re: [gentoo-user] One hard drive much slower for some reason.
Robert Bridge wrote: Hi Dale, > From the above, the reallocated sector count is fine, none of the disk seem to be having surface problems. The UDMA errors are MUCH higher for sdb, as is the power-on hours. It is claiming about 6 years powered on, which is a bit weird alright. If it is having to recover UDMA errors, it will be much slower to operate. Cheers, RobbieAB The powered on hours is most likely about right. I rarely turn my machine off. That drive is about that old too. I don't always have it mounted but it is a pain to remove so I just left it in there in case I needed it. Dale :-) :-)
Re: [gentoo-user] Fatal problem: Pyton-updater "kills" PC
Heyho, *.la files are ok? # lafilefixer --justfixit dependencies ok? # revdep-rebuild -- -av -- Cheers, Manuel Klemenz signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Re: Fast checksumming of whole partitions
I'm calculating checksums over partitions just by calling # md5sum /dev/sda1 or for the complete disk (incl. partition table + all partitions) # md5sum /dev/sda that's it :) - works with any distro/liveDVD -- Cheers, Manuel Klemenz On Saturday 05 June 2010 21:23:31 meino.cra...@gmx.de wrote: > 7v5w7go9ub0o <7v5w7go9u...@gmail.com> [10-06-05 20:22]: > > On 06/05/10 02:39, meino.cra...@gmx.de wrote: > > [] > > > > > Is there any faster and reliable way to checksum whole paritions (not > > > on "per file" base)??? > > > > FWIW, portage has a tool called "dcfldd" that works well for me. It is > > > > dd with the addition of: > > * Hashing on-the-fly - dcfldd can hash the input data as it is > > > > being transferred, helping to ensure data integrity. > > > > * Status output - dcfldd can update the user of its progress in > > > > terms of the amount of data transferred and how much longer operation > > will take. > > > > * Flexible disk wipes - dcfldd can be used to wipe disks quickly > > and > > > > with a known pattern if desired. > > > > * Image/wipe Verify - dcfldd can verify that a target drive is a > > > > bit-for-bit match of the specified input file or pattern. > > > > * Multiple outputs - dcfldd can output to multiple files or disks > > at > > > > the same time. > > > > * Split output - dcfldd can split output to multiple files with > > more > > > > configurability than the split command. > > > > * Piped output and logs - dcfldd can send all its log data and > > > > output to commands as well as files natively. > > > > > > e.g. when I copy my HD, I get a copy status report and hash by using the > > following commands: > > > > #!/bin/bash > > dcfldd if=/dev/sda bs=4096k sizeprobe=if status=on hashwindow=0 > > of=/dev/sdb dcfldd if=/dev/sdb bs=4096k sizeprobe=if status=on > > hashwindow=0 of=/dev/null > > > > When they've completed, I'll visually compare the two hashes (you can > > automate this.) You can get fancier and do the Verify instead of the > > hashes. > > > > HTH > > > > (p.s. Part of your answer is setting the best blocksize for dd or > > dcfldd. > > > > I'd presume it the smaller of your available memory, or the buffer size > > on your HD?.. someone please correct me on this!?) > > That looks really interesting. The only problem I have with this is > that I have to have /dev/sda as /dev/sdb idle (not mounted) and > because of that I use knoppix as temporary system to boot. And I > dont think that knoppix has this tool "on board". > > Or is there a way to do such copies from a one disk to another > while one disk is booted??? > > Best regards, > mcc signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] One hard drive much slower for some reason.
Dale writes: > For the record, hda and hdb are not even mounted. I am currently using > hdc for the OS. The drive used to be a lot faster than this. I used > it for my OS a good while back and recently used it for /var/portage > and /usr/portage. I'm not sure what has changed so I can't figure out > why it is so slow. Anyone see something I am missing? All I see is > the others are udma6 while it is udma5. It has always been that way > tho. > > Thoughts? hdb is in slave mode, maybe this slows things down? If you want to be sure, you could exchange hda and hdb (that is, exchange a jumper so master becomes slave and vice versa, unless you have it set to 'cable select'), and check again. Wonko
[gentoo-user] Pasting jacked up for mnths now... like a bugger
Does anyone else notice a serious mess when copy/pasting to firefox. Some other places too. I'll mouse scrape something from and go to paste it into google, and get some older paste plus the new one intermixed as a result. Its been going on for a good while and finally reached the point where I'm really sick of it. I use something of an exotic mouse I guess (Logitech G9), could that be the problem? I actually doubt it. I'll give an example, I mouse scrapted the `I actually doublt it' above and when to paste it to an empty firefox navigation box. This was the result: -US%3I actually doubt itAunofficial&q=pdf2html+opensource&aq=f&aqi=&aql=&oq=&gs_rfai=http://twibright.com/pdf2html As you see, its there but prefaced and postfaced with other junk. Any ideas what I can do about it? I don't really want to go tracking down different mice etc... I'm hoping its something to do with xorg or something.
Re: [gentoo-user] One hard drive much slower for some reason.
Alex Schuster wrote: Dale writes: For the record, hda and hdb are not even mounted. I am currently using hdc for the OS. The drive used to be a lot faster than this. I used it for my OS a good while back and recently used it for /var/portage and /usr/portage. I'm not sure what has changed so I can't figure out why it is so slow. Anyone see something I am missing? All I see is the others are udma6 while it is udma5. It has always been that way tho. Thoughts? hdb is in slave mode, maybe this slows things down? If you want to be sure, you could exchange hda and hdb (that is, exchange a jumper so master becomes slave and vice versa, unless you have it set to 'cable select'), and check again. Wonko It hasn't mattered in the past. I'm not sure why it should matter now. I really don't see how it could matter at all really. Heck, my DVD drive is slow as it gets, its udma4, but hdc is on the same cable and it is one of the faster drives I have. That would exclude sda of course. Those two drives has been in there this way for ages and used to be pretty close as far as speed. I'm thinking age is catching up on the drive myself. Dale :-) :-)
Re: [gentoo-user] One hard drive much slower for some reason.
On Sat, Jun 5, 2010 at 8:54 PM, Dale wrote: > The powered on hours is most likely about right. I rarely turn my machine > off. That drive is about that old too. I don't always have it mounted but > it is a pain to remove so I just left it in there in case I needed it. Is it a WD Caviar Black by any chance? I have vague memories of seeing something saying they don't power off in firmware if unused... Anyway, those UDMA errors are a bigger problem I suspect, as they will slow things down as the disk has to recover from the errors. Are you seeing any of the numbers change as you leave it running? RobbieAB
Re: [gentoo-user] One hard drive much slower for some reason.
Robert Bridge wrote: On Sat, Jun 5, 2010 at 8:54 PM, Dale wrote: The powered on hours is most likely about right. I rarely turn my machine off. That drive is about that old too. I don't always have it mounted but it is a pain to remove so I just left it in there in case I needed it. Is it a WD Caviar Black by any chance? I have vague memories of seeing something saying they don't power off in firmware if unused... Anyway, those UDMA errors are a bigger problem I suspect, as they will slow things down as the disk has to recover from the errors. Are you seeing any of the numbers change as you leave it running? RobbieAB Right now its not even in use. It's not mounted or anything but it is getting power. I was using a week or so ago for /var and something else. I can't recall at the moment. I'm not sure if I am going to us it anymore or not. If it stays this slow, I know I'm not. lol Got to love newegg for this part. This is a link to the drive. http://www.newegg.com/Product/Product.aspx?Item=N82E16822144102 Dale :-) :-)
[gentoo-user] Re: Pasting jacked up for mnths now... like a bugger
On 06/06/10 07:56, Harry Putnam wrote: > Does anyone else notice a serious mess when copy/pasting to firefox. > Some other places too. I don't. But, I guess you need to clarify, when you're saying you "copy/paste", is it Ctrl+C/Ctrl+V type of copy/pasting or Middle-click type of copy/pasting? > This was the result: > -US%3I actually doubt > itAunofficial&q=pdf2html+opensource&aq=f&aqi=&aql=&oq=&gs_rfai=http://twibright.com/pdf2html what was inside the navigation box before? Firefox's middle-click url-paste only works if your middle click is not in the address bar. If you middle-click in the address bar, the regular buffer-paste mechanism takes over (i.e. it will paste your selection buffer without deleting what's previously on the address bar). So, we have three copy-paste mechanism: - Ctrl+C/Ctrl+V, we're all familiar with this - Buffer-Paste, provided by X, pastes your selection buffer to hovered textbox - Url-Paste, provided by Firefox, loads the URL in the selection buffer, which as a side effect, replaces the address bar with that url
[gentoo-user] Re: Fast checksumming of whole partitions
On 06/05/10 15:23, meino.cra...@gmx.de wrote: [] > That looks really interesting. The only problem I have with this is > that I have to have /dev/sda as /dev/sdb idle (not mounted) and > because of that I use knoppix as temporary system to boot. And I dont > think that knoppix has this tool "on board". Just boot up knoppix, mount root partition that contains dcfldd, go to wherever the executable is located (e.g. /usr/bin/dcfldd): 1. boot up knoppix 2. create a partition: mkdir /work 3. mount /work to the root partition: mount /dev/sdc /work 4. cd /work/usr/bin 5. run dcfldd: ./dcfldd If your root partition is encrypted (e.g. mine is), then place a copy of dcfldd on the boot partition; no boot partition, put a copy on its own dedicated little partition. Of course, you can always put a copy on a USB jumpdrive. As a last alternative, download and compile a copy while in knoppix. > Or is there a way to do such copies from a one disk to another while > one disk is booted??? Sure, but the running disk/sector would have temporary files that would not consistently hash when you did the hash check. If you do this, try it in linux without bringing up X. This might avoid copying some software "locks" that could block startup on the copied disk/sector. HTH
Re: [gentoo-user] [OT sphinx] Any users of sphinx here
On Fri, 2010-06-04 at 17:52 -0500, Harry Putnam wrote: > I've been looking for a perl based search tool that uses some kind of > indexing to index and render searchable my home library of software > manual and the like. Quite a few html pages involved, maybe 15-16,000. > > Webglimpse is something I've worked with before and know a bit about > but thought I might like to see what else is available. > > Googling lead to a tool called Sphinx that apparently is coupled with > a data base tool like mysql. It is advertised as the kind of search > tool I'm after and has a perl front-end also available in portage > (dev-perl/Sphinx-Search). > > The trouble is I haven't been able to figure out the first thing about > using it. The overview, and Introduction, like a lot of such > documents fails to give a really basic idea of what the tool does. > > The call it a `full text search engine', but never really say what > that means. > > There are 12-15 FEATURES listed, and none appear to describe sensibly > what they really do. > > The faq is a string a questions about using sql.. really. > > So far I haven't found a good statement of what the darn thing really > does or how to aim it at data. > > The manual is probably great if you already know a lot about using > sphinx but very thin for my case. > > I've not even been able to get a rough idea of how to aim the darn > thing at the desired (Local lan) web site. > > Or, to show how thin it really is or how dumb I really am, I've been > unable to tell if it can even do what I want to do. > > I've posted on a sphinx list on gmane... but it appears to be only > moderately active and haven't gotten any replies... > > I hoped some one here may be familiar with sphinx and willing to coach > me a bit or at least let me know if it can even do what I want to do. > > Also any other perl based search tools involving indexing and some > kind of versatile search query capability.. like regular expressions > I'd be interested to know about. If you can put your HTML pages into a database, Sphinx might be able to help you with your issue. Basically what Sphinx does is let you search databases. You specify one or more SQL sources of data ans associated queries, and Sphinx provides an API (or a emulated SQL server) that makes searching easy. Sphinx is for full text database searching; it does not index files or websites directly. (Note that is this not actually true; it can search XML files directly, but you still specify XML attributes instead of database columns, etc, so it is treating the XML as a data store and not as a generic document.) I recall reading that Craigslist uses Sphinx to search their database of listings. As an example of how it works, suppose I am making a news website and have a bunch of news posts, each of which has an author, category, and text. With Sphinx, I can setup a source -- let's call it news_catalog -- that will index this data. news_catalog will be associated with an SQL query that will allow Sphinx to access the data it needs to index. Let's use "SELECT id, author, category, text FROM catalog" as our query. Note that catalog is a table or view in your database, though this query can also use complex joins, etc, as long as the database supports it. Via the Sphinx API, I can say I want to search for "Europe | America" and it will return a list of news articles containing the terms Europe, America, or both, as a pipe is the or operator. It actually returns a list of ids which correspond to the id I specified in my query; a unique key is always the first argument in the query. My application is responsible for fetching the actual data from the original database using that id and presenting the data in a useful way to the user. Extended query syntax allows for other boolean operators, searching specific fields, strict order, exact match, field start/end, etc. The documentation has lots of examples; look at http://www.sphinxsearch.com/docs/current.html for the current reference manual. If you have a bunch of HTML files on a disk or website that you want to index and search, I do not think Sphinx is the software you want. Yes, you could load your data into a database and then use Sphinx, but that does not seem like the best solution. Sphinx provides the API for use in your application; it does not provide a user interface. As an alternative, I recommend you look at something like ht://Dig (htdig.org), which will search HTML pages directly in addition to PDF, Word, Excel, Powerpoint, etc with the help of external converters. It also includes a user interface. After glancing at webglimpse, with which I am not familiar, it looks like it does something similar to ht://Dig. Regards, Brandon Vargo
Re: [gentoo-user] Fatal problem: Pyton-updater "kills" PC
Manuel Klemenz [10-06-06 03:07]: > Heyho, > > *.la files are ok? # lafilefixer --justfixit > dependencies ok? # revdep-rebuild -- -av > > -- > Cheers, > Manuel Klemenz Hi Manuel, It seems that running lafilefixer had fix the problem, since revdep-rebuild doesn not reports any problems. BUT: "setup-tools" still fail to compile: Any idea, how to fix it that ? Best regards and have a nice sunday! mcc * Building of dev-python/setuptools-0.6.10 with CPython 3.1... python3.1 setup.py build -b build-3.1 creating build creating build/src creating build/src/docs creating build/src/docs/_theme creating build/src/docs/_theme/nature creating build/src/docs/_theme/nature/static creating build/src/docs/build creating build/src/docs/build/html creating build/src/docs/build/html/_sources creating build/src/docs/build/html/_static creating build/src/setuptools creating build/src/setuptools/command creating build/src/setuptools/tests creating build/src/tests creating build/src/tests/shlib_test copying setuptools/dist.py -> build/src/setuptools copying setuptools/__init__.py -> build/src/setuptools copying setuptools/sandbox.py -> build/src/setuptools copying setuptools/package_index.py -> build/src/setuptools copying setuptools/archive_util.py -> build/src/setuptools copying setuptools/depends.py -> build/src/setuptools copying setuptools/extension.py -> build/src/setuptools copying setuptools/tests/doctest.py -> build/src/setuptools/tests copying setuptools/tests/test_upload_docs.py -> build/src/setuptools/tests copying setuptools/tests/test_easy_install.py -> build/src/setuptools/tests copying setuptools/tests/test_build_ext.py -> build/src/setuptools/tests copying setuptools/tests/__init__.py -> build/src/setuptools/tests copying setuptools/tests/test_sandbox.py -> build/src/setuptools/tests copying setuptools/tests/test_resources.py -> build/src/setuptools/tests copying setuptools/tests/test_develop.py -> build/src/setuptools/tests copying setuptools/command/upload.py -> build/src/setuptools/command copying setuptools/command/setopt.py -> build/src/setuptools/command copying setuptools/command/install_scripts.py -> build/src/setuptools/command copying setuptools/command/egg_info.py -> build/src/setuptools/command copying setuptools/command/upload_docs.py -> build/src/setuptools/command copying setuptools/command/build_ext.py -> build/src/setuptools/command copying setuptools/command/__init__.py -> build/src/setuptools/command copying setuptools/command/install.py -> build/src/setuptools/command copying setuptools/command/develop.py -> build/src/setuptools/command copying setuptools/command/build_py.py -> build/src/setuptools/command copying setuptools/command/saveopts.py -> build/src/setuptools/command copying setuptools/command/install_lib.py -> build/src/setuptools/command copying setuptools/command/bdist_wininst.py -> build/src/setuptools/command copying setuptools/command/easy_install.py -> build/src/setuptools/command copying setuptools/command/install_egg_info.py -> build/src/setuptools/command copying setuptools/command/alias.py -> build/src/setuptools/command copying setuptools/command/bdist_rpm.py -> build/src/setuptools/command copying setuptools/command/register.py -> build/src/setuptools/command copying setuptools/command/sdist.py -> build/src/setuptools/command copying setuptools/command/rotate.py -> build/src/setuptools/command copying setuptools/command/test.py -> build/src/setuptools/command copying setuptools/command/bdist_egg.py -> build/src/setuptools/command copying setuptools/tests/win_script_wrapper.txt -> build/src/setuptools/tests copying setuptools/cli.exe -> build/src/setuptools copying setuptools/gui.exe -> build/src/setuptools copying tests/test_distribute_setup.py -> build/src/tests copying tests/install_test.py -> build/src/tests copying tests/shlib_test/setup.py -> build/src/tests/shlib_test copying tests/shlib_test/test_hello.py -> build/src/tests/shlib_test copying tests/shlib_test/hello.c -> build/src/tests/shlib_test copying tests/shlib_test/hellolib.c -> build/src/tests/shlib_test copying tests/shlib_test/hello.pyx -> build/src/tests/shlib_test copying tests/api_tests.txt -> build/src/tests Traceback (most recent call last): File "setup.py", line 24, in from lib2to3.main import main File "/usr/lib/python3.1/lib2to3/main.py", line 12, in from . import refactor File "/usr/lib/python3.1/lib2to3/refactor.py", line 25, in from . import pytree, pygram File "/usr/lib/python3.1/lib2to3/pygram.py", line 35, in del python_grammar_no_print_statement.keywords["print"] KeyError: 'print' * ERROR: dev-python/setuptools-0.6.10 failed: * Building failed with CPython 3.1 in distutils_building() function * * Call stack: * ebuild.sh, line 54: Called src_compile * environment, line 4640: Called distutils_src_compile * environment, line 1260: Called python_execute_function 'distutils_building' * environment, line 3418: Called die