On 1 September 2012 09:46, Jared Camins-Esakov <jcam...@cpbibliography.com>wrote:
> Doug, > > So environment variables are not the issue. We are carefully managing >> those. >> > > Make sure when you are using cron jobs that you set the environment > variables IN YOUR CRONTAB. Setting environment variables elsewhere is a > recipe for confusion and misery down the road. However, this is -- as you > say -- not the problem. > > >> I have tried using the new tool checkNonIndexedBiblios.pl (from patch >> 6566) >> and it indeed finds a few recent biblios that are not indexed. Using the >> -z option to mark them for indexing followed by a manual run of >> rebuild_zebra -b -v -z did not get the biblios indexed. I cranked up the >> debugging on zebraidx (by modifying rebuild_zebra.pl and using -v -v) and >> did not see any obvious errors in the output that would suggest why >> indexing was failing. >> > > Did you change your bibliographic frameworks? It could be a matter of the > biblionumber not being stored properly. The other thing to do is to confirm > that the non-indexed biblios are *actually* getting added to the zebraqueue > by the 6566 script. It's kind of a long shot, but it could be an issue with > the zebraqueue table getting corrupted. I've seen this happen when the > zebraqueue table got too large, and disk space was low. > So I think this is working as expected. Disk space is ample on the system in question, and the catalogue is small by most standards (about 2500 biblios). I ran rebuild_zebra.pl with the -k flag so it left the exported records and here's the tree I got. library:/tmp# ls -altR p6tjtKrrK3/ p6tjtKrrK3/: total 0 drwxrwxrwt 6 root root 1040 Sep 1 17:50 .. drwx------ 5 koha koha 100 Sep 1 06:36 . drwxr-xr-x 2 koha koha 60 Sep 1 06:36 upd_biblio drwxr-xr-x 2 koha koha 60 Sep 1 06:36 del_biblio drwxr-xr-x 2 koha koha 40 Sep 1 06:36 biblio p6tjtKrrK3/upd_biblio: total 16 -rw-r--r-- 1 koha koha 12670 Sep 1 06:36 exported_records drwxr-xr-x 2 koha koha 60 Sep 1 06:36 . drwx------ 5 koha koha 100 Sep 1 06:36 .. p6tjtKrrK3/del_biblio: total 0 drwx------ 5 koha koha 100 Sep 1 06:36 .. drwxr-xr-x 2 koha koha 60 Sep 1 06:36 . -rw-r--r-- 1 koha koha 0 Sep 1 06:36 exported_records p6tjtKrrK3/biblio: total 0 drwx------ 5 koha koha 100 Sep 1 06:36 .. drwxr-xr-x 2 koha koha 40 Sep 1 06:36 . Using marcprint.py, a small python program built around pymarc package, I decoded this file and find 13 MARC records, as expected. Example: =LDR 00871nam a22002417a 4500 =001 201112071555.ls =003 UkLoVW =005 20111209110116.0 =008 111207t1982\\\\enkg\\\\r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 40 =100 1\$aSheffield, Ken$92330 =245 \0$aTen country dances :$bmainly from Thompson, Wright & Wilson. =260 \\$aOxford :$b[The Author],$c1982. =300 \\$a12 p. :$bmusic ;$c30 cm. =490 1\$aFrom two barns ;$vv. 1 =650 \\$9117$aCountry dances =650 \\$9127$aDance music =830 \5$aFrom two barns$92331 =942 \\$2VWML$cBK$hQS 40$n0$6QS_00040 =999 \\$c14879$d14879 =952 \\$w2011-12-07$p10914$r2011-12-07$40$00$6QS_00040$915083$bVWML$10$oQS 40$d2011-12-07$70$cBOX$2VWML$yBK$aVWML =952 \\$w2011-12-07$p11121$r2011-12-07$40$00$6QS_00040$915084$bVWML$10$oQS 40$d2011-12-07$71$cBOX$2VWML$yBK$aVWML I have attached an ascii printout of all 13 records in case someone wants to look for a pattern in these records. The problem is either in the format/contents of those records, or in zebraidx/zebrasrv or their config files. My suspicion is with the later since we have already had to fix one problem there with for bug 6566. -Doug- > > Regards, > Jared > > -- > Jared Camins-Esakov > Bibliographer, C & P Bibliography Services, LLC > (phone) +1 (917) 727-3445 > (e-mail) jcam...@cpbibliography.com > (web) http://www.cpbibliography.com/ > >
opts = [], args = ['/tmp/exported_records'] =LDR 01203nam a22002417a 4500 =001 201204111533.ls =003 UkLoVW =005 20120502165940.0 =008 120411s1796\\\\enkg\\\\r\\\\\000\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 35.4 =245 \0$aThompson's twenty four country dances for the year 1796 :$bwith figures to each dance as they are performed at court, Bath, & all publick assemblys. =260 \\$aLondon :$b[Thompson],$c[1796]. =300 \\$a1 v. :$bmusic ;$c13 cm. =500 \\$aPagination commences at p. 85, tune no. 169. =530 \\$3Available on microfilm, Country dances published by Thompson and Rutherford from 1756-1817, reel no. 8. =650 \\$9117$aCountry dances =650 \\$9127$aDance music =650 \\$9159$aEighteenth century =942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4 =999 \\$c15260$d15260 =952 \\$w2012-04-11$p3051 c$r2012-04-11$41$00$6QS_00035_4$915612$bVWML$10$oQS 35.4$d2012-04-11$zIn Thompson box II. Some pages missing - contains pp. 85-94.$71$cLC$2VWML$yBK$aVWML =952 \\$w2012-04-11$p3052$r2012-04-11$41$00$6QS_00035_4$915613$bVWML$10$oQS 35.4$d2012-04-11$zIn Thompson box II. Some pages missing - contains pp. 89-96. $71$cLC$2VWML$yBK$aVWML --------------------- =LDR 00844nam a22002177a 4500 =001 201203211127.ls =003 UkLoVW =005 20120321144114.0 =008 120321s1781\\\\enkg\\\\r\\\\\000\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 35.4 =245 \0$aTwenty four country dances for the year 1781 :$bwith proper directions to each dance as they are performed at court, Almack's, Bath, Pantheon, and all public assemblies. =260 \\$aLondon :$bT. Skillern,$c[1781]. =300 \\$a12 p. :$bmusic,$c13 cm. =650 \\$9117$aCountry dances =650 \\$9127$aDance music =650 \\$9542$aTune-books =650 \\$9159$aEighteenth century =942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4 =999 \\$c15206$d15206 =952 \\$w2012-03-21$p2277 j$r2012-03-21$40$00$6QS_00035_4$915537$bVWML$10$oQS 35.4$d2012-03-21$zStored in box.$71$cLC$2VWML$yBK$aVWML --------------------- =LDR 00844nam a22002177a 4500 =001 201203211040.ls =003 UkLoVW =005 20120321144320.0 =008 120321s1799\\\\enkg\\\\r\\\\\000\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 35.4 =245 \0$aTwenty four country dances for the year 1799 :$bwith proper directions to each dance as they are performed at court, Almack's, Bath, Pantheon, and all public assemblies. =260 \\$aLondon :$bT. Skillern,$c[1799]. =300 \\$a12 p. :$bmusic,$c13 cm. =650 \\$9117$aCountry dances =650 \\$9127$aDance music =650 \\$9542$aTune-books =650 \\$9159$aEighteenth century =942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4 =999 \\$c15204$d15204 =952 \\$w2012-03-21$p2192 d$r2012-03-21$40$00$6QS_00035_4$915535$bVWML$10$oQS 35.4$d2012-03-21$zStored in box.$71$cLC$2VWML$yBK$aVWML --------------------- =LDR 00839nam a22002057a 4500 =001 201203121633.ls =003 UkLoVW =005 20120313142348.0 =008 120312s1798\\\\enkg\\\\r\\\\\000\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 35.4 =245 \9$aPreston's twenty four country dances for the year 1798 :$bwith proper tunes and directions to each dance as they are performed at Court, Bath, and all public assemblys. =260 \\$aLondon :$bPreston & Son,$c[1798]. =300 \\$a[14 p.] :$bmusic ;$c13 cm. =650 \\$9117$aCountry dances =650 \\$9127$aDance music =650 \\$9159$aEighteenth century =942 \\$2VWML$cBK$hQS 35.4$n0$6QS_00035_4 =999 \\$c15158$d15158 =952 \\$w2012-03-12$p2192 a$r2012-03-12$40$00$6QS_00035_4$915466$bVWML$10$oQS 35.4$d2012-03-12$zStored with other tune books in box.$71$cLC$2VWML$yBK$aVWML --------------------- =LDR 00690nam a22002177a 4500 =001 201202091646.ls =003 UkLoVW =005 20120210150604.0 =008 120209s1872\\\\enkf\\\\r\\\\\000\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aGO 25(31) =100 1\$92504$aRoby, John =245 \\$aTraditions of Lancashire. Vol 1 /$cby John Roby. =250 \\$a5th ed. =260 \\$aLondon :$bRoutledge,$c1872. =300 \\$a468 p., 13 p. of plates :$b18 cm. =650 \\$9277$aLancashire =650 \\$9281$aLegends =942 \\$2VWML$cBK$hGO (25)31$n0$6GO_0002531 =999 \\$c15052$d15052 =952 \\$w2012-02-09$p6952$r2012-02-09$40$00$6GO_0002531$915343$bVWML$10$oGO 25(31)$d2012-02-09$71$2VWML$yBK$aVWML --------------------- =LDR 01415nam a22003017a 4500 =001 201202071158.ls =003 UkLoVW =005 20120210131404.0 =008 120207s1969\\\\enkfg\\|r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aMPQ 40 =100 1\$92487$aMacCormick, Donald =245 \0$aHebridean folksongs. Vol. I : $ba collection of waulking songs /$cby Donald MacCormick ; some of them translated by the late Fr. Allan McDonald ; completed and edited by J.L. Campbell ; tunes transcribed, from recordings, by Francis Collinson. =260 \\$aOxford :$bOxford University Press,$c1969. =300 \\$a375 p., 3 p. of plates :$bmusic ;$c22 cm. =500 \\$aVolume 1 of 3. =500 \\$aSongs collected in Kilphedir in South Uist in the year 1893. =504 \\$aBibliography p. 345-349. Includes indexes. =650 \\$9569$aWaulking songs =650 \\$9202$aFolk songs =650 \\$9234$aHebrides =700 \\$92488$aMcDonald, Allan =700 \\$9698$aCampbell, John Lorne =700 \\$92486$aCollinson, Francis M. =942 \\$2VWML$cBK$hMPQ 40$n0$6MPQ_00040 =999 \\$c15038$d15038 =952 \\$w2012-02-07$p6433$r2012-02-07$40$00$6MPQ_00040$915326$bVWML$10$oMPQ 40$d2012-02-07$71$2VWML$yBK$aVWML =952 \\$w2012-02-07$p6606$r2012-02-07$40$00$6MPQ_00040$915327$bVWML$10$oMPQ 40$d2012-02-07$zPresented to the Vaughan Williams Memorial Library by Mr. Frank Howes, October 1969.$71$cST$2VWML$yBK$aVWML --------------------- =LDR 00853nam a22002412a 4500 =001 201112141640.ls =003 UkOxU =005 20111215101342.0 =008 500101s1921\\\\enka\\\\\\\\\\000\0\eng\d =035 \\$aOCLC ocm16473143 from D950803M =040 \\$aDPL$cDPL$dEQO =092 \\$aD0502834800 =099 \\$aQR 5 App 1 =100 1\$aBell, Elizabeth Turner$92358 =245 10$aFifty figure and character dances for schools /$cby Elizabeth Turner Bell. =260 \\$aLondon :$bHarrap,$c1921. =300 \\$a222 p. :$bplates ;$c26 cm. =650 \0$aDances$9130 =650 \0$aEducation$91612 =740 0\$aMusic for fifty figure and character dances for schools =942 \\$2VWML$cBK$hQR 5 App 1$n0$6QR_00005_APP_1 =999 \\$c14920$d14920 =952 \\$w2011-12-14$p4446$r2011-12-14$40$00$6QR_00005_APP_1$915145$bVWML$10$oQR 5 App 1$d2011-12-14$70$cST$2VWML$yBK$aVWML --------------------- =LDR 00791nam a22002297a 4500 =001 201112081033.ls =003 UkLoVW =005 20111209110557.0 =008 111207t1995\\\\enkg\\\\r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 40 =100 1\$aSheffield, Ken$92330 =245 \0$aTen country dances for 1995 :$bfrom the collections of Playford, Thompson, Wright, Johnson and Walsh. =260 \\$aOxford :$b[The Author],$c1995. =300 \\$a12 p. :$bmusic ;$c30 cm. =490 1\$aFrom two barns ;$vv. 7 =650 \\$9117$aCountry dances =650 \\$9127$aDance music =830 \5$aFrom two barns$92331 =942 \\$2VWML$cBK$hQS 40$n0$6QS_00040 =999 \\$c14885$d14885 =952 \\$w2011-12-08$p18198$r2011-12-08$40$00$6QS_00040$915095$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML --------------------- =LDR 00911nam a22002417a 4500 =001 201112081033.ls =003 UkLoVW =005 20111209110508.0 =008 111207t1992\\\\enkg\\\\r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 40 =100 1\$aSheffield, Ken$92330 =245 \0$aTen country dances for 1992 :$bfrom the collections of Playford, Thompson, Wright, Johnson and Walsh =260 \\$aOxford :$b[The Author],$c1992. =300 \\$a12 p. :$bmusic ;$c30 cm. =490 1\$aFrom two barns ;$vv. 6 =650 \\$9117$aCountry dances =650 \\$9127$aDance music =830 \5$aFrom two barns$92331 =942 \\$2VWML$cBK$hQS 40$n0$6QS_00040 =999 \\$c14884$d14884 =952 \\$w2011-12-08$p12748$r2011-12-08$40$00$6QS_00040$915093$bVWML$10$oQS 40$d2011-12-08$70$cBOX$2VWML$yBK$aVWML =952 \\$w2011-12-08$p18197$r2011-12-08$40$00$6QS_00040$915094$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML --------------------- =LDR 00874nam a22002417a 4500 =001 201112081033.ls =003 UkLoVW =005 20111209110334.0 =008 111207t1987\\\\enkg\\\\r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 40 =100 1\$aSheffield, Ken$92330 =245 \0$aTen country dances for 1987 :$bmainly from Thompson and Walsh. =260 \\$aOxford :$b[The Author],$c1987. =300 \\$a12 p. :$bmusic ;$c30 cm. =490 1\$aFrom two barns ; $vv. 4 =650 \\$9117$aCountry dances =650 \\$9127$aDance music =830 \5$aFrom two barns$92331 =942 \\$2VWML$cBK$hQS 40$n0$6QS_00040 =999 \\$c14882$d14882 =952 \\$w2011-12-08$p11987$r2011-12-08$40$00$6QS_00040$915089$bVWML$10$oQS 40$d2011-12-08$70$cBOX$2VWML$yBK$aVWML =952 \\$w2011-12-08$p11988$r2011-12-08$40$00$6QS_00040$915090$bVWML$10$oQS 40$d2011-12-08$71$cBOX$2VWML$yBK$aVWML --------------------- =LDR 00871nam a22002417a 4500 =001 201112071555.ls =003 UkLoVW =005 20111209110116.0 =008 111207t1982\\\\enkg\\\\r\\\\\001\0\eng\d =040 \\$aUkLoVW$cUkLoVW =099 \\$aQS 40 =100 1\$aSheffield, Ken$92330 =245 \0$aTen country dances :$bmainly from Thompson, Wright & Wilson. =260 \\$aOxford :$b[The Author],$c1982. =300 \\$a12 p. :$bmusic ;$c30 cm. =490 1\$aFrom two barns ;$vv. 1 =650 \\$9117$aCountry dances =650 \\$9127$aDance music =830 \5$aFrom two barns$92331 =942 \\$2VWML$cBK$hQS 40$n0$6QS_00040 =999 \\$c14879$d14879 =952 \\$w2011-12-07$p10914$r2011-12-07$40$00$6QS_00040$915083$bVWML$10$oQS 40$d2011-12-07$70$cBOX$2VWML$yBK$aVWML =952 \\$w2011-12-07$p11121$r2011-12-07$40$00$6QS_00040$915084$bVWML$10$oQS 40$d2011-12-07$71$cBOX$2VWML$yBK$aVWML --------------------- =LDR 00980nam a22003012a 4500 =001 201110271312.ls =003 UkOxU =005 20111027151609.0 =008 500101s1978\\\\enka\\\\\b\\\\000\0\eng\d =020 \\$a0245532080 =035 \\$aOCLC ocm11116132 from D941122M =040 \\$aAZS$cAZS$dEQO$dUkLoVW =090 \\$aPN1979.P9$bA3x =092 \\$aD0502008990 =099 \\$aGRQ 15 =100 1\$aAdams, Anthony$92190 =245 14$aThe world of Punch & Judy /$cAnthony Adams and Robert Leach =260 \\$aLondon :$bHarrap,$c1978. =300 \\$a40 p. :$bill. ;$c25 cm. =440 \\$92191$aHarrap's theatre workshop =504 \\$aBibliography: p. 40 =630 00$aPunch and Judy$92192 =650 \0$aPuppets$92193 =700 1\$aLeach, Robert$91888 =740 04$aThe world of Punch and Judy =942 \\$2VWML$cBK$hGRQ 15$n0$6GRQ_00015 =999 \\$c14768$d14768 =952 \\$w2011-10-27$p11353$r2011-10-27$40$00$6GRQ_00015_BOX$914902$bVWML$10$oGRQ 15 Box$d2011-10-27$70$cBOX$2VWML$yBK$aVWML --------------------- =LDR 01555cam a22003251 4500 =001 201109261500.ls =003 UkLoVW =005 20111003164210.0 =008 770502s1957\\\\enkagh\\\b\\\\000\0\eng\\ =010 \\$a 57004332 =040 \\$aDLC$cDLC$dDLC =050 00$aML160$b.N44 vol. 1 =082 00$a781.8$a780.93* =099 \\$aMG 20 =100 1\$aWellesz, Egon.$92114 =245 10$aAncient and oriental music$cedited by Egon Wellesz. =260 \\$aLondon :$bOxford University Press,$c1957. =300 \\$a530 p.$billus., facsims., music.$c26 cm. =440 \0$aNew Oxford history of music,$vv. 1$92116 =504 \\$aBibliography: p. [479]-503. =505 \\$aPrimitive music / by Marius Schneider -- The music of far Eastern Asia 1 : China / by Laurence Picken -- The music of far Eastern Asia 2 : other countries / by Laurence Picken -- The music of India / by Arnold Bake -- The music of ancient Mesopotamia / by Henry George Farmer -- The music of ancient Egypt / by Henry George Farmer -- Music in the bible / by Carl H. Kraeling -- The music of post-biblical Judaism / by Eric Werner -- Ancient Greek music / by Isobel Henderson -- Roman music / by Rev. J.E. Scott -- The music of Islam / by Henry George Farmer. =650 \0$aMusic$9335 =650 \0$aAsia$926 =650 \0$aGreece$9225 =650 \0$aBible$947 =650 \0$aJewish music$9269 =650 \0$aIslam$92115 =942 \\$2VWML$cBK$hMG 20$n0$6MG_00020 =999 \\$c14696$d14696 =952 \\$w2011-09-26$p4571$r2011-09-26$40$00$6MG_00020$914774$bVWML$10$oMG 20$d2011-09-26$71$2VWML$yBK$aVWML ---------------------
_______________________________________________ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha