Re: [CODE4LIB] Question about OAI Harvesting via Perl

Hi, have a look at the Catmandu framework for Perl. Install Catmandu ( https://metacpan.org/pod/Catmandu) and Catmandu::OAI ( https://metacpan.org/pod/Catmandu::OAI). # in the perl script: use Catmandu::Importer::OAI; my $importer = Catmandu::Importer::OAI->new( url => "...", metadataPrefix

Re: [CODE4LIB] Question about OAI Harvesting via Perl

Just out of curiosity, does it work for a little bit then stop working? I know arXiv throttle crawlers, and am not sure if they throttle oai-pmh clients. Simeon Warner who helps run arXiv has been know to post code4lib, so maybe this will cross his radar. In the meantime, could you share your h

Re: [CODE4LIB] links from finding aid to digital object

UNC has been doing this (linking) for several years and we recently borrowed (sincerest form of flattery) Duke's interface work to add thumbnails and inline views. We've got content for over 500 collections and well over half a million scans and growing. UNC and Duke are working on a full day pre

Re: [CODE4LIB] links from finding aid to digital object

Finding aids at the Archives of American Art link to digitized content at the folder level from the container list, e.g. http://www.aaa.si.edu/collections/artist-tenants-association-records-7621/more. You can browse from item to item on the folder URL, but items themselves are not individually addr

Re: [CODE4LIB] Question about OAI Harvesting via Perl

Thanks for responding! I initialized it as follows (following the code from the synopsis on the site). my $harvester = Net::OAI::Harvester->new( baseURL => 'http://contentpro.lib.bcit.ca/iii/oairep/OAIRepository' );

[CODE4LIB] Job: Scientific Research Data Librarian at National Institute of Standards and Technology at National Institute of Standards and Technology

Scientific Research Data Librarian at National Institute of Standards and Technology National Institute of Standards and Technology Gaithersburg SALARY RANGE: $62,467.00 to $97,333.00 / Per Year OPEN PERIOD: Friday, January 10, 2014 to Friday, January 31, 2014 SERIES & GRADE: ZA-1410-03 POSITI

[CODE4LIB] Job: Summer Internships at Rock and Roll Hall of Fame

Summer Internships Rock and Roll Hall of Fame Cleveland The Rock and Roll Hall of Fame and Museum's Library and Archives offers opportunities for intern experiences to graduate students preparing for careers in libraries and archives. Interns must schedule their work Monday through Friday during r

[CODE4LIB] Job: Director, Informatics for Research Engagement at Drexel University

Director, Informatics for Research Engagement Drexel University Philadelphia Drexel University Libraries is a dynamic, matrixed organization focused on transformation to create scholarly connections, effective library learning environments and access to authoritative information. The Libraries, co

[CODE4LIB] Job: Digital Project Manager at University of California, Berkeley

Digital Project Manager University of California, Berkeley Berkeley The University of California, Berkeley, is one of the world's most iconic teaching and research institutions. Since 1868, Berkeley has fueled a perpetual renaissance, generating unparalleled intellectual, economic and social value

Re: [CODE4LIB] Question about OAI Harvesting via Perl

On Jan 14, 2014, at 3:01 PM, Eka Grguric wrote: > Hi, > > I am a complete newbie to Perl (and to Code4Lib) and am trying to set up a > harvester to get complete metadata records from oai-pmh repositories. My > current approach is to use things already built as much as possible - > specifically

[CODE4LIB] Fwd: [WEB4LIB] Digital Project Manager position - UC Berkeley Library

-- Forwarded message -- From: Lisa WEBER Date: Tue, Jan 14, 2014 at 12:31 PM Subject: [WEB4LIB] Digital Project Manager position - UC Berkeley Library To: web4...@listserv.nd.edu The UC Berkeley Library is hiring a Digital Project Manager. Read all about it at: http://www.lib.be

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

On 1/14/2014 2:52 PM, Salazar, Christina wrote: CSUCI (http://www.csuci.edu/ ) is game to host C4L in sunny S CA (definitely NOT Los Angeles, but still S CA) but y'all have to not be cranky pants about the venue - it's an excellent facility, but a bit remote.* Current temp: 80 degrees. *On th

Re: [CODE4LIB] archiving web pages

As an archivist, I don't see any problem using a PDF. Technically it should be a PDF-A, but realistically it is usually a PDF. I have done projects where I used PDFs for the archiving of full websites. It can be quite handy, depending on needs of course. Sometimes it works with the look and feel/d

[CODE4LIB] Question about OAI Harvesting via Perl

Hi, I am a complete newbie to Perl (and to Code4Lib) and am trying to set up a harvester to get complete metadata records from oai-pmh repositories. My current approach is to use things already built as much as possible - specifically the Net::Oai::Harvester (http://search.cpan.org/~esummers/O

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

CSUCI (http://www.csuci.edu/ ) is game to host C4L in sunny S CA (definitely NOT Los Angeles, but still S CA) but y'all have to not be cranky pants about the venue - it's an excellent facility, but a bit remote.* Current temp: 80 degrees. *On the site of a fairly infamous former mental hospital

Re: [CODE4LIB] archiving web pages

Thanks for the thoughtful responses. We've been actively digitizing our print paper (which ceased publication in 2011) and I was thinking of this as an extension of that effort. Right now, I think capturing a monthly WARC file of the site is definitely a good idea no matter what. But beyond that

Re: [CODE4LIB] links from finding aid to digital object

Hi Ed, Apologies if any of my Stanford cohorts have informed you about the Bassi Veratti Collection Site ( http://bv.stanford.edu ) we created here last year using Blacklight. You can drill down into boxes and folders of each of the Series in the "Content inventory" ( http://bv.stanford.edu/en/

Re: [CODE4LIB] links from finding aid to digital object

Hi Ed, At Pitt we're putting digital object identifiers into Archivists' Toolkit. We're doing folder-level digitization, except in rare cases. When the resultant EAD is transformed to HTML the identifier is wrapped into an actionable URL and the size of the linked document is retrieved to incorpor

Re: [CODE4LIB] archiving web pages

On 1/14/2014 12:26 PM, Nathan Tallman wrote: On Tue, Jan 14, 2014 at 12:08 PM, Francis Kayiwa wrote: If Skidmore has an IR I'd looking into adding them into your IR and render from there (in addition to WARC'ing them) Francis, I'm confused when you say "in addition to WARC'ing them." Would

Re: [CODE4LIB] archiving web pages

Kathryn, When you write strategy do you mean a technology solution or a preservation strategy, one component of which is the technology implementation of said strategy? If it's a preservation strategy for your school's online (web) content - so archival records - see what the University of Mich

Re: [CODE4LIB] archiving web pages

Hi- We actually have implemented the original question above with some shell scripts[1] for harvesting, and creating SIPs. The SIPs are then ingested into our Islandora instance with the Web ARChive Solution Pack[2] as AIPs. DIPs are also available via our local Wayback instance[3], and on an

Re: [CODE4LIB] archiving web pages

Here are several to consider: * http://www.webarchive.org.uk/wayback/archive/*/http://www.aboutmayfair.co.uk/ * http://webarchive.loc.gov/lcwa0015/*/http://lawprofessors.typepad.com/adminlaw/ * http://www.padi.cat:8080/wayback/*/http://www.ajberga.cat/ * http://vefsafn.is/index.php?page=english

Re: [CODE4LIB] archiving web pages

Hi Nathan, Nope, unfortunately not...It was done as a test, and at that time we used the IA only version. Cheers Lisa On Tue, Jan 14, 2014 at 11:31 AM, Nathan Tallman wrote: > Lisa, > > Is your local web archive available online? I'd like to see a production > example of non-Internet Archive

Re: [CODE4LIB] archiving web pages

Lisa, Is your local web archive available online? I'd like to see a production example of non-Internet Archive instance of Wayback/Open Wayback. Thanks, Nathan On Tue, Jan 14, 2014 at 12:17 PM, L Snider wrote: > Rob is right on! I included the wrong link, thanks for catching that... > > Cheer

Re: [CODE4LIB] archiving web pages

On Tue, Jan 14, 2014 at 12:08 PM, Francis Kayiwa wrote: > > If Skidmore has an IR I'd looking into adding them into your IR and render > from there (in addition to WARC'ing them) Francis, I'm confused when you say "in addition to WARC'ing them." Wouldn't you be putting the WARC into the IR and

Re: [CODE4LIB] archiving web pages

Rob is right on! I included the wrong link, thanks for catching that... Cheers Lisa On Tue, Jan 14, 2014 at 11:04 AM, Robert Sanderson wrote: > For what it's worth, the latest wayback code is: > > https://github.com/iipc/openwayback > > And being developed by the IIPC consortium, rather th

Re: [CODE4LIB] links from finding aid to digital object

What alternatives has your survey suggested? Would anyone suggest that a finding aid and its digital contents should not be in communication? On Tue, Jan 14, 2014 at 10:12 AM, Steven Majewski wrote: > > On Jan 14, 2014, at 10:54 AM, Johnston, Leslie wrote: > > > I suspect there are some in Vir

Re: [CODE4LIB] archiving web pages

On 1/14/2014 11:48 AM, Kathryn Frederick (Library) wrote: Hi, I'm trying to develop a strategy for preserving issues our school's online newspaper. Creating a WARC file of the content seems straightforward, but how will that content fair long-term? Also, how is the WARC served to an end-user?

Re: [CODE4LIB] archiving web pages

For what it's worth, the latest wayback code is: https://github.com/iipc/openwayback And being developed by the IIPC consortium, rather than just the Internet Archive alone. It has many additional features, contributed by other members. It should be used in preference to the sourceforge vers

Re: [CODE4LIB] links from finding aid to digital object

The Kentucky Digital Library does this as well. Example-- http://kdl.kyvl.org/catalog/xt7rr49g527p/guide Cheers, Sarah Dorpinghaus Digital Projects Library Manager University of Kentucky Digital Library Services 859.257.3329 | sarah.dorpingh...@uky.edu -Original Message- From: Code

Re: [CODE4LIB] archiving web pages

Hi Kathryn, Right now the WARC format is considered the best preservation format for websites/social media, in terms of digital archives. It is our best guess right now. It will likely will be with us for a long time, because it has been adopted by most of the major players. The way I have seen W

Re: [CODE4LIB] archiving web pages

IMO, there are many web archiving situations where it is more appropriate to just focus on the content rather than the manifestation of the content. Just as you wouldn't expect a 1995 article from the NYT to be displayed as the website was in 1995 or an article in an online database to actually app

Re: [CODE4LIB] links from finding aid to digital object

At New York Public Library we attach digital assets in our repository to container list components, for example: http://archives.nypl.org/mss/2993#detailed -Matt On Tue, Jan 14, 2014 at 11:47 AM, Kyle Banerjee wrote: > Archive Engine West http://hero.village.virginia.edu/nwda/ includes EAD > w

Re: [CODE4LIB] links from finding aid to digital object

I'm surprised the Online Archive of California hasn't come up yet: http://www.oac.cdlib.org/ See, for example: They have been doing this for quite some time, and I would consider it a "reference" implementation of this ki

[CODE4LIB] archiving web pages

Hi, I'm trying to develop a strategy for preserving issues our school's online newspaper. Creating a WARC file of the content seems straightforward, but how will that content fair long-term? Also, how is the WARC served to an end-user? Is there some other method I should look at? Thanks in advan

Re: [CODE4LIB] links from finding aid to digital object

Archive Engine West http://hero.village.virginia.edu/nwda/ includes EAD with direct links to digital content as well as a way to search digital content directly that links back to finding aids. If you want a quick example of a search that illustrates the process, just type in "lovejoy." This bring

Re: [CODE4LIB] links from finding aid to digital object

On Jan 14, 2014, at 10:54 AM, Johnston, Leslie wrote: > I suspect there are some in Virginia Heritage, but I don't know how to limit > a search to finding aids with links. > > http://vaheritage.org/ No way to search by links, as hrefs are part of xml tags and only text, not tags are indexed

Re: [CODE4LIB] links from finding aid to digital object

Hi Ed, At NYU we have a workflow where we programatically load handles into the Archivist Toolkit using a plug-in written by Nathan Stevens. These handles then appear in the exported EAD, which is then transformed into HTML. Here is an example: http://dlib.nyu.edu/findingaids/html/fales/woj/dscre

Re: [CODE4LIB] links from finding aid to digital object

I suspect there are some in Virginia Heritage, but I don't know how to limit a search to finding aids with links. http://vaheritage.org/ > -Original Message- > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of > Edward Summers > Sent: Tuesday, January 14, 2014 10:3

Re: [CODE4LIB] links from finding aid to digital object

Hi Ed, I only have a second to respond, but we have digital content available in our Finding Aids site. You can view images (microfiche style), browse thumbnails, or download a PDF. Unfortunately, we don't have a "viewer" for AV content at the moment, but do link out to the files when we can.

Re: [CODE4LIB] links from finding aid to digital object

Aldo Leopold Papers: http://digital.library.wisc.edu/1711.dl/wiarchives.uw-lib-leopoldpapers I can provide you with some sample EAD XML from this collection, if you're interested. -- Scott On 01/14/2014 09:38 AM, Edward Summers wrote: Hi all, I was wondering if anyone can point me at examp

[CODE4LIB] Job: Web Developer at University of New Brunswick

Web Developer University of New Brunswick Fredericton UNB's Harriet Irving Library, Fredericton, invites applications for the position of Web Developer. The Systems Group at the University of New Brunswick Libraries has an opening for a Web Developer to join our dynamic and enthusiastic team. We a

[CODE4LIB] links from finding aid to digital object

Hi all, I was wondering if anyone can point me at example(s) of finding aids (either EAD XML or HTML) that are linked to digital object of some kind. For example a container list that links to a digital image that is available on the Web. I’m doing a bit of an informal survey so if you see some

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

I regularly take the 100 bus to get to and from RDU airport when I travel. It is my default for airport travel. The schedule doesn't always work for my flight times. Also note that I do not believe this bus runs on Sundays when many folks are probably going to be coming into town. If it works for y

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

Does that mean we can have Code4Lib in Sunny Southern California? (Lookin' at you, UCLA, USC, CSUN, CSLB, LMU...) On Jan 14, 2014, at 2:53 AM, Chris Fitzpatrick wrote: > Also, last time few time I was in LA I took the Metro to/from the airport > and it was great. > I think the Green line goes t

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

Salvete!     Yo,yo,yo public transport is good enough for Sergey Brin and his google glass. #justsayin http://www.theguardian.com/technology/2013/jan/21/sergey-brin-google-glass-new-york-subway Cheers, Brooke - Original Message - > From: Chris Fitzpatrick > To: CODE4LIB@LISTSERV.ND

Re: [CODE4LIB] Public transport from RDU to Sheraton Raleigh and how safe is it?

Also, last time few time I was in LA I took the Metro to/from the airport and it was great. I think the Green line goes to LAX and the Red Line goes to North Hollywood and Burbank. But you would run the danger of running into Ed Begley Jr., so there's that. On Tue, Jan 14, 2014 at 12:48 AM, And