Comments on: Googlizing a Digital Library

By: The Code4Lib Journal – Googlizing a Digital Library » Web Design

The Code4Lib Journal – Googlizing a Digital Library » Web Design — Wed, 14 Mar 2012 22:40:42 +0000

[...] The Code4Lib Journal – Googlizing a Digital Library [...]

By: Matthew Theobald

Matthew Theobald — Tue, 16 Dec 2008 04:46:54 +0000

The deep, invisible and hidden web are the common terms. More recently the idea of the “structured” web has risen. ISEN.org has a solution for cataloging digital libraries coming from a library and information science perspective. You might investigate our project and feel free to ask questions.

By: Laurie Phillips

Laurie Phillips — Mon, 15 Dec 2008 15:37:33 +0000

You say:
“While directed query engines are an area of intense research…”
I am doing some research on the deep web and can’t find any recent references to the term “directed query engine”. Is this a common concept that is usually called by another name?
Thanks in advance.

By: Jody DeRidder

Jody DeRidder — Tue, 25 Mar 2008 19:34:27 +0000

Hi Joe!
Very cool. I’m surprised you’re not having them index the full text, however. Why not? It will maximize the access to your information. Ours was using DLXS12. Is Google using your browse pages at all? Our static ones really made a difference in our hits, and I think the hidden metatags helped too, though I know it’s difficult to add those using the dynamic system.
I’d also thought about using rewrites of URLs to redirect the crawlers…

By: Joseph Shubitowski

Joseph Shubitowski — Tue, 25 Mar 2008 15:20:01 +0000

Jody – most interesting as are working through all the same issue here with our DLXS collections. We have version 13 up now and find that we can submit sitemaps to Google with URLs in the form of:
http://archives.getty.edu:8082/cgi/f/findaid/findaid-idx?c=utf8a;idno=US::CMalG::90.R.11
that go directly to the correct dynamic page in DLXS. We have tweaked the title tags so that we get the title we want Google to see and index, and after a week, we are seeing good results and relatively high rankings.

Previously, we were on version 11a and had generated static cached pages that we used for both indexing and retrieval (as DLXS speed was a problem). The switch to 13 allowed us to dump all that staic work. Tom Burton-West did all that work here at GRI before going to UMich last year to join the DLPS/DLXS team.

Great article! Thanks for sharing all the detail and the research.

Joe Shubitowski