Search Engine Coverage of the OAI-PMH Corpus

Frank McCown; Xiaoming Liu; Michael L. Nelson; Mohammad Zubair

doi:10.1109/MIC.2006.41

Search Engine Coverage of the OAI-PMH Corpus

Frank McCown, Xiaoming Liu, Michael L. Nelson, Mohammad Zubair

Harding University

Old Dominion University

Research output: Contribution to journal › Article › peer-review

Abstract

Having indexed much of the "surface" Web, search engines are now using various approaches to index the "deep" Web. At the same time, institutional repositories and digital libraries are adopting the open archives initiative protocol for metadata harvesting (OAI-PMH) to expose their holdings. The authors harvested nearly 10 million records from OAI-PMH repositories. From these records, they extracted 3.3 million unique resource URLs and then conducted searches on samples from this collection to determine how much of the OAI-PMH corpus the three major search engines have indexed.

Original language	American English
Journal	IEEE Internet Computing
Volume	10
DOIs	https://doi.org/10.1109/MIC.2006.41
State	Published - Mar 1 2006

Keywords

Search engines
OAI-PMH

Disciplines

Computer Sciences

Access to Document

10.1109/MIC.2006.41License: CC BY

https://doi.org/10.1109/MIC.2006.41

Cite this

@article{c5c4fb5434b24353a88080e5a8a3c86c,

title = "Search Engine Coverage of the OAI-PMH Corpus",

abstract = " Having indexed much of the {"}surface{"} Web, search engines are now using various approaches to index the {"}deep{"} Web. At the same time, institutional repositories and digital libraries are adopting the open archives initiative protocol for metadata harvesting (OAI-PMH) to expose their holdings. The authors harvested nearly 10 million records from OAI-PMH repositories. From these records, they extracted 3.3 million unique resource URLs and then conducted searches on samples from this collection to determine how much of the OAI-PMH corpus the three major search engines have indexed.",

keywords = "Search engines, OAI-PMH",

author = "Frank McCown and Xiaoming Liu and Nelson, {Michael L.} and Mohammad Zubair",

year = "2006",

month = mar,

day = "1",

doi = "10.1109/MIC.2006.41",

language = "American English",

volume = "10",

journal = "IEEE Internet Computing",

}

TY - JOUR

T1 - Search Engine Coverage of the OAI-PMH Corpus

AU - McCown, Frank

AU - Liu, Xiaoming

AU - Nelson, Michael L.

AU - Zubair, Mohammad

PY - 2006/3/1

Y1 - 2006/3/1

N2 - Having indexed much of the "surface" Web, search engines are now using various approaches to index the "deep" Web. At the same time, institutional repositories and digital libraries are adopting the open archives initiative protocol for metadata harvesting (OAI-PMH) to expose their holdings. The authors harvested nearly 10 million records from OAI-PMH repositories. From these records, they extracted 3.3 million unique resource URLs and then conducted searches on samples from this collection to determine how much of the OAI-PMH corpus the three major search engines have indexed.

AB - Having indexed much of the "surface" Web, search engines are now using various approaches to index the "deep" Web. At the same time, institutional repositories and digital libraries are adopting the open archives initiative protocol for metadata harvesting (OAI-PMH) to expose their holdings. The authors harvested nearly 10 million records from OAI-PMH repositories. From these records, they extracted 3.3 million unique resource URLs and then conducted searches on samples from this collection to determine how much of the OAI-PMH corpus the three major search engines have indexed.

KW - Search engines

KW - OAI-PMH

UR - https://scholarworks.harding.edu/computer-science-facpub/8

UR - https://doi.org/10.1109/MIC.2006.41

U2 - 10.1109/MIC.2006.41

DO - 10.1109/MIC.2006.41

M3 - Article

VL - 10

JO - IEEE Internet Computing

JF - IEEE Internet Computing

ER -

Search Engine Coverage of the OAI-PMH Corpus

Abstract

Keywords

Disciplines

Access to Document

Other files and links

Cite this