Library and information science
Not a vertical but the discipline the other nine pages borrow from. Vocabulary construction, identity resolution and metadata interchange were solved here first, and the rulebooks are published.
Why this page leads the set
Library and information science is not a vertical. It is the discipline the other nine pages borrow from, which is why it is the first entry rather than a peer of the rest.
The case for that position is not sentimental. In the talk cited below, Jessica Talisman puts it at 3:22: as the 1990s big-data movement optimised for storage first and query layers second, library and information science was already building metadata ecosystems threaded through machine-readable records for governance, reliability and consistency. Libraries went online in the 1960s, before the web, because worldwide catalogues had to be searchable and their records reconcilable. Those systems are still in service, connecting libraries for lending and access.
The practical consequence for an agentic programme is a sourcing rule. When a team starts modelling a domain and reaches for a bespoke vocabulary, it is usually about to re-solve a problem with a published rulebook. The vocabulary stage of the pipeline is a library-science stage, and the rulebook it cites is a library-science standard.
Where the method comes from
At 9:04 the pipeline's first stage is handed a construction standard rather than a modelling preference: a guideline for the construction, format and management of monolingual controlled vocabularies, to be read alongside the W3C's SKOS documentation. Stated aims, in the same passage: eliminate ambiguity, control synonyms, test and validate, and establish relationships between concepts.
That is ANSI/NISO Z39.19, and it is the document that turns a glossary into a controlled vocabulary. Three references carry the stage:
- ANSI/NISO Z39.19 — the construction rulebook: preferred terms, aliases, definitions, scope notes, and the discipline of deciding what is one concept and what is two.
- ISO 25964-1 and -2 — the thesaurus standard, and the standard for interoperability and mapping between vocabularies. Part 2 is the one to read if the plan involves aligning a local vocabulary to a published one.
- W3C SKOS — the encoding that makes a vocabulary machine-readable, with preferred, alternative and hidden labels, definitions, and broader, narrower and related relations.
Two of these already have pages on this site, at W3C SKOS and ISO 25964. This page covers what the rest of the domain set does with them.
What is reusable, by layer
| Layer | Standards | What it gives an agent |
|---|---|---|
| Vocabulary construction | ANSI/NISO Z39.19; ISO 25964-1 and -2; W3C SKOS | Ambiguity and synonym control by rule rather than by taste |
| Thesauri in service | MeSH; AGROVOC; UNESCO and EuroVoc; NASA Thesaurus; LCSH; Getty AAT, ULAN and TGN | Concepts that were curated by people and have been maintained for decades |
| Identity resolution | ISNI (ISO 27729); ORCID (ISO 27716); VIAF; LC/NACO authority files; ISIL (ISO 15511) | Answering “which one is this” for people and organizations, a problem authority control has handled since the 1970s |
| Persistent identifiers | DOI (ISO 26324); ARK; URN (RFC 8141); ISBN (ISO 2108); ISSN (ISO 3297) | References an agent can resolve and rely on over time |
| Bibliographic models | IFLA LRM, consolidating FRBR, FRAD and FRSAD; RDA; ISBD | The work, expression, manifestation and item distinction that most enterprise data models never make |
| Record formats | MARC 21; UNIMARC; MARCXML; MODS; METS; EAD; BIBFRAME 2.0 | MARC is the legacy format and BIBFRAME is its linked-data successor; the migration is itself the lesson |
| Interchange protocols | Z39.50 (ISO 23950); SRU and SRW with CQL; OAI-PMH; ResourceSync; OpenURL and KBART | Moving metadata between systems that never agreed on a schema — the original interoperability problem |
| Provenance and preservation | PREMIS; OAIS (ISO 14721); ISO 16363; W3C PROV-O; CIDOC CRM (ISO 21127) | An audit trail for a record: who changed it, when, and on what authority |
| Metadata schemas | Dublin Core / DCMI Terms (ISO 15836) | The second pipeline stage, specified and in wide use since 1995 |
Read as a whole, the table is an argument. Every layer in it corresponds to something an agent now needs, and almost every one of them predates the agent.
The playbook
- Reuse
- Align to ANSI/NISO Z39.19 for construction, ISO 25964 for thesaurus structure and mapping, and SKOS for encoding. Do not write your own vocabulary rules, and do not reach for OWL before a concept scheme has been tested.
- Scope
- One bounded term space with a visible boundary: one product catalogue, one internal function, one reporting vocabulary. Not the organization's vocabulary.
- Competency questions
- Is this one concept or two? Which label is preferred and which are aliases? Who owns this definition? Which published vocabulary should this local term map to?
- Smallest artifact
- A concept scheme: preferred label, alternative labels, definition, scope note, owner, source. Publish it as SKOS, and keep it in version control.
- Validation
- Have the domain experts adjudicate a sample of mappings and definitions, and record their disagreements. The disagreements are the requirements; the agreements are usually already known.
- Characteristic failure
- Synonym collapse and silent duplication — two terms that mean the same thing, or one term that means two. Neither raises an error, and both degrade retrieval for as long as they persist.
Limits of this page
- The domain is standards-rich, which makes reuse cheap, and adoption-poor inside AI teams, which makes the work unfamiliar. Standing behind a vocabulary nobody curates is worse than having none, because it implies a check that is not happening.
- The pipeline described below stops at the semantic structures. Library science does not supply validation, permission, currentness or agent coupling; those have to come from elsewhere in this set.
- Several of the sources are cited by name only, because their publishers do not serve the pages to automated clients. The links that are published here were fetched and their bodies inspected.
FAQ
Because the problem is older than the field solving it. Libraries were building machine-readable catalogues for worldwide lending before the web existed, and had to solve identifier ambiguity, record reconciliation and metadata interchange to do it. The vocabulary method agentic systems are now rediscovering is a solved discipline in library and information science.
ANSI/NISO Z39.19, Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies. It is the construction rulebook behind the vocabulary stage: preferred terms, aliases, definitions, scope notes and the relationships between concepts. It is the one cited in the talk this page draws on.
No. Library science solved vocabulary construction, identity resolution and metadata interchange — the first half of the problem. It did not solve validation, permission, currentness or agent coupling, which is where most of the remaining work sits.
Because loc.gov and viaf.org do not serve these pages to an automated client reliably, so a link could not be verified. On this site an unverifiable link is dropped rather than published, and the standard is cited by name instead.
Sources
Links were fetched with a browser user agent and their bodies inspected. Standards whose publishers answer automated clients with a challenge page or a redirect stub are cited by name, number and year instead of linked, following the convention already used for ISO on this site.
- ANSI/NISO Z39.19-2005 (R2010), Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies — NISO
- ISO 25964-1:2011 and ISO 25964-2:2013, Information and documentation — Thesauri and interoperability with other vocabularies (cited by number; ISO pages are not linkable). See also this site's page on ISO 25964: https://knowledgesidekick.org/standards/iso-25964/
- W3C, SKOS Simple Knowledge Organization System Reference, W3C Recommendation, 18 August 2009; and the SKOS Primer, W3C Working Group Note, 18 August 2009 (cited by name and date; w3.org answers automated clients with a Cloudflare challenge). See also this site's page on SKOS: https://knowledgesidekick.org/standards/skos/
- IFLA, Library Reference Model (IFLA LRM), 2017, consolidating FRBR, FRAD and FRSAD (cited by name and date)
- IFLA, ISBD Consolidated Edition, 2011 (cited by name and date)
- Library of Congress, BIBFRAME 2.0; MARC 21 formats; MARCXML; MODS; METS; PREMIS; LCSH; Z39.50 (ISO 23950); SRU (cited by name; loc.gov is not reachable from an automated client)
- Library of Congress, Virtual International Authority File (VIAF), and the LC/NACO authority file (cited by name)
- National Information Standards Organization, ResourceSync
- Open Archives Initiative, Protocol for Metadata Harvesting, version 2.0
- NLM, Medical Subject Headings (MeSH) (cited by name: the MeSH home path answers automated clients with a redirect stub rather than the vocabulary)
- Getty Research Institute, Art & Architecture Thesaurus; also ULAN and TGN
- DCMI Metadata Terms — Dublin Core
- CIDOC CRM, the cultural-heritage reference model, published as ISO 21127
- ORCID, researcher identifiers
- DOI Foundation, the DOI system
- ISNI, International Standard Name Identifier, ISO 27729 (cited by name: isni.org answers automated clients with a Cloudflare challenge)
- Wilkinson et al., The FAIR Guiding Principles for scientific data management and stewardship, Scientific Data 3, 2016
- Jessica Talisman, Knowledge Infrastructures and the Ontology Pipeline for AI Systems (O'Reilly Data Superstream, video), transcript of 0:00-18:56 — the source of the pipeline stages, the Z39.19 reference at 9:04, and the library-science framing at 3:22
Page updated .