Adoption · domains · origins

Library and information science

Not a vertical but the discipline the other nine pages borrow from. Vocabulary construction, identity resolution and metadata interchange were solved here first, and the rulebooks are published.

Domains · Adoption · W3C SKOS · ISO 25964

Why this page leads the set

Library and information science is not a vertical. It is the discipline the other nine pages borrow from, which is why it is the first entry rather than a peer of the rest.

The case for that position is not sentimental. In the talk cited below, Jessica Talisman puts it at 3:22: as the 1990s big-data movement optimised for storage first and query layers second, library and information science was already building metadata ecosystems threaded through machine-readable records for governance, reliability and consistency. Libraries went online in the 1960s, before the web, because worldwide catalogues had to be searchable and their records reconcilable. Those systems are still in service, connecting libraries for lending and access.

The practical consequence for an agentic programme is a sourcing rule. When a team starts modelling a domain and reaches for a bespoke vocabulary, it is usually about to re-solve a problem with a published rulebook. The vocabulary stage of the pipeline is a library-science stage, and the rulebook it cites is a library-science standard.

Where the method comes from

At 9:04 the pipeline's first stage is handed a construction standard rather than a modelling preference: a guideline for the construction, format and management of monolingual controlled vocabularies, to be read alongside the W3C's SKOS documentation. Stated aims, in the same passage: eliminate ambiguity, control synonyms, test and validate, and establish relationships between concepts.

That is ANSI/NISO Z39.19, and it is the document that turns a glossary into a controlled vocabulary. Three references carry the stage:

  • ANSI/NISO Z39.19 — the construction rulebook: preferred terms, aliases, definitions, scope notes, and the discipline of deciding what is one concept and what is two.
  • ISO 25964-1 and -2 — the thesaurus standard, and the standard for interoperability and mapping between vocabularies. Part 2 is the one to read if the plan involves aligning a local vocabulary to a published one.
  • W3C SKOS — the encoding that makes a vocabulary machine-readable, with preferred, alternative and hidden labels, definitions, and broader, narrower and related relations.

Two of these already have pages on this site, at W3C SKOS and ISO 25964. This page covers what the rest of the domain set does with them.

What is reusable, by layer

Library and information science standards, by what they buy an agent
Layer Standards What it gives an agent
Vocabulary construction ANSI/NISO Z39.19; ISO 25964-1 and -2; W3C SKOS Ambiguity and synonym control by rule rather than by taste
Thesauri in service MeSH; AGROVOC; UNESCO and EuroVoc; NASA Thesaurus; LCSH; Getty AAT, ULAN and TGN Concepts that were curated by people and have been maintained for decades
Identity resolution ISNI (ISO 27729); ORCID (ISO 27716); VIAF; LC/NACO authority files; ISIL (ISO 15511) Answering “which one is this” for people and organizations, a problem authority control has handled since the 1970s
Persistent identifiers DOI (ISO 26324); ARK; URN (RFC 8141); ISBN (ISO 2108); ISSN (ISO 3297) References an agent can resolve and rely on over time
Bibliographic models IFLA LRM, consolidating FRBR, FRAD and FRSAD; RDA; ISBD The work, expression, manifestation and item distinction that most enterprise data models never make
Record formats MARC 21; UNIMARC; MARCXML; MODS; METS; EAD; BIBFRAME 2.0 MARC is the legacy format and BIBFRAME is its linked-data successor; the migration is itself the lesson
Interchange protocols Z39.50 (ISO 23950); SRU and SRW with CQL; OAI-PMH; ResourceSync; OpenURL and KBART Moving metadata between systems that never agreed on a schema — the original interoperability problem
Provenance and preservation PREMIS; OAIS (ISO 14721); ISO 16363; W3C PROV-O; CIDOC CRM (ISO 21127) An audit trail for a record: who changed it, when, and on what authority
Metadata schemas Dublin Core / DCMI Terms (ISO 15836) The second pipeline stage, specified and in wide use since 1995

Read as a whole, the table is an argument. Every layer in it corresponds to something an agent now needs, and almost every one of them predates the agent.

The playbook

Reuse
Align to ANSI/NISO Z39.19 for construction, ISO 25964 for thesaurus structure and mapping, and SKOS for encoding. Do not write your own vocabulary rules, and do not reach for OWL before a concept scheme has been tested.
Scope
One bounded term space with a visible boundary: one product catalogue, one internal function, one reporting vocabulary. Not the organization's vocabulary.
Competency questions
Is this one concept or two? Which label is preferred and which are aliases? Who owns this definition? Which published vocabulary should this local term map to?
Smallest artifact
A concept scheme: preferred label, alternative labels, definition, scope note, owner, source. Publish it as SKOS, and keep it in version control.
Validation
Have the domain experts adjudicate a sample of mappings and definitions, and record their disagreements. The disagreements are the requirements; the agreements are usually already known.
Characteristic failure
Synonym collapse and silent duplication — two terms that mean the same thing, or one term that means two. Neither raises an error, and both degrade retrieval for as long as they persist.

Limits of this page

  • The domain is standards-rich, which makes reuse cheap, and adoption-poor inside AI teams, which makes the work unfamiliar. Standing behind a vocabulary nobody curates is worse than having none, because it implies a check that is not happening.
  • The pipeline described below stops at the semantic structures. Library science does not supply validation, permission, currentness or agent coupling; those have to come from elsewhere in this set.
  • Several of the sources are cited by name only, because their publishers do not serve the pages to automated clients. The links that are published here were fetched and their bodies inspected.

FAQ

Because the problem is older than the field solving it. Libraries were building machine-readable catalogues for worldwide lending before the web existed, and had to solve identifier ambiguity, record reconciliation and metadata interchange to do it. The vocabulary method agentic systems are now rediscovering is a solved discipline in library and information science.

ANSI/NISO Z39.19, Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies. It is the construction rulebook behind the vocabulary stage: preferred terms, aliases, definitions, scope notes and the relationships between concepts. It is the one cited in the talk this page draws on.

No. Library science solved vocabulary construction, identity resolution and metadata interchange — the first half of the problem. It did not solve validation, permission, currentness or agent coupling, which is where most of the remaining work sits.

Because loc.gov and viaf.org do not serve these pages to an automated client reliably, so a link could not be verified. On this site an unverifiable link is dropped rather than published, and the standard is cited by name instead.

Sources

Links were fetched with a browser user agent and their bodies inspected. Standards whose publishers answer automated clients with a challenge page or a redirect stub are cited by name, number and year instead of linked, following the convention already used for ISO on this site.

  1. ANSI/NISO Z39.19-2005 (R2010), Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies — NISO
  2. ISO 25964-1:2011 and ISO 25964-2:2013, Information and documentation — Thesauri and interoperability with other vocabularies (cited by number; ISO pages are not linkable). See also this site's page on ISO 25964: https://knowledgesidekick.org/standards/iso-25964/
  3. W3C, SKOS Simple Knowledge Organization System Reference, W3C Recommendation, 18 August 2009; and the SKOS Primer, W3C Working Group Note, 18 August 2009 (cited by name and date; w3.org answers automated clients with a Cloudflare challenge). See also this site's page on SKOS: https://knowledgesidekick.org/standards/skos/
  4. IFLA, Library Reference Model (IFLA LRM), 2017, consolidating FRBR, FRAD and FRSAD (cited by name and date)
  5. IFLA, ISBD Consolidated Edition, 2011 (cited by name and date)
  6. Library of Congress, BIBFRAME 2.0; MARC 21 formats; MARCXML; MODS; METS; PREMIS; LCSH; Z39.50 (ISO 23950); SRU (cited by name; loc.gov is not reachable from an automated client)
  7. Library of Congress, Virtual International Authority File (VIAF), and the LC/NACO authority file (cited by name)
  8. National Information Standards Organization, ResourceSync
  9. Open Archives Initiative, Protocol for Metadata Harvesting, version 2.0
  10. NLM, Medical Subject Headings (MeSH) (cited by name: the MeSH home path answers automated clients with a redirect stub rather than the vocabulary)
  11. Getty Research Institute, Art & Architecture Thesaurus; also ULAN and TGN
  12. DCMI Metadata Terms — Dublin Core
  13. CIDOC CRM, the cultural-heritage reference model, published as ISO 21127
  14. ORCID, researcher identifiers
  15. DOI Foundation, the DOI system
  16. ISNI, International Standard Name Identifier, ISO 27729 (cited by name: isni.org answers automated clients with a Cloudflare challenge)
  17. Wilkinson et al., The FAIR Guiding Principles for scientific data management and stewardship, Scientific Data 3, 2016
  18. Jessica Talisman, Knowledge Infrastructures and the Ontology Pipeline for AI Systems (O'Reilly Data Superstream, video), transcript of 0:00-18:56 — the source of the pipeline stages, the Z39.19 reference at 9:04, and the library-science framing at 3:22

Page updated .