Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Organization
How to keep hundreds of thousands of files organized.
Repositories
A guide to the different repositories used to store ocr-project data.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
  - Edition-Section System
    File organization depends on two basic folder types
  - Folder names
    As the OCR workflow passes through its various stages, production moves into specific folders for each stage. Their names and contents are given below:
  - Repositories
    A guide to the different repositories used to store ocr-project data.
    - Google Drive
      Used for image files.
    - GitHub
      Used for data files.
    - archive Repository
      Long-term storage of image files
  - Setting Up the Repositories
    Create local copies of the remote repositories
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Repositories

A guide to the different repositories used to store ocr-project data.

A repository is a collection of files and folders, like a file cabinet. All data for the Nineteenth-Century Knowledge Project resides in one of eight repositories.


name	location	contents
archive	HDD	Image files from multiple scans of different Encyclopedia Britannica editions
eb03	Google Drive	ocr-project files
eb07	Google Drive	ocr-project files
eb09	Google Drive	ocr-project files
eb11	Google Drive	ocr-project files
information	Google Drive	General information used by the Knowledge Project
metainfo	Google Drive	Informational material relevant to generating metadata for the entries.
outputs	GitHub	This repository contains the output from the OCR process and everything that follows in creating the master file. It also includes derivatives, code, and analytics.