Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Organization
How to keep hundreds of thousands of files organized.
Repositories
A guide to the different repositories used to store ocr-project data.
GitHub
Used for data files.
outputs Repository
Explains the content of the outputs repository.
page Folder
Pages are individual printed pages in the Encyclopedia.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
  - Edition-Section System
    File organization depends on two basic folder types
  - Folder names
    As the OCR workflow passes through its various stages, production moves into specific folders for each stage. Their names and contents are given below:
  - Repositories
    A guide to the different repositories used to store ocr-project data.
    - Google Drive
      Used for image files.
    - GitHub
      Used for data files.
      - outputs Repository
        Explains the content of the outputs repository.
        autoindex folder
        Collects all materials needed for indexing entry files.
        code Folder
        The central repository for program code and transformation scripts.
        digital-editions Folder
        Storage area for editions generated from the master files.
        entry Folder
        Contains the TEI-encoded data after the page files are converted to entry files.
        master Folder
        Contains the master files for creating digital editions.
        metadata Folder
        A collection of files containing metadata for each entry page.
        page Folder
        Pages are individual printed pages in the Encyclopedia.
        2-page-docx Folder
        Container for Word .docx page files created by ABBYY FineReader.
        3-page-tei Folder
        Container for TEI page files.
        records Folder
        A collection of spreadsheets and other documents recording details of the production and analytical work.
    - archive Repository
      Long-term storage of image files
  - Setting Up the Repositories
    Create local copies of the remote repositories
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

page Folder

Pages are individual printed pages in the Encyclopedia.

The page folder is dedicated to the process of converting the OCR output into TEI. These files are then further processed into the entry files that are stored in the entry folder.

The page folder is structured similarly to the ebnn Repositories. It is subdivided into print edition folders and sections. Each section then contains folders for the different stages of processing each file, as well as a copy of the page-inventory file for that section, named outputs-ebnn-snn.