Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Organization
How to keep hundreds of thousands of files organized.
Repositories
A guide to the different repositories used to store ocr-project data.
GitHub
Used for data files.
outputs Repository
Explains the content of the outputs repository.
page Folder
Pages are individual printed pages in the Encyclopedia.
2-page-docx Folder
Container for Word .docx page files created by ABBYY FineReader.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
  - Edition-Section System
    File organization depends on two basic folder types
  - Folder names
    As the OCR workflow passes through its various stages, production moves into specific folders for each stage. Their names and contents are given below:
  - Repositories
    A guide to the different repositories used to store ocr-project data.
    - Google Drive
      Used for image files.
    - GitHub
      Used for data files.
      - outputs Repository
        Explains the content of the outputs repository.
        autoindex folder
        Collects all materials needed for indexing entry files.
        code Folder
        The central repository for program code and transformation scripts.
        digital-editions Folder
        Storage area for editions generated from the master files.
        entry Folder
        Contains the TEI-encoded data after the page files are converted to entry files.
        master Folder
        Contains the master files for creating digital editions.
        metadata Folder
        A collection of files containing metadata for each entry page.
        page Folder
        Pages are individual printed pages in the Encyclopedia.
        2-page-docx Folder
        Container for Word .docx page files created by ABBYY FineReader.
        3-page-tei Folder
        Container for TEI page files.
        records Folder
        A collection of spreadsheets and other documents recording details of the production and analytical work.
    - archive Repository
      Long-term storage of image files
  - Setting Up the Repositories
    Create local copies of the remote repositories
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

2-page-docx Folder

Container for Word .docx page files created by ABBYY FineReader.

This folder contains the docx page files created by ABBYY FineReader. Each file represents one printed page. All .docx filenames, like those below, use the convention:

edition - section - page-sequence-number

The page-sequence-number is the sequence of the page in the section; pages in every section always begins at 0001, regardless of the printed page number.

The file eb11-w03-0005.docx contains the text of the fifth page in the third section of the letter "W" for the eleventh edition.