Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Entry Files
Procedures for converting single pages into Encyclopedia entries.
Entry-Inventory File
Document the filenames of every entry in a section using the entry-inventory file.
Quick check of entry terms

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
  - Prep and Convert Pages to Entry Files
    Before page files can be converted to entry files, we need to do some housekeeping.
  - Entry-Inventory File
    Document the filenames of every entry in a section using the entry-inventory file.
    - Quick check of entry terms
    - Full Check of Entry Terms List
      Compare our list of recognized entry terms with the print pages.
  - Process Entry Files
    Run cleanup routine on all new entry files
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Quick check of entry terms

Entry terms in the newly-created entry-inventory should be given a quick check for obvious errors before proceding further. Such a check can reveal problems that can best be solved by modifying the page files and re-running the Python conversion. This generates a new set of files and an updated Entry_Stats.txt file which will then modify the entry-inventory list of terms. If you need to consult the page originals, follow the procedure in Entry-Inventory File.

Review the list of entry terms in the entry-inventory for errors. In addition to known misspelling, check:
1. Words out of alphabetical order. These are probably scannos.
2. Words with accidentals. OCR often confuses the descenders from the live above as an accidental for capital letters.
Mark changes in the entry-inventory file first, before fixing the files. This avoids having to make the corrections twice if you discover that you need to rerun the Python conversion.