Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Entry Files
Procedures for converting single pages into Encyclopedia entries.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
  - Prep and Convert Pages to Entry Files
    Before page files can be converted to entry files, we need to do some housekeeping.
  - Entry-Inventory File
    Document the filenames of every entry in a section using the entry-inventory file.
  - Process Entry Files
    Run cleanup routine on all new entry files
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Entry Files

Procedures for converting single pages into Encyclopedia entries.

Attention: This section is no longer maintained and is posted for information only.

ABBYY FineReader generates separate files for each page of the Encyclopedia. After we convert them to TEI (saved in the 3-tei folder) they are still files of individual pages. For the project, we need files for entire entries, not pages.

To solve this problem, we run a Python script that concatenates the individual page files into a single file. It then segments the file by entry and creates a new file for each, saved in the digital-edition/xml folder.

These new entry files need to be carefully checked and validated. To do this, we use Oxygen XML Editor.