Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Entry Files
Procedures for converting single pages into Encyclopedia entries.
Process Entry Files
Run cleanup routine on all new entry files
Fix Runovers
Fix runover entries.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
  - Prep and Convert Pages to Entry Files
    Before page files can be converted to entry files, we need to do some housekeeping.
  - Entry-Inventory File
    Document the filenames of every entry in a section using the entry-inventory file.
  - Process Entry Files
    Run cleanup routine on all new entry files
    - Cleanup Entry Files
      Check entry files for common problems.
    - Editorial Notes
      Check for notes by editors.
    - Fix Runovers
      Fix runover entries.
    - Review Page Inventory Comments
      Address any issues raised in the page-inventory notes.
    - Validate Entry Files
      Use Oxygen to validate the entry files.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Fix Runovers

Fix runover entries.

Runovers appear in two places:

entries that have to be pieced back together.
footnotes that run over to subsequent pages.

This section details how to rejoin entry pieces. For footnote runovers, see Review Inventory Comments.

In the entry-inventory, see if the entry term for the first entry in the section ends with "CONTD". This indicates that it contains continuation text that runs over from the last entry in the previous section.
Open both files: the original entry file (called an 'entry stub') and the continuation file.
In the continuation file, copy all content from the <div> tag to the end.
Paste the copied text at the end of the original entry file, making a note of the line number. Go back to paste location.
Change the <div> to a self-ending tag by changing the closing >> to />. (This avoids problems with </div> at the end of the file.) Then rename <div> to <pb>. Delete @type and @xmlns. Remove the hyphen and final two digits from the value of @xml:id.
Remove the substitute entry term ending in "CONTD" and validate the corrected file.
Close the continuation file and remove it from the batch by moving it to the ebnn/_removed_files folder for the edition.