Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Entry Files
Procedures for converting single pages into Encyclopedia entries.
Process Entry Files
Run cleanup routine on all new entry files
Cleanup Entry Files
Check entry files for common problems.

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
  - Prep and Convert Pages to Entry Files
    Before page files can be converted to entry files, we need to do some housekeeping.
  - Entry-Inventory File
    Document the filenames of every entry in a section using the entry-inventory file.
  - Process Entry Files
    Run cleanup routine on all new entry files
    - Cleanup Entry Files
      Check entry files for common problems.
    - Editorial Notes
      Check for notes by editors.
    - Fix Runovers
      Fix runover entries.
    - Review Page Inventory Comments
      Address any issues raised in the page-inventory notes.
    - Validate Entry Files
      Use Oxygen to validate the entry files.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Cleanup Entry Files

Check entry files for common problems.


search	replace	settings
Find remaining @@@s
`@`		manual cleanup
Encode anchored marginal notes
`(<note\s+anchored=\"true\"\s+n=\"\d{1,3}\"\s+place=\")bottom(\"\s+type=\"authorial\"\s><p>) (<hi\s+rend=\"[\w\s]\">)\s\[\sm\s\]`	`\1margin\2\3`	regex
Encode unanchored marginal notes
`(<note\s+anchored=\")true(\"\s+n=\"\d{1,3}\"\s+place=\")bottom(\"\s+type=\"authorial\"\s><p>) (<hi\s+rend=\"[\w\s]\">)\s\[\smu\s\]`	`\1false\2margin\3\4`	regex
Remove false space within entry terms
`<label>([A-ZÀ-Ù]{2,}) ([A-ZÀ-Ù]{2,})`	`<label>\1\2`	regex
Remove life dates from entry terms
`(\s+\(c)(</hi></label>)`	`\2\1`	regex; check every instance