Home
Production
Descriptions of OCR processing, TEI transformation, and metadata creation
Organization
How to keep hundreds of thousands of files organized.
Setting Up the Repositories
Create local copies of the remote repositories

Production
Descriptions of OCR processing, TEI transformation, and metadata creation
- Organization
  How to keep hundreds of thousands of files organized.
  - Edition-Section System
    File organization depends on two basic folder types
  - Folder names
    As the OCR workflow passes through its various stages, production moves into specific folders for each stage. Their names and contents are given below:
  - Repositories
    A guide to the different repositories used to store ocr-project data.
  - Setting Up the Repositories
    Create local copies of the remote repositories
    - Install Drive File Stream
      Add Drive File Stream to the computer for accessing the ebnn and metadata repositories.
    - Install Github Desktop
      Set up GitHub to create the outputs repository on your machine.
    - Using Github
      Pull and push files at the beginning and end of every session with outputs.
- Page Files
  Explains the procedures we use to get the best quality OCR of each page.
- Entry Files
  Procedures for converting single pages into Encyclopedia entries.
- Master Files
  After creating entry files, we run an automated metadata generation process to add index terms to each entry.

Setting Up the Repositories

Create local copies of the remote repositories

Files for the Nineteenth-Century Knowledge Project are stored in eight different repositories.


repository	location
archive	Stored locally on an external hard disk drive, so you need to connect it to your computer to access those files.
eb03, eb07, eb09, eb11, metainfo, information	Stored in the cloud on Google Drive. We use SyncBack Free to create a local copy of Google Drive created by Google Drive File Stream.
outputs	Stored on GitHub. We use GitHub Desktop to clone a local copy.

On the external hard drive provided to you, create the appropriate ebnn folder in the root (top-level) directory.
Create an empty outputs folder in the root directory
Follow the instructions on the next page to install Google Drive File Stream and copy the appropriate ebnn repository to the supplied external hard drive.
Create a clone of the complete outputs repository following the instructions for installing and using GitHub Desktop.