topic-model-db

DDL and load db scripts for History Lab topics models.

Run the sql script ddl/topic-model.sql to install the topic model tables in an existing schema.

To load topic models in History Lab csv format, run the following scripts in this order:

1. load/create-stage-tables.sql
2. load/load-stage-tables-pg.sh (PostgreSQL only)
3. load/populate-tables.sql
4. load/drop-stage-tables.sql

Rename doc_id column in the topic_docs table if necessary and add referential integrity constraint.

TODO: support direct load into tables

1. keep ddl/topic-model.sql to create topic-model tables for new corpus schemas
2. create a backup-topic-model script
3. update load-stage-tables-pg.sh for direct load including drop constraints, truncate and recreate indices
4. remove *tables.sql