Welcome to the NoSQL Database Migration Project repository. This project is a part of the BSc (Hons) Computing program coursework, focusing on the practical application of database migration techniques from an SQL DBMS to a NoSQL DBMS. Specifically, this project involves the migration of a PostgreSQL database to MongoDB.
The source PostgreSQL database presents a zoo management system, and its schema and data can be accessed through the following link: Relational Database Repository.
The main goal of the migration was to automatize as many processes as possible. The migration process is structured in the following way:
-
Data Model Rethink: The initial step involved changing the data model to comply with MongoDB database design principles. The revised NoSQL data model visualization is available in the assets folder for review.
-
Data Export: The data from the PostgreSQL database was exported in JSON, which is compatible with MongoDB documents format. The exported JSON files, representing 13 SQL tables, can be found in the SQL-Tables-JSON directory.
-
Data Transformation: The exported JSON files were then transformed using a Python script to match the NoSQL data model. This transformation resulted in four JSON documents ready for import into MongoDB.
-
JSON Schema Validation: To maintain the integrity, consistency and safety of the data within the MongoDB database, the JSON Schema Validation was set up.
-
Database Population: Using the Bash script along with mongoimport tool, the transformed JSON populates the MongoDB database with data.
- To simplify the database transfer process, additional ID fields were included alongside the _id field for each collection. For instance, fields such as animal_id, employee_id, and others were transferred from the SQL database and are designed to assist in referencing the documents.