We have an 8 step approach to data migration from data audit to quality check after migration. While it is a guide, we will identify the necessary steps for your business.
Data Migration Process
- Audit the original data source: In this stage, we take a look at your data source ensuring data completeness, identifying duplicates, identifying format or data inconsistency as well as identifying any outdated records.
- Matching current data to new system’s data hierarchy: Next, we need to create a data map between the two data sources. A crucial step that ensures all data is migrated. After fields are mapped, we can identify and correct formatting issues that need to be updated and highlight any data that cannot move over.
- Creating custom fields to ensure all data is migrated: It is common that you have created custom fields in your system and we need to consider how this data comes across to where it is now going to live. We need to customize your new platform to ensure no data is lost by creating new fields in the right format.
- Data Clean-Up: Prior to migrating data, it is critical to address duplicates, especially when merging multiple data sources into one. We also clean-up data formatting issues – for example, if one system has a binary field of True/False and the new system uses 1/0. It is important to manipulate your data to the new format. Additional services can include data augmentation and verification, normalization strategies and ongoing best practices in maintaining a clean dataset.
- Establishing data migration priority: Before we start to migrate your data, we need to set parameters around the hierarchy of importance. By splitting your data into areas of importance, we are able to ensure the most critical information migrates safely and accurately as a priority while also being cognizant of any capacity issues with the new system. This is not to say that all of your data cannot be migrated, but simply establishes priorities within the whole system.
- Quality Control: Quality control includes verifying that all data that was established as migration priority is there, all fields are in the correct format, duplicates have been eliminated and we have all the fields with corresponding data included in the final file. This stage is critical since it is where we commonly see issues like special characters – which we can fix before polluting your new system with bad formatting.
- Data Migration Begins: Once all prior steps are completed, we can now migrate your data. We work with several different formats including images, videos, PDF files as well as data text usually in the form of CSV. It depends on your new system and the requirements.
- Final Quality Check: Once the initial migration is complete, we will conduct a final check to ensure the imported file matches what you are seeing in your new system.