The Big Move: What You Need to Know About Data Migration for Salesforce
Note: This blog has been revised to include up-to-date information.
Say you just bought a new house and you're finally moving in. Hooray! However, you quickly realize that not all your furniture will work with the layout of the house — certain pieces are too large, too small, too awkward or unnecessary for their respective rooms. So now you're tasked with re-configuring your furniture layout, throwing out some old furniture and perhaps shopping for new pieces. And suddenly, your move-in process just becomes a lot more time consuming than you had planned.
Now imagine your new Salesforce database is that new house, and your data is the furniture. You have to move, or migrate, your data from your old database into Salesforce, but the process is not as simple as it may sound. During a Salesforce implementation, data migration can consume 40-60% of the total labor. And it’s an expense that’s sometimes overlooked when you first start planning a Salesforce project.
When you consider configuration, training, and project management, data migration stands out as one of the biggest costs of implementation. There are four fundamental reasons for this:
1) Your data is probably a mess.
And that’s OK! Almost every organization’s data is a mess in the beginning, and this is what consultants assume when they engage with you. Duplicates and inconsistent/incomplete data are common culprits for the mess. Sometimes referred to as "data froth," when you have more than 5% duplicates and numerous inconsistent data, things start to "dirty." Searches don't work properly and reports begin to fail, giving you a database full of "dirty data."
The data has to be cleaned, and this takes time. Data deduplication solutions help speed up the process, and data can be deduped post-migration, reducing the overall cost of migration. The bigger challenge, however, is addressing data inconsistencies and incompletions, which are more difficult to fix globally and must be resolved PRIOR to migration if records are to be matched up properly.
2) Your data is not formatted properly for your new database.
Your data probably resides in legacy systems like NeonCRM, Blackbaud, or a warren of spreadsheets you’ve cobbled together over the years. Extracting data properly can be challenging. Here is why: often times people will load two field values into a single field (first name and last name, for example). Before import can occur those values must be split (parsed) before they can be migrated into their proper fields in your new database.
It is also important to mention that the opposite can occur where two field values (such as street address and suite number) need to be merged (concatenated) before import can begin. The process of concatenation and parsing is time-consuming because it can not be reconciled globally — it must be assessed and addressed on a field-by-field basis. Automation can be used to help speed up the process, but only if your data is consistent.
3) In order to migrate the data you must "map" where it goes.
Data mapping is an important component of ensuring the configuration of the new system supports your data from the old system.
What is mapping? Essentially, mapping is the process for choosing a destination for your data in your new database from where it currently lives in your legacy system. Where you may have had one field in your legacy database, you may now have two in the new database, and vice versa. In addition, you may have decided to change the field names altogether which can cause confusion in the migration process if this renaming has not been documented.
Finally, you may have decided to completely change your business workflow (which usually happens when you move to a more powerful CRM), which means you have added tables and triggers which can make the mapping process all the more complex.
4) Once your data is cleaned, formatted, and mapped, you are then tasked with importing the data.
When most people move to a new database, they are looking for three fundamental improvements: better search capability, better reporting, and a better user interface. In order to get these features you are going to need a database with more tables and field values. The process of importing often requires a separate import phase for each new table in the database.
An import phase requires you to import the data, assign a record number for each piece of data and its associated table, export that data for matching to related tables, and then importing the matched data back into the database as a bundle. What this boils down to is that the more tables you have, the more import phases are required. This process becomes more time consuming with each new table you have in your database.
In some cases, import tools can be utilized to help reduce the number of phases required for import, but these tools often require some technical expertise and don’t clean the data for you.
In an effort to reduce costs of data migration it is not uncommon for some vendors to recommend fewer tables. But be warned! Yes, that will reduce the cost of the overall data migration, largely because it will reduce the need for parsing your data. However, what you will not discover until later is that you may be unable to produce the reports you require, ultimately finding yourself in the exact same position you found yourself in your legacy database.
This leads to our top four recommendations for how you can best prepare yourself for success before data migration:
- Start cleaning your data now. If you are migrating from multiple systems, work on normalizing your data and get a unique identifier across systems in place.
- Provide your consulting group with a list of reports you wish to compile before migration begins. This will give the consultants a sense of what tables and how many tables you require before they begin configuration.
- Have realistic expectations about the amount of time and effort it may take to prepare and migrate your data. Your consultants can help set these expectations after a data review.
- Engage staff members who know your data well to help with preparations and data migration validation.
At the end of the day, data migration may not be the most exciting part of setting up your shiny new database, but it is every bit as important as the design and building of the database. You simply can not have one without the other any more than you can have a new home with improperly fitted furniture.
Ready to start your data migration to Salesforce?
Learn how our team of consultants can help you.
