Data Transfer
PROCESS ​REDESIGN

Analyzed and redesigned the existing ETL process
resulting in a 90% improvement in the run time

Our Client

• Source databases and Extract Transform and Load (ETL) process were poorly designed resulting in frequent stops and restarts requiring manual intervention and multi-shift monitoring of jobs. 
  
• Key weekly and monthly SQL-based reports were taking too long to run (18-26 hours).
  
• Redundancy in data between data sources resulted in numerous errors and anomalous information.

Our Engagement

• Analyzed and redesigned the existing ETL process
  
• Streamlined the extract of data and reduced the redundancy of data
• Clarified data definitions and data sources to ensure the appropriate use of the data
  
• Improved performance of process for rebuilding cubes
• Cleaned-up error logs and underlying processes

Our Results

• Greatly improved speed of new ETL process runs for key weekly reports (2-4 hours a 90% improvement)
  
• Normalized databases with minimal data redundancies
  
• New process resulted in better data clarity and reduction in misunderstanding of the information produced