Cloud-Enable your Legacy ETLs

1. Automate ETL Migration Planning & Lineage Capture

First, we leverage Crawler360™ to automatically scan the vast inventory of legacy ETL pipelines to uncover the lineage and source-to-target data flow to find out:

• What ETL pipelines are feeding my data warehouse or data lake? And how many are there?
• What is the end-to-end lineage of my ETL pipelines, from source system to BI tool?
• Which ETL pipelines are not only feeding the data warehouse in-scope for migration, but also other systems?

By defining the lineage and inventory of all in-scope ETL pipelines, we provide customers with quick, actionable insights to plan their migration path to the cloud, without risk of impacting business operations or other dependent systems.

2. Automate ETL Code Re-Pointing & Re-Writing

Then, we leverage SHIFT™ Translator to re-point or re-write all of the legacy ETL code to run natively against the cloud target. Specifically, SHIFT™ Translator can automatically:

• Re-point the legacy ETL pipelines by translating all embedded SQL to the syntax of the target cloud platform (be it Snowflake, Redshift, or others), as well as the XML objects, including source/target connectors, tables, and orchestration logic to run against the target cloud platform, or
  
  
• Re-write the legacy ETL pipeline code to a new cloud-native framework (such as PySpark, Azure Data Factory and Databricks) and retire the legacy vendor tool entirely.

By automating this process, the SHIFT™ Migration Suite provides customers with an end-to-end automated solution to get legacy ETL pipelines running on the cloud fast, efficiently, and without impacting current business processes.

3. Accelerate Cut-Over

• SHIFT™ Tester will automate key aspects of ETL code and data validation testing when completing the migration project, in order to accelerate end-to-end testing efforts. This ensures all translated code compiles and executes with the expected results in the cloud target.
• Crawler360™ will identify dependencies to downstream applications like BI or Analytics tools, in order to define the appropriate migration approach while identifying optimization and consolidation opportunities along the way.