Transforming a Manufacturing Enterprise into a Data-Driven Powerhouse
Oct 01, 2023
Client
The client is a global leader in elevator and escalator manufacturing and generates over USD 12 billion annually.
Challenges
The current Business Warehouse (BW) reports were slow in generating results.
There was a need to transition to a mature data-driven operating mode.
A cloud data warehousing and analytics solution was required to harness the power of cloud computing for significant data transformation.
Data required transformation, standardization, and quality control.
There was a need for integration and migration of big data to the cloud.
LTM Solution
Databricks, with its Spark engine and massively parallel processing (MPP) power, excelled in processing big data quickly.
It helped transform large datasets into a standard data model through its medallion architecture.
Databrick’s medallion architecture, a data design pattern was utilized to organize data logically.
This architecture was implemented to incrementally and progressively improve the structure and quality of data as it flows through each architecture layer (from bronze to silver to gold layer tables).
Business Benefits
Reduced the Extract, Transform, and Load (ETL) time from 26 to 6 hours
Handled over 50 million incremental data daily with improved quality using Delta Lake in Databricks
Delivered business reports faster, with more accuracy, and better quality
Increased the adoption of PBI reports and enabled the movement of users from BW reports to PBI reports