Serverless Data and Analytics Platform on Snowflake in AWS Cloud For a Global Electric Company

May 01, 2023

The client is a Fortune 1000 public utility company based in the US. It is primarily into the function of energy distribution to customers.

Vast amount of siloed data across different business functions, which required lots of time to process and cleanse it to meet the business user’s needs.
Poor data insights and unavailability of right data at right time for decision-making.
The turnaround time to load historical data to datawarehouse was several hours.
Overall, the data platform was not dynamically scalable to handle the concurrent data load and deliver information as per business expectations.
Distribution of IT costs to all concerned departments.

Develop the end-state architecture and automated dataflow to ingest data from Oracle to s3 bucket onto snowflake for data discovery and insight leveraging LTM Canvas polarsled framework.
Use TableShift (LTM accelerators) to reduce migration time from over weeks to few days from Oracle tables and create equivalent in Snowflake.
Leverage Snowflake as the core data warehouse platform to fully leverage pay-as-you-go pricing, auto scaling-up and across and data sharing with customers.
Configure Serverless component snow pipe to read S3 events to ingest data onto stage table.

Cost-effective and scalable platform providing near real-time visibility to serve customer requests
5TB Volume of data migrated over 8 weeks with >5 FTE effort
8-10 Business apps migration in progress
Enhanced Performance 2x as compared to RedShift
Reduce IT spend around 30 to 50% by providing better and efficient data platform