APPROACH

The approach to address the client’s challenge included:

  • Setting up a central Cloud-Data warehouse as a single source of truth
  • Laying the foundational data architecture that classified requests into zones based on repeatability and use
  • Implementation of a metadata-driven governance system focused on UI to capture datarequests
  • Building re-usable frameworks to enable the platform to serve personas with data requests, platform usage requests and insights requests
  • Harnessing the power of Data-Bricks on Azure to create a dynamic, auto-scalable ingestion layer based on workload

KEY BENEFITS

  • Azure native solution easily integrable with Collibra governance platform powered by Rest-API for an organization wide transparency
  • Manages record changes via unified streaming, and in-built data-quality layer using the delta-lake feature of data-bricks
  • Loosely coupled frameworks for logging/Alerting & monitoring which are cloud-agnostic and can be re-configured and used as needed

RESULTS

  • The time taken to on-board data decreased to a 24-hour interval
  • Overall storage and computing cost reduced by 30%
  • One platform – to bring your own data, Platform & data services and Insights services

亚洲自拍偷拍