Skip to main content

Data SME / NBC News

Implemented automated data compliance processes and optimized real-time processing and dashboard solutions for NBCUniversal, enhancing data management, subscription tracking, and viewership monitoring to support strategic decision-making.

NBC News

Client Information​

  • Client: NBC News
  • Role: Subject Matter Expert / Data Engineering
  • Year: 2024

Project Overview​

Driving Innovation and Compliance: Enhancing NBCUniversal's data management and real-time insights for superior operational performance.

NBC Universal Office

Background​

In my role as a Subject Matter Expert at NBCUniversal, I led the development of automated solutions for CCPA/GDPR compliance, utilizing Airflow and Databricks to streamline the "Data Subject Request" process for data deletion and masking. I tackled performance challenges in Adobe's real-time streaming processing, implementing a framework to optimize task distribution and enhance efficiency in Spark.

Additionally, I developed real-time dashboards for subscription tracking and viewership monitoring, using tools like Looker to provide stakeholders with up-to-the-minute insights across platforms and events, from live broadcasts to major occasions like the 2024 elections and Black Friday.

Technical Implementation​

Data Compliance Automation​

  • Implemented Airflow DAGs for automated "Data Subject Request" processing
  • Developed Databricks notebooks for efficient data masking and deletion
  • Created comprehensive audit trails for compliance verification
  • Reduced manual processing time by over 85%

Real-time Processing Optimization​

  • Identified bottlenecks in Adobe's streaming data pipeline
  • Implemented custom Spark optimizations for enhanced throughput
  • Designed framework for optimal task distribution across clusters
  • Achieved 3x performance improvement in streaming data processing

Dashboard Development​

  • Created real-time dashboards using Looker and Power BI
  • Implemented subscription tracking across all NBC platforms
  • Developed viewership monitoring for live broadcasts
  • Built special dashboards for major events (elections, Black Friday)