Self-Service Dimensional Data Analytics: Scalable Patterns for Data-Driven Enterprises (2018)

By Francesco Dorigo, Bao Nguyen & Daniel Howell, Comcast

The IP video analytics platform design described herein streamlines the conversion of event-based analytics telemetry into time series visualization. With this objective in mind, Comcast developed a platform with the flexibility to support a wide variety of data producers and data consumers, and with the scalability to provide an enterprise solution for real-time analytics.

Parametrized and configurable execution libraries automate repetitive data engineering tasks. In addition, our analytics system provides abstraction layers both for data ingress and data egress, which enables a seamless evolution of the ETL (Extract, Transform, Load) pipeline. This has two main advantages: First to simplify the efforts related to upgrading the pipeline by letting producers and consumers evolve at their own pace, and second, the underlying technologies can seamlessly evolve with zero impact for ingestion and aggregation layers (producers and consumers).

This document describes the major components of our IP video analytics data pipeline, with a specific focus on custom components. This design reduces the time between data ingress and insight.

By clicking the "Download Paper" button, you are agreeing to our terms and conditions.

Similar Papers

Helm: Self-Service Customer Data Platform
By Sriharsha Gangam, Comcast Cable
Planned Maintenance Tool (PMT): A Data-Driven Approach to Recommending the Best Time for Planned-Maintenance
By Pete Quesada, Julianne Heinzmann, Nishesh Shukla, Resmi Vijayan, Mike O’Dell, May Merkle-Tan; Comcast Cable
Self Service Activation A Field Study Of High-Speed Data (HSD) Self Install
By Bruce F. Bahlmann, MediaOne Internet Services Group
Create Data-Driven Solutions to Optimize IP Content Delivery and Identify Revenue Opportunities
By Brennen Lynch and Anukool Lakhina, Guavus, Inc.
Access Network Data Analytics
By Karthik Sundaresan & Jay Zhu, CableLabs
Encourage EVERY Employee to Learn and Utilize Data, Analytics, and Machine Learning (DAML)
By Robert Gray Wald, MS, SCTE® a subsidiary of CableLabs®
Photon Avatars in the Comcast Cosmos: An End-to-End View of Comcast Core, Metro and Access Networks
By Venk Mutalik, Steve Ruppa, Fred Bartholf, Bob Gaydos, Steve Surdam, Amarildo Vieira, Dan Rice; Comcast
Applications Of Big Data Analytics To Identify New Revenue Streams & Improve Customer Experience
By Anukool Lakhina and Brennen Lynch, Guavus, Inc.
Implement Closed-Loop Network Decisioning Now with Big Data Analytics and Fuel Future-State SDN Use Cases Through a Common Platform Deployment
By Brennen Lynch and Anukool Lakhina, Guavus, Inc.
New Generation Data Governance for Charter Network:1
By Jay Liew, Mark Teflian, Bruce Bacon, Jay Brophy & Randy Pettus, Charter Communications
More Results >>