Self-Service Dimensional Data Analytics: Scalable Patterns for Data-Driven Enterprises (2018)

By Francesco Dorigo, Bao Nguyen & Daniel Howell, Comcast

The IP video analytics platform design described herein streamlines the conversion of event-based analytics telemetry into time series visualization. With this objective in mind, Comcast developed a platform with the flexibility to support a wide variety of data producers and data consumers, and with the scalability to provide an enterprise solution for real-time analytics.

Parametrized and configurable execution libraries automate repetitive data engineering tasks. In addition, our analytics system provides abstraction layers both for data ingress and data egress, which enables a seamless evolution of the ETL (Extract, Transform, Load) pipeline. This has two main advantages: First to simplify the efforts related to upgrading the pipeline by letting producers and consumers evolve at their own pace, and second, the underlying technologies can seamlessly evolve with zero impact for ingestion and aggregation layers (producers and consumers).

This document describes the major components of our IP video analytics data pipeline, with a specific focus on custom components. This design reduces the time between data ingress and insight.

By clicking the "Download Paper" button, you are agreeing to our terms and conditions.

Similar Papers

Helm: Self-Service Customer Data Platform
By Sriharsha Gangam, Comcast Cable
Planned Maintenance Tool (PMT): A Data-Driven Approach to Recommending the Best Time for Planned-Maintenance
By Pete Quesada, Julianne Heinzmann, Nishesh Shukla, Resmi Vijayan, Mike O’Dell, May Merkle-Tan; Comcast Cable
Unlocking the Power of Big Data: “The Key Workforce Skills Operator’s Need for the Future of Analytics”
By Steven R. Harris, Society of Cable Telecommunications Engineers, Inc.
Self Service Activation A Field Study Of High-Speed Data (HSD) Self Install
By Bruce F. Bahlmann, MediaOne Internet Services Group
Exploring the Benefits of Network Intelligence Applications to Optimize HFC Networks Using a Data-Driven Design Approach
By Diana Linton, Charter Communications; Esteban Sandino, Charter Communications; Nader Foroughi, Technetix Inc.; Keith Auzenne, Charter Communications; Premton Bogaj, Technetix Inc.
Create Data-Driven Solutions to Optimize IP Content Delivery and Identify Revenue Opportunities
By Brennen Lynch and Anukool Lakhina, Guavus, Inc.
Access Network Data Analytics
By Karthik Sundaresan & Jay Zhu, CableLabs
An Innovative Data Driven Approach to Optimize WiFi Performance
By Maryam Miri, Rogers Communications Inc; Kevin Esdale, Rogers Communications Inc
Encourage EVERY Employee to Learn and Utilize Data, Analytics, and Machine Learning (DAML)
By Robert Gray Wald, MS, SCTE® a subsidiary of CableLabs®
Applications Of Big Data Analytics To Identify New Revenue Streams & Improve Customer Experience
By Anukool Lakhina and Brennen Lynch, Guavus, Inc.
More Results >>