Optimizing DOCSIS 3.0 Configuration in the Upstream through Applied Reinforcement Learning (2021)

By Kevin Dugan, Maher Harb, Dan Rice & Robert Lund, Comcast

In 2020, Comcast deployed a Profile Management Application (PMA) system for optimizing the DOCSIS 3.0 (D3.0) configuration across upstream channels in the network to achieve the proper balance between efficiency and robustness (fault tolerance). The established PMA system strengthens organizational objectives to increase network capacity, proactively respond to impairments, and support robust service optimizations for customers. At its core, the current system adopts a rules-based approach, in which a static policy (in the form of defined thresholds) for the different telemetry features (e.g., signal-to-noise ratio and codeword error rates) govern the choice of channel configuration.

Limitations within PMA exist when shaping telemetry thresholds to adapt to a wider range of environmental conditions. Currently, configurations are assigned to channels starting with conservative profiles and progressively moving toward efficient, yet less robust profiles. Further innovations within Comcast’s PMA implementation focus on the delicate balance of applying intelligent, dynamic decision making policies while preserving proper configurations for the diverse set of network devices.

A reinforcement learning (RL) approach for PMA allows, through experience, learning an optimal policy and therefore, enhancing the criteria used at various decision points. Simultaneously, RL simplifies policy management by consolidating permutations of telemetry boundaries into a single entity, called a ‘state’.

PMA efficacy improves with RL by reducing the latency of transitioning into optimal, efficient profiles, and doing so with increased confidence across varying network conditions. Inherent in this implementation is the risk reduction for operators to deploy more profile changes that maximize capacity without crossing the boundary that introduces disruption in service. This paper introduces a proof-of concept RL-based PMA system along with performance study based on initial experimentation conducted in our laboratory

By clicking the "Download Paper" button, you are agreeing to our terms and conditions.

Similar Papers

Deploying PMA-Enabled OFDMA in Mid-Split and High-Split
By Maher Harb, Dan Rice, Kevin Dugan, Jude Ferreira, Robert Lund; Comcast
2022
Detection and Classification of OFDMA Spectrum Impairments by Machine Learning
By Jude Ferreira, Comcast; Kevin Dugan, Comcast; Maher Harb, Comcast; Mike O’Dell, Comcast; Larry Wolcott, Comcast
2023
Full Scale Deployment of PMA
By Maher Harb, Bryan Santangelo, Dan Rice & Jude Ferreira, Comcast
2020
A Machine Learning Pipeline for D3.1 Profile Management
By Maher Harb, Jude Ferreira, Dan Rice, Bryan Santangelo & Rick Spanbauer, Comcast
2019
A Deep Learning Approach for Detecting RF Spectrum Impairments and Conducting Root Cause Analysis
By Kevin Dugan, Justin Evans, Maher Harb; Comcast
2022
Time is Ripe for D3.0 Farming: Achieving Optimal Spectral Efficiency by Allocating D3.0 Spectrum to OFDM
By Maher Harb, Chad Humble, Sebnem Ozer, Dan Rice; Comcast
2022
Accounting for Every MHz of Bandwidth: Data & Algorithms for Artifact Discovery and Close-Packing of QAMs in Support of Spectrum Activation
By Maher Harb, Comcast; Wenlong Shen, Comcast; Matt Stehman, Comcast; Sanket Walavalkar, Comcast; Dan Rice, Comcast
2023
Towards Fully Automated HFC Spectrum Management
By Jay Zhu, Comcast; Maher Harb, Comcast; Jeff Howe, Comcast; Chad Humble, Comcast; Dan Rice, Comcast
2023
Rapid and Automated Production Scale Activation of Expanded Upstream Bandwidth
By Rob Thompson, Rob Howald, John Chrostowski, Dan Rice, Amarildo Vieira, Rohini Vugumudi & Zhen Lu, Comcast Cable
2021
How Network Topology Impacts Rf Performance: A Study Powered By Graph Representation Of The Access Network
By Maher Harb, Karthik Subramanya, Ramya Narayanaswamy, Sanket Walavalkar & Dan Rice, Comcast
2021
More Results >>