Online Learning Methods for Networking

This book provides a tutorial on a family of sequential learning and decision problems known as the multi-armed bandit problems. In such problems any decision serves the purpose of exploring or exploiting or both. This balancing act between exploration and exploitation is characteristic of this type of "learning-on-the-go" problem, where we have to instantaneously apply what we have learned so far even as we continue to learn. The authors give an in-depth introduction to the technical aspects of the theory of such decision-making technologies. The range is comprehensive and covers topics which have applications in many networking systems. These include: Recommender systems; Ad Placement systems; the smart grid; and clinical trials. Online Learning and Its Applications in Networking is essential reading for students working in networking and machine learning. Designers of many network-based systems will find it a valuable resource for improving their technology.