Model Selection and Error Estimation in a Nutshell

Luca Oneto (Autor)

Buch | Hardcover

XIII, 132 Seiten

2019 | 1st ed. 2020
Springer International Publishing (Verlag)
978-3-030-24358-6 (ISBN)

Artikel merken

How can we select the best performing data-driven model? How can we rigorously estimate its generalization error? Statistical learning theory answers these questions by deriving non-asymptotic bounds on the generalization error of a model or, in other words, by upper bounding the true error of the learned model based just on quantities computed on the available data. However, for a long time, Statistical learning theory has been considered only an abstract theoretical framework, useful for inspiring new learning approaches, but with limited applicability to practical problems. The purpose of this book is to give an intelligible overview of the problems of model selection and error estimation, by focusing on the ideas behind the different statistical learning theory approaches and simplifying most of the technical aspects with the purpose of making them more accessible and usable in practice. The book starts by presenting the seminal works of the 80's and includes the most recent results. It discusses open problems and outlines future directions for research.

Luca Oneto was born in Rapallo, Italy in 1986. He received his BSc and MSc in Electronic Engineering at the University of Genoa, Italy respectively in 2008 and 2010. In 2014 he received his PhD from the same university in the School of Sciences and Technologies for Knowledge and Information Retrieval with the thesis ``Learning Based On Empirical Data''. In 2017 he obtained the Italian National Scientific Qualification for the role of Associate Professor in Computer Engineering and in 2018 he obtained the one in Computer Science. He worked as Assistant Professor in Computer Engineering at University of Genoa from 2016 to 2019. In 2018 he was co-founder of the spin-off ZenaByte s.r.l. He is currently Associate Professor in Computer Science at University of Pisa with particular interests in Statistical Learning Theory and Data Science. Besides being an editorial board member of the book series Modeling and Optimization in Science and Technologies he is also co-author of the textbook Introduction to Digital Systems Design (Donzellini et al., Springer, 2019).

Introduction.- The "Five W" of MS & EE.- Preliminaries.- Resampling Methods.- Complexity-Based Methods.- Compression Bound.- Algorithmic Stability Theory.- PAC-Bayes Theory.- Di erential Privacy Theory.- Conclusions & Further Readings.

Erscheinungsdatum	27.07.2019
Reihe/Serie	Modeling and Optimization in Science and Technologies
Zusatzinfo	XIII, 132 p. 62 illus.
Verlagsort	Cham
Sprache	englisch
Maße	155 x 235 mm
Gewicht	379 g
Themenwelt	Informatik ► Datenbanken ► Data Warehouse / Data Mining
	Informatik ► Theorie / Studium ► Künstliche Intelligenz / Robotik
	Mathematik / Informatik ► Mathematik
	Technik
Schlagworte	Algorithmic Stability Theory • Complexity-Based Methods • Compression Bound • Data-Driven Models • Differential Privacy Theory • Empirical data • error estimation • Model Selection • PAC-Bayes Theory • Rademacher Complexity Theory • Resampling methods • statistical learning theory • Union and Shell Bounds • Vapnik-Chernovenkis Theory
ISBN-10	3-030-24358-3 / 3030243583
ISBN-13	978-3-030-24358-6 / 9783030243586
Zustand	Neuware