Big Data Processing with Apache Spark
Efficiently tackle large datasets and big data analysis with Spark and Python
Seiten
2018
Packt Publishing Limited (Verlag)
978-1-78980-881-0 (ISBN)
Packt Publishing Limited (Verlag)
978-1-78980-881-0 (ISBN)
No need to spend hours ploughing through endless data – let Spark, one of the fastest big data processing engines available, do the hard work for you.
Key Features
Get up and running with Apache Spark and Python
Integrate Spark with AWS for real-time analytics
Apply processed data streams to machine learning APIs of Apache Spark
Book DescriptionProcessing big data in real time is challenging due to scalability, information consistency, and fault-tolerance. This book teaches you how to use Spark to make your overall analytical workflow faster and more efficient. You'll explore all core concepts and tools within the Spark ecosystem, such as Spark Streaming, the Spark Streaming API, machine learning extension, and structured streaming.
You'll begin by learning data processing fundamentals using Resilient Distributed Datasets (RDDs), SQL, Datasets, and Dataframes APIs. After grasping these fundamentals, you'll move on to using Spark Streaming APIs to consume data in real time from TCP sockets, and integrate Amazon Web Services (AWS) for stream consumption.
By the end of this book, you’ll not only have understood how to use machine learning extensions and structured streams but you’ll also be able to apply Spark in your own upcoming big data projects.What you will learn
Write your own Python programs that can interact with Spark
Implement data stream consumption using Apache Spark
Recognize common operations in Spark to process known data streams
Integrate Spark streaming with Amazon Web Services (AWS)
Create a collaborative filtering model with the movielens dataset
Apply processed data streams to Spark machine learning APIs
Who this book is forData Processing with Apache Spark is for you if you are a software engineer, architect, or IT professional who wants to explore distributed systems and big data analytics. Although you don‘t need any knowledge of Spark, prior experience of working with Python is recommended.
Key Features
Get up and running with Apache Spark and Python
Integrate Spark with AWS for real-time analytics
Apply processed data streams to machine learning APIs of Apache Spark
Book DescriptionProcessing big data in real time is challenging due to scalability, information consistency, and fault-tolerance. This book teaches you how to use Spark to make your overall analytical workflow faster and more efficient. You'll explore all core concepts and tools within the Spark ecosystem, such as Spark Streaming, the Spark Streaming API, machine learning extension, and structured streaming.
You'll begin by learning data processing fundamentals using Resilient Distributed Datasets (RDDs), SQL, Datasets, and Dataframes APIs. After grasping these fundamentals, you'll move on to using Spark Streaming APIs to consume data in real time from TCP sockets, and integrate Amazon Web Services (AWS) for stream consumption.
By the end of this book, you’ll not only have understood how to use machine learning extensions and structured streams but you’ll also be able to apply Spark in your own upcoming big data projects.What you will learn
Write your own Python programs that can interact with Spark
Implement data stream consumption using Apache Spark
Recognize common operations in Spark to process known data streams
Integrate Spark streaming with Amazon Web Services (AWS)
Create a collaborative filtering model with the movielens dataset
Apply processed data streams to Spark machine learning APIs
Who this book is forData Processing with Apache Spark is for you if you are a software engineer, architect, or IT professional who wants to explore distributed systems and big data analytics. Although you don‘t need any knowledge of Spark, prior experience of working with Python is recommended.
Manuel Ignacio Franco Galeano is a computer scientist from Colombia. He works for Fender Musical Instruments as a lead engineer in Dublin, Ireland. He holds a master's degree in computer science from University College, Dublin UCD. His areas of interest and research are music information retrieval, data analytics, distributed systems, and blockchain technologies.
Table of Contents
Introduction to Spark Distributed Processing
Introduction to Spark Streaming
Spark Streaming Integration with AWS
Spark Streaming, ML, and Windowing Operations
| Erscheinungsdatum | 05.11.2018 |
|---|---|
| Verlagsort | Birmingham |
| Sprache | englisch |
| Maße | 191 x 235 mm |
| Themenwelt | Mathematik / Informatik ► Informatik ► Datenbanken |
| Informatik ► Software Entwicklung ► User Interfaces (HCI) | |
| ISBN-10 | 1-78980-881-2 / 1789808812 |
| ISBN-13 | 978-1-78980-881-0 / 9781789808810 |
| Zustand | Neuware |
| Haben Sie eine Frage zum Produkt? |
Mehr entdecken
aus dem Bereich
aus dem Bereich
Aus- und Weiterbildung nach iSAQB-Standard zum Certified Professional …
Buch | Hardcover (2023)
dpunkt Verlag
CHF 48,85
Lean UX und Design Thinking: Teambasierte Entwicklung …
Buch | Hardcover (2022)
dpunkt (Verlag)
CHF 48,85
Wissensverarbeitung - Neuronale Netze
Buch | Hardcover (2023)
Carl Hanser (Verlag)
CHF 48,95
