
Scala Programming for Big Data Analytics: Get Started With Big Data Analytics Using Apache Spark
Irfan Elahi
Résumé
The author discusses functions at length and highlights a number of associated concepts such as functional programming and anonymous functions. The book then delves deeper into Scala's powerful collections system because many of Apache Spark's APIs bear a strong resemblance to Scala collections.
Along the way you'll see the development life cycle of a Scala program. This involves compiling and building programs using the industry-standard Scala Build Tool (SBT). You'll cover guidelines related to dependency management using SBT as this is critical for building large Apache Spark applications. Scala Programming for Big Data Analytics concludes by demonstrating how you can make use of the concepts to write programs that run on the Apache Spark framework. These programs will provide distributed and parallel computing, which is critical for big data analytics.
What You Will Learn
- See the fundamentals of Scala as a general-purpose programming language
- Understand functional programming and object-oriented programming constructs in Scala
- Use Scala collections and functions
- Develop, package and run Apache Spark applications for big data analytics
Data scientists, data analysts and data engineers who intend to use Apache Spark for large-scale analytics.
* Chapter 2 - Installing Scalao Introductiono Checking Scala installation status in your systemo Verifying Java development kit (JDK) installation statuso Installing Scala in Windowso Verifying Scala installation statuso Exercise
* Chapter 3 - Using Scala Shello Introductiono Getting help in Scala shello Hello world in Scala REPLo Understanding hello world in Scala REPL step by stepo Real life example: Usefulness of Scala REPL's data type highlighting featureo Paste mode in Scala REPLo Retrieving history in Scala REPLo Auto-completion feature of Scala REPLo Exiting from Scala REPLo Exercise
* Chapter 4 - Variableso Introductiono Immutability of objects in Scalao Defining variables (Mutable and Immutable) in Scalao Why Immutability Is so emphasized in Scala?o Mutability and type-safety caveatso Specifying types for variables and type inferenceo Exercise
* Chapter 5 - Data Typeso Introductiono Exercise - Data typeso Boolean typeo Exercises - Boolean typeo String typeo Exercise - string typeso Special types in Scalao Type casting in Scalao Exercise - special types
* Chapter 6 - Conditional Statementso Introductiono Caveats - Using {} after if/elseo Nested If-else statementso If else as ternary operatoro Pattern matchingo Exercise
* Chapter 7 - Code Blockso Introductiono Caveats - Code Blockso Code Blocks and if/else statementso Exercise
* Chapter 8 - Functionso Introductiono Why use Functions at all?o Intuitive understanding of Functionso Invoking a Functiono Caveats - Function definitiono Functions With multiple parameterso Positional parameterso Default value of parameters in Functionso Function with no arguments aka 0 Parityo Single line functionso When To actually use return statementso Passing function as argumentso Anonymous Functions
* Chapter 9 - Scala collectionso Introductiono Real life and intuitive examples of collectionso Listso Indexing list elementso What can you store in lists?o Widely used lists operationso Iterating over listo Using Map Function for iterating over listso Getting to know Functional Programming conceptso Using foreach on listso Using filter on listso Reduce operation on listso List equality checko Alternative ways to create listso Exercise - listso Setso Map collectionso Indexing a mapo Alternative ways lo create map collectionso Manipulating mapso Iterating through Maps in Functional Styleo Tupleso Indexing tupleso Iterating over tupleso Alternative ways to create tupleso Mutable collectionso Implications related to mutable collectionso Mutable mapso Nested collections
* Chapter 10 - Loopso Introductiono Types of loops in Scalao Guards in for Loopo While Loopo Comparison of for and while Loop: Which one suits well in what scenarios?
* Chapter 11 - Using classes and packageso Introductiono Classes and objects in Scalao Mutating attribute values and caveatso Singleton objectso Classes and packageso Importing packageso Exercise
* Chapter 12 - Exception Handlingo Introductiono Fundamentals of Exception Handling in Scalao Implications in Type Inference and Exception Handlingo Exercise - Exception Handling
* Chapter 13 - Development Lifecycle in Scalao Introductiono Fundamentals of development Lifecycleo Introducing Scala Build Tool (SBT)o Directory Structure for SBTo Dependency Management via SBTo Compiling via SBTo Building and Packaging via SBTo Exercise - Packaging Apache Spark Applications
* Chapter 14 - Hello World in Apache Sparko Development Environment for Apache Spark Developmento Instantiating Spark Session and Context Object Using OOP Conceptso Using Spark Context Object's Functions to Create Spark-Native Data Structure (RDD)o Using RDD's Transformations Employing Functional Programming and Scala Collection Conceptso Employing Scala Functions Concepts in Spark RDD's Transformations
In addition to his technology competencies, Irfan has recently presented at the DataWorks Summit in Sydney on the subject of in-memory big data technologies and in a number of meetups all around the world. He also remains involved delivering knowledge-transfer sessions, training and workshops about big data and machine learning, both within his firm and at clients. He also has launched Udemy courses on Apache Spark for big data analytics and R programming for data science with more than 18,000 students from 145 countries enrolled.
Caractéristiques techniques
PAPIER | |
Éditeur(s) | Apress |
Auteur(s) | Irfan Elahi |
Parution | 19/08/2019 |
Nb. de pages | 306 |
EAN13 | 9781484248096 |
Avantages Eyrolles.com
Consultez aussi
- Les meilleures ventes en Graphisme & Photo
- Les meilleures ventes en Informatique
- Les meilleures ventes en Construction
- Les meilleures ventes en Entreprise & Droit
- Les meilleures ventes en Sciences
- Les meilleures ventes en Littérature
- Les meilleures ventes en Arts & Loisirs
- Les meilleures ventes en Vie pratique
- Les meilleures ventes en Voyage et Tourisme
- Les meilleures ventes en BD et Jeunesse