Apache Spark and Scala

Apache Spark and Scala Training Syllabus

Introduction to Spark

  • Big Data Analytics
  • There are Other Alternatives, then Why go for Spark
  • What is Spark
  • What is the difference between spark1 and spark2
  • Spark Features
  • Spark in Hadoop Ecosystem and How to Useful with Hadoop
  • Saprk Components
  • Saprk Architecture and SparkContext
  • Spark deployement Modes
  • Spark Clusters
  • Spark on Shell
  • Spark web UI
  • SBT
  • Helloworld With SBT
  • Creating Spark Helloworld Program in scala
  • Executing through spark-submit

Introduction to Scala

  • Understanding to Scala
  • Feature and Benefit of Scala
  • Classes and Objects
  • Basic Types and Operations
  • Exception Handling
  • Collections
  • Packages and Imports
  • Working with Lists
  • Stateful Objects

Programming Model  with Spark

  • What is RDD ?
  • Features of RDD’s
  • CREATING RDD
  • RDD Partition
  • RDD Lineage Graph
  • RDD Transformations and Actions
  • Common Transformations and Actions
  • Persistance (Caching)
  • Key Value Pair RDD
  • Creating Pair RDD
  • Data Loading and Saving through RDD
  • File Formats
  • File Systems
  • Structured Data with Spark
  • Databases
  • Data Partitioning
  • Accumalator
  • BroadCast Variable

Spark Streaming

  • What is streaming
  • Architecture of Spark Streaming
  • Output Operators
  • Input Sources
  • Transformations
  • Checkpointing

 

Spark SQL

  • What is Spark SQL
  • Spark SQL Features
  • Comparison Between Hive, Impala and Spark SQL
  • Spark SQL Architecture
  • Spark SQL Libraries
  • Data Source API
  • DataFrame API
  • SQL Interpreter and Optimizer
  • SQL Service
  • What is SQL Context
  • SQL Queries
  • Caching
  • Creating Datasets
  • Interoperating with RDDs
  • JSON Dataset
  • JDBC/ODBC
  • User Defined Functions

 

Machine Learning using spark MLIB

  • What is Machine Learning?
  • Who is using Machine Learning
  • Different types of Machine Learning
  • Spark’s Mllib
  • Why Mllib
  • Spark Mllib Tools
  • Clustering
  • K-Means Clustering
  • K-MeanAlgorithm

Course Video

The Course Videos Section.

Course Overview

The Course Overview Section.