Best Big Data and Hadoop Course in Kolkata

10 SEATS

COURSE INSTRUCTOR

Mr. Prashant.

Sr. Hadoop Developer & Consultant.

Mr. Prashant is expert in Big Data Technologies and he has worked with top level IT companies.

BASIC INFORMATION

Price : Call Now.
Lessons : 12
Length : 3 Month
Level : Advance
Category : Analysis

Started : 15 APR 2024
Shift : 02
Class : 90

APPLY NOW

Course Description

Big Data is all about distributed data processing and it is an emerging field in the current IT sector, professionals are using hadoop for processing huge amount of data that is stored on various RDBMS and company servers.this course will upgrade your skills in apache spark, python, scala and ETL operations uisng sqoop moreover, you will learn how real time data is processed using apache kafka.

After completion of this course you'll be able to work on big data tools moreover,you will be an expert of python and scala programming language.In this couse you will learn how to do distributed data processing using python and scala.

We will start this course with basics of Hadoop and its architecture then you will work on hadoop advance level Tools like Apache Sqoop and Apache Hive that is required to process big data,you will learn how to analyze different types of data sets and how ot visualize and generate reports.

Course Syllabus

Module 1: Introduction to Big Data & Hadoop

Introduction to big data and its background.
Understading the role of Hadoop Framework.
A Brief History of Distributed Computing.
Understanding the Basics of Distributed Computing.
Understading Data Warehouses and its role.
Understading Big Data vs Traditional Data Warehouse Systems.
Introduction to RDBMS.
Working on IBM DB2 or Mysql.
Working on DB2/Mysql Databases and Tables.
DB2/Mysql Hands on Lab.
Understanding RDBMS in a Big Data Environment

Module 2: Installation and Configuration of Big Data tools.

Understanding the Basics of Virtualization.
Virtual machine installation and its configuration.
Implementing Virtualization to Work with Big Data
Setup and Configuration of Cloudera VM.
Understading Cloudera HDFS and Cloudera Manager.
Understanding Cloudera and mysql Database.

Module 3: Hadoop Distributed File System.

Introduction to Hadoop Distributed File System.
Hadoop Cluster Architecture.
Undersatding Name Node and Data Nodes in Hadoop.
Understanding the role of Job Tracker and Task Tracker.
Role of Secondary Name Node.
Data Replication and rack awareness.
High Availability in Hadoop.
Working on HDFS File System.
Useful Commands to Manage HDFS.
HDFS Hands on Lab.

Module 4: Map Redduce - A Distributed Architecture

Introduction to Map & Reduce
Deep background of Map Reduce.
Understanding the map Functions.
Understanding the reduce Function.
Working on map and reduce together.
Map Reduce Programming using java.
Temperature analysis using Map Reduce programming.
Assignments on Map Reduce programming.

Module 5: Data Warehousing using Hive.

An Introduction to Apache Hive.
Introduction to dataware house.
Understand Hive environment and its Architecture.
Hive Thrift Server and Hive Client.
Working with Hive Query Language(HQL).
Perform DDL approach Through Hive
Nested Queries in Hive.
Hive partitioning and bucketing.
Working on Hive User Defined Function.
Hive Left Join and Right Outer Join.
Windowing Function in Hive.
Hands on Lab on apache Hive.

Module 6: ETL - Working on Sqoop and Flume

An Introduction to ETL techniques.
introduction of Apache Sqoop .
Requirement of Sqoop and its background.
Performing sqoop operations on hadoop datawarehouse.
Loading data using Sqoop tool in Cloudera.
Introduction to Flume and its methodology.
Requirement of Apache Flume
Activating Flume Agent on Hadoop and working on Sink.
Execution of Flume Agent on hadoop.

Module 7: Big Data Processing Using Apache PIG.

Introduction to Apache Pig.
Apache Pig Architecture
Undersatding Pig Local and Map Reduce Mode.
Working with pig Script.
Executing and managing Pig Script on Hadoop.
Apache Pig Advantages and Disadvantages.
Working on PIG User Defined Functions.
Assignments on Apache Pig

Module 8: Working on Apache Spark Using Scala and Python.

Introduction to Apache Spark.
An Introduction to python programming.
Working on scala programming Language.
An Introduction to Apache Spark.
Understanding Run time Architecture of Spark.
Working on RDD-Resilient Distributed Data Sets.
Creating Spark RDD using Scala and Python.
Eclipse setup and Configuration for Apache Spark.
Spark App development using Scala.

Module 9: Apache Spark Transformations and Actions.

Working on Spark Transformations and Actions.
Performing Map Transformation on RDD.
Performing FlatMap Transformation on RDD.
Performing Filter Operation on Spark RDD.
Executing GroupByKey and ReduceByKey.
Understanding Union and Join Operations on RDD.
Word Count Analysis using scala Programming Language.
Introduction to HDFS and Hue Environment.

Module 10: Apache YARN and Spark SQL.

Understanding YARN Architecture.
Understanding Resource Manager and App Manager
Understanding YRAN Slave Demon.
Background of Node Manager & App Master
Role of Containers in YARN.
Understanding Yarn JOB in Cloudera.
Spark-shell (Scala and Python shell ).
Use Pair RDDs to Join Two Datasets.

Module 11: Working on DataFrames in Spark SQL.

Executing Spark Application.
Spark SQL on Cloudera Virtual Machine.
Understanding HIveContext and SQLContext.
Working on Data Frames using Python.
Working on Data Frames using Scala.
Understanding Case Class and Row functionality.
Perform Join Operations on Data Frames.

Module 12: Apache Spark Streaming and Apache Kafka.

An Introduction to Spark Streaming.
Developing Network Streaming Module.
Working on Streaming Context.
Windowing Live Stream using spark Streaming module.
Introduction to Apache Kafka.
Produce and Consume Apache Kafka Message.
Collect Web Server Logs with Apache Flume.
Send Web Server Log Messages from Apache Flume to Apache Kafka.
Working on Broadcast variables & Accumulators.
Why Spark Streaming.
Developing Network Streaming App.
Working on Streaming Context.
Windowing Network Stream using spark Streaming module.

Module 13: Real Time Project Development in Big Data.

An Introduction to Project Development.
Project Assignments.
Task Allocation and Project guidance.
Final Project Submission.

Student Reviews

Our Student reviews after completion of this course.

Frequently Asked Questions

Q.1- Will i get certificate after completion of this course.?

Yes, you will get industry valid certificate after completeion of this course and you will be tagged as a Big Data Expert.

Q.2- Can I pay my fee in installments.?

Yes, You can pay your fee in two installments but it depands on the course you selected.

Q.3- I do not belong from IT background. Can I join Big Data online course.?

Yes, You can join Big Data & Hadoop online course even if you do not belong from computer science background. Our experts will help you to upgarde your technical skills, you just need some basic computer skills for this course.

Q.4- Does this course is practical oriented.?

This course is 100% practical oriented, you will work on cloudera, HDFS, Hive, Pig, Sqoop and Flume moreover, you will work on how to work on distributed data processing using apache spark and KAFKA.

Q.5- Why Should I Join DigiStacKedu.?

DigiStackEdu provide cost effective and quality training,We focus on every student and we understand the value of money.Our Trainers are certified and having more than 10+ years of experience in Digital Marketing, Data Science, Java Programming, Web Designing, Big Data and Data Analytics moreover,We have Trained 47,000+ students and professionals who are working in top level IT companies.

Q.6- Can i do Internship after this course.?

DigiStackEdu only provide internship in Data Science, Digital Marketing, Java Programming, PHP programming and Web Development.For more details please contact to our support team.

Q.7- What is the future of Big Data & Hadoop course.?

Big Data and Apache Spark is the most demanding Data processing Framework in the current IT industry and you'll get a lot of job opportunity after completion of this course.

Q.8- What is the policy of Money Back at DigiStackedu?

You can submit your fee after 3 classes, Even after that if you face any issue with in the next 7 days then you can contect to our support team for the return.

Q.9- How much time it will take to be master in Big Data and Hadoop. ?

We'll start this course by very basic concepts of Big Data and Hadoop further we'll move to the advance concept of Hadoop.It will take approx 3 month to be master of Big Data after that you will get a industry valid cerficate and will get a tag as a Hadoop Expert.

BIG DATA & HADOOP COURSE IN KOLKATA