Introduction to Big Data
Play
Course Content
Introduction to Big Data and Apache Kafka
(14 Lectures)
Big Data Analytics
Play
Need for Kafka
Play
What is Kafka?
Play
Kafka Features
Play
Kafka Concepts
Play
Kafka Architecture
Play
Kafka Components
Play
ZooKeeper
Play
Where is Kafka Used?
Play
Kafka Installation
Play
Kafka Cluster
Play
Types of Kafka Clusters
Play
Configuring Single Node Single Broker Cluster
Play
Kafka Producer
(9 Lectures)
Configuring Single Node Multi Broker Cluster
Play
Constructing a Kafka Producer
Play
Sending a Message to Kafka
Play
Producing Keyed and Non-Keyed Messages
Play
Sending a Message Synchronously & Asynchronously
Play
Configuring Producers
Play
Serializers
Play
Serializing Using Apache Avro
Play
Partitions
Play
Kafka Consumer
(11 Lectures)
Consumers and Consumer Groups
Play
Standalone Consumer
Play
Consumer Groups and Partition Rebalance
Play
Creating a Kafka Consumer
Play
Subscribing to Topics
Play
The Poll Loop
Play
Configuring Consumers
Play
Commits and Offsets
Play
Rebalance Listeners
Play
Consuming Records with Specific Offsets
Play
Deserializers
Play
Kafka Internals
(11 Lectures)
Cluster Membership
Play
The Controller
Play
Replication
Play
Request Processing
Play
Physical Storage
Play
Reliability
Play
Broker Configuration
Play
Using Producers in a Reliable System
Play
Using Consumers in a Reliable System
Play
Validating System Reliability
Play
Performance Tuning in Kafka
Play
Kafka Cluster Architectures & Administering Kafka
(10 Lectures)
Use Cases - Cross-Cluster Mirroring
Play
Multi-Cluster Architectures
Play
Apache Kafka’s MirrorMaker
Play
Other Cross-Cluster Mirroring Solutions
Play
Topic Operations
Play
Consumer Groups
Play
Dynamic Configuration Changes
Play
Partition Management
Play
Consuming and Producing
Play
Unsafe Operations
Play
Kafka Monitoring and Kafka Connect
(9 Lectures)
Considerations When Building Data Pipelines
Play
Metric Basics
Play
Kafka Broker Metrics
Play
Client Monitoring
Play
Lag Monitoring
Play
End-to-End Monitoring
Play
Kafka Connect
Play
When to Use Kafka Connect?
Play
Kafka Connect Properties
Play
Kafka Stream Processing
(5 Lectures)
Stream Processing
Play
Stream-Processing Concepts
Play
Kafka Streams by Example
Play
Stream-Processing Design Patterns
Play
Kafka Streams: Architecture Overview
Play
Integration of Kafka With Hadoop, Storm and Spark
(9 Lectures)
Apache Hadoop Basics
Play
Hadoop Configuration
Play
Kafka Integration with Hadoop
Play
Apache Storm Basics
Play
Configuration of Storm
Play
Integration of Kafka with Storm
Play
Apache Spark Basics
Play
Spark Configuration
Play
Kafka Integration with Spark
Play
Integration of Kafka With Talend and Cassandra
(6 Lectures)
Flume Basics
Play
Integration of Kafka with Flume
Play
Cassandra Basics such as and KeySpace and Table Creation
Play
Integration of Kafka with Cassandra
Play
Talend Basics
Play
Integration of Kafka with Talend
Play
Course Details
Apache Kafka training will take you through the architectural design of Kafka that enables it to process large strings of data in real-time. Kafka stores, processes, and publishes streams of data records seamlessly as they occur and in a durable manner. The speed and performance of Kafka can be attributed to the fact that it runs as a cluster on multiple servers, enabling it to span across several data centers.
IT professionals can use Kafka certification to dive into the intrinsic architecture of Apache Kafka. Moreover, it helps to understand Kafka API streams, learn how it is developed on Java, and eventually develop cutting-edge big data solutions using Kafka.
Who should go for this course?
- Data scientists
- ETL developers
- Data analysts
- BI Analysts & Developers
- SAS Developers
- Big Data Professionals
- Big Data Architects
- Project Managers
- Research professionals
- Analytics professionals
- Professionals aspiring for a career in Big Data
- Messaging and Queuing System professionals
Prerequisites
It is not mandatory for you to have a prior knowledge of Kafka to take up Apache Kafka training. However, as a participant you are expected to know the core concepts of Java or Python to attend this course.
Enquiry
Training Options
Self-paced Training
349
- Lifetime access to high-quality self-paced eLearning content curated by industry experts
- 3 simulation test papers for self-assessment
- Lab access to practice live during sessions
- 24x7 learner assistance and support
Live Virtual Classes
499
- Online Classroom Flexi-Pass
- Lifetime access
- Practice lab and projects with integrated Azure labs
- Access to Microsoft official content aligned to examination
One on One Training
Enquiry Now
- Customized learning delivery model (self-paced and/or instructor-led)
- Flexible pricing options
- Enterprise grade learning management system (LMS)
- Enterprise dashboards for individuals and teams
- 24x7 learner assistance and support
Exam & Certification
- Exam Cost $150
- 60 multiple choice questions in 90 minutes
- No negative scoring
- Remotely proctored on your computer
- Available globally in English
- There is no mention of number of questions need to be correct in order to pass the exam. Result will be shown immediately (PASS or FAIL) at the end of exam. No scoring or percentage is provided.
Frequently Asked Questions
Apache Kafka is one of the most popular publish subscribe messaging systems which is used to build real-time streaming data pipelines that are robust, reliable, fault tolerant & distributed across a cluster of nodes. Kafka supports a variety of use-cases which commonly include Website activity tracking, messaging, log aggregation, Commit log & stream processing. These are reasons why many giants such as Airbnb, PayPal, Oracle, Netflix, Mozilla, Uber, Cisco, Coursera, Spotify, Twitter, Tumblr are looking for professionals with Kafka skills. Getting Kafka certified will help you land your dream job.
To master Apache Kafka, you need to learn all the concepts related to Apache Kafka – Kafka Architecture, Kafka Producer & Consumer, Configuring Kafka Cluster, Kafka Monitoring, Kafka Connect & Kafka Streams. Knowledge of Kafka integration with other Big Data tools such as Hadoop, Flume, Talend, Cassandra, Storm and Spark will be a plus point.
There are a lot of job opportunities for Apache Kafka professionals as it is adopted by both SME & big giants. The average salary of a Software Engineer with Kafka skills is $110,209 whereas a Senior Software Engineer and a Lead Software Engineer can expect average salaries of $131,151 and $134,369 respectively.
- Company
- About Us
- Blog
- Contact Us
- Work with us
- Become an instructor
- For Businesses
- Corporate Training
- Partner Programme