Students
16
Lectures
198
Course Duration
Unlimited Duration
Updated
September 15, 2022
Apache Kafka is a community distributed event streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged event streaming platform.
Founded by the original developers of Apache Kafka, Confluent delivers the most complete distribution of Kafka with Confluent Platform. Confluent Platform improves Kafka with additional community and commercial features designed to enhance the streaming experience of both operators and developers in production, at massive scale.
Annapurna Singh
0
24
Courses
327
Students
This course will explore the basic concepts of messaging systems, introduction to point to point messaging, publish - subscribe messaging, principles of Apache Kafka Server installation, operations and then it will walk you through the deployment of Kafka cluster in single node and multi node mode. Finally, we will conclude with producer application and consumer application and later I add real-time applications and integration with Big Data Technologies.
The target audience would be the people who are willing to know about Apache Kafka, Zookeeper, Queues, Topics, Client - Server communication, Messaging system (Point to Point & Pub - Sub), Single node server, Multi node servers or Kafka cluster, command line producer and consumer, Producer application using Java API's and Consumer application using Java API's.
We made this course such a way that everyone can understand easily, we added the basic concepts in the beginning lectures , then added advanced topics and finally taught how to use the Kafka server in real time with an example.
Who this course is for:
- Anyone can learn it as this course starts from scratch
- This course is developed for all the Developers and Administrators who want to learn about Kafka servers.
- Who want to learn more about client - server communication
- Students who wants to do a job in middleware
-
- Why Kafka is Needed? Unlimited
- Kafka Use Cases Unlimited
- Who uses Kafka? Unlimited
- Kafka Streaming Architecture Unlimited
- Why Kafka Review Unlimited
- Module :1 Kafka Overview Deck Unlimited
-
- What is Kafka? Unlimited
- Kafka messaging allows Unlimited
- Kafka Decoupling Data Streams Unlimited
- Kafka Usage Unlimited
- Kafka Record Retention Unlimited
- Kafka scalable message storage Unlimited
- Module :2 What is Kafka deck Unlimited
- Kafka Fundamentals Unlimited
- Apache Kafka – Core Kafka Unlimited
- Kafka needs Zookeeper Unlimited
- Kafka Producer/Consumer Details Unlimited
- Kafka Scale and Speed Unlimited
- Kafka Cluster, Failover, ISRs Unlimited
- ZooKeeper does coordination for Kafka Cluster Unlimited
- Failover vs. Disaster Recovery Unlimited
- Module 3: Kafka Architecture Deck Unlimited
- Topics, Logs, Partitions Unlimited
- Topic Parallelism and Consumers Unlimited
- Kafka Topic Partitions Layout Unlimited
- Replication: Kafka Partition Distribution and Leader Unlimited
- Kafka Replication to Partition 0 and 1 Unlimited
- Module 5: Kafka Topics Deck Unlimited
- Kafka Consumer Groups Unlimited
- Kafka Consumer Load Share Unlimited
- Kafka Consumer Groups Processing Unlimited
- Kafka Consumer Failover Unlimited
- Kafka Consumer Offsets and Recovery Unlimited
- Consumer to Partition Cardinality Unlimited
- Multi-threaded Consumers Unlimited
- Module 7: Kafka Consumers Deck Unlimited
- Running many nodes Unlimited
- Create three new server-n.properties files Unlimited
- Modify server-x.properties Unlimited
- Create Startup scripts for three Kafka servers Unlimited
- Start Kafka Consumer and producer Unlimited
- Running consumers in same group Unlimited
- Consumer Failover Unlimited
- Create Kafka Describe Topic Unlimited
- Test Broker Failover Unlimited
- Objectives Unlimited
- Module 9: Kafka Cluster and Failover Deck Unlimited
- Objectives Create Producer Unlimited
- Gradle Build script Unlimited
- Common Kafka imports and constants Unlimited
- Send sync records with Kafka Producer Unlimited
- Running the Producer Unlimited
- Async Send Method Unlimited
- Java Kafka Simple Producer recap Unlimited
- Module 11: Intro to Producers Deck Unlimited
- StockPrice App to demo Advanced Producer Unlimited
- Stock Price Kafka Producer imports,create Producer Unlimited
- Stock App Constants Unlimited
- Stock Price Serializer Unlimited
- Stock Sender imports,Runnable Unlimited
- Run scripts Unlimited
- Module 13: About the App Deck Unlimited
- Kafka Design Motivation Scale Unlimited
- Use Cases Unlimited
- Persistence: Embrace filesystem Unlimited
- Broker Log Config Unlimited
- Kafka Compression Config Unlimited
- Pull vs. Push/Streams:Pull Unlimited
- MOM Consumer Message State Unlimited
- Kafka Broker Failover Unlimited
- Kafka and Quorum Unlimited
- All nodes die at same time. Now what? Unlimited
- Module 15: Kafka Low Level Design Deck Unlimited
- Common Kafka imports and constants Unlimited
- Process messages from Kafka with Consumer Unlimited
- Running both Consumer and Producer Unlimited
- Logging Unlimited
- Pass Unique Group Id Unlimited
- Modify Consumer Unlimited
- Java Kafka Simple Consumer Example Recap Unlimited
- Try this: Consumers in Same Group Unlimited
- Kafka Consumer Review Unlimited
- Module 17: Introduction to Consumers Deck Unlimited
- Avro for Big Data and Data Streaming Architectures Unlimited
- Avro Schema Unlimited
- Confluent Schema Registry Unlimited
- Schema Registry Config Unlimited
- Schema Evolution Unlimited
- Schema Registry Actions Unlimited
- Working with Schemas Unlimited
- Incompatible Change Unlimited
- Use Kafka Avro Deserializer from Consumer Unlimited
- Schema Registry Unlimited
- Module 19: Avro and the Schema Registry Deck Unlimited
- SSL/TLS Overhead Unlimited
- Encrypting client transports Unlimited
- Certificate Authority Unlimited
- Configure servers (Kafka Broker) Unlimited
- Setup Kafka Consumer for SSL Unlimited
- Setup Kafka Producer for SSL Unlimited
- Avoid Man in the middle attacks Unlimited
- Module 21: SSL (Optional) Deck Unlimited
- Steps to add Plain SASL via JAAS Unlimited
- Create JAAS config for ZooKeeper Unlimited
- Create JAAS config for Kafka Brokers Unlimited
- Create JAAS config for Consumer Unlimited
- Modify Producer create Producer() Unlimited
- Module 23: SASL Plain (Optional) Deck Unlimited
- Mirror Maker Unlimited
- Disaster Recovery Unlimited
- Scale Reads / Scale Consumers Unlimited
- Mirror Maker Command Line Unlimited
- Mirror Maker Review Unlimited
- Module 25: Mirror Maker (Optional) Deck Unlimited
