Course Outline
Module 1: An introduction to the architecture and configuration of Confluent Apache Kafka clusters
- The role of Kafka in modern data pipelines
- Key distinctions between Apache Kafka and Confluent Kafka
- Core elements: producers, consumers, brokers, topics, and partitions
- Deployment models for Kafka clusters and scaling considerations
Module 2: Configuring Zookeeper Quorums
- An overview of Zookeeper
- The specific role of Zookeeper within a Kafka cluster
- Determining Zookeeper Quorum size
- Managing Zookeeper configuration
- Implementing SSH on servers
- Practical exercise: Configuring Zookeeper (both as a team and as a service)
- Utilising the Zookeeper Command Line Interface (CLI)
- Practical exercise: Configuring a Zookeeper Quorum
- Understanding the Zookeeper internal file system
- Performance factors that impact Zookeeper
- Demonstration of management tools for Zookeeper and Zoonavigator
Module 3: Configuring the Kafka Cluster
- Fundamental Kafka concepts
- General Kafka configuration settings
- Practical exercise: Configuring Kafka brokers
- Practical exercise: Executing Kafka commands
- Practical exercise: Setting up a Kafka Multi-Broker Cluster
- Practical exercise: Testing the Kafka cluster
- Verifying connectivity to the Kafka cluster
- The Advertised.listeners configuration: a critical setting
- Topic-specific configurations
- Settings for downloading and ingesting messages within topics
- Practical exercise: Demonstrating Kafka resilience
- Kafka performance: Input/Output (I/O)
- Kafka performance: Network (RED)
- Kafka performance: RAM
- Kafka performance: CPU
- Kafka performance: Operating System (OS)
- Kafka performance: Other factors
- Practical exercise: Modifying Kafka broker configuration
Module 4: Advanced Kafka Configuration
- Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry configuration
- Sending and receiving messages via CLI, Java, and the Spring framework
- Monitoring metrics and tools (such as Confluent Control Center and Elasticsearch)
- Log files and offset management
- High availability and disaster recovery principles
- Ensuring high availability through replication
- Optimising producer and consumer performance
- Disaster recovery strategies
- Failover control and data recovery procedures
- Connector configuration
- Implementing Kafka Connect
- Kafka security features
Summary and Next Steps
Requirements
- Proficiency in distributed systems and messaging concepts
- Practical experience with the Linux command line
- A foundational grasp of networking and system administration
Intended Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customised Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from £4800 + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
