The repository contains the materials (i.e. agendas, slides, demos, exercises) for Apache Kafka™ and Kafka Streams workshops led by Jacek Laskowski.

The current version of the workshop may take up to 3 days and is intended for a variety of IT roles (e.g. software developers, administrators, operators and architects).

The course is designed to help you master the essential aspects and operation of Apache Kafka and Kafka Streams in a fairly short time. After the course, you should have a clear understanding of Kafka with regard to administration, operation and application development.

No prior experience with Apache Kafka™ or Kafka Streams required.

1. The Essentials of Apache Kafka (Architecture and Core Concepts)
2. Working with Kafka Topics
   1. Replicas and In-Sync Replicas (ISRs)
   2. Managing Topics with kafka-topics shell script
3. Kafka Configuration
   1. Kafka Server and Scheduled Recurring Tasks
4. Monitoring Kafka Cluster
5. Troubleshooting and Debugging
   1. KafkaMetricsGroup
   2. LogManager and /tmp/kafka-logs (Failure and Recovery)
6. Internals of KafkaServer and Other Services

1. Kafka Producers and Consumers
2. Developing Kafka Producers
   1. Producer API
   2. KafkaProducer
3. Developing Kafka Consumers
   1. Consumer API
   2. KafkaConsumer, TopicPartition, ConsumerRecord

• ConsumerRebalanceListener
• AdminClient

• Introduction to Kafka Streams (Core Concepts)
  • StreamsBuilder -- High-Level Stream Processing DSL
  • Topology -- Processor API
  • StreamsConfig and Important Configuration Properties
• Kafka Streams API
  • KStream, KTable, et al.
  • Aggregation
  • Join
• Stateful Stream Processing in Kafka Streams
  • StateStore
• Testing Kafka Streams Applications
• Troubleshooting and Debugging