Apache Kafka
Download Apache Kafka PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Apache Kafka book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages.
Apache Kafka in Action
Author: Anatoly Zelenin
language: en
Publisher: Simon and Schuster
Release Date: 2025-06-03
Apache Kafka, start to finish. Apache Kafka in Action: From basics to production guides you through the concepts and skills you’ll need to deploy and administer Kafka for data pipelines, event-driven applications, and other systems that process data streams from multiple sources. Authors Anatoly Zelenin and Alexander Kropp have spent years using Kafka in real-world production environments. In this guide, they reveal their hard-won expert insights to help you avoid common Kafka pitfalls and challenges. Inside Apache Kafka in Action you’ll discover: • Apache Kafka from the ground up • Achieving reliability and performance • Troubleshooting Kafka systems • Operations, governance, and monitoring • Kafka use cases, patterns, and anti-patterns Clear, concise, and practical, Apache Kafka in Action is written for IT operators, software engineers, and IT architects working with Kafka every day. Chapter by chapter, it guides you through the skills you need to deliver and maintain reliable and fault-tolerant data-driven applications. Foreword by Adam Bellemare. About the technology Apache Kafka is the gold standard streaming data platform for real-time analytics, event sourcing, and stream processing. Acting as a central hub for distributed data, it enables seamless flow between producers and consumers via a publish-subscribe model. Kafka easily handles millions of events per second, and its rock-solid design ensures high fault tolerance and smooth scalability. About the book Apache Kafka in Action is a practical guide for IT professionals who are integrating Kafka into data-intensive applications and infrastructures. The book covers everything from Kafka fundamentals to advanced operations, with interesting visuals and real-world examples. Readers will learn to set up Kafka clusters, produce and consume messages, handle real-time streaming, and integrate Kafka into enterprise systems. This easy-to-follow book emphasizes building reliable Kafka applications and taking advantage of its distributed architecture for scalability and resilience. What's inside • Master Kafka’s distributed streaming capabilities • Implement real-time data solutions • Integrate Kafka into enterprise environments • Build and manage Kafka applications • Achieve fault tolerance and scalability About the reader For IT operators, software architects and developers. No experience with Kafka required. About the author Anatoly Zelenin is a Kafka expert known for workshops across Europe, especially in banking and manufacturing. Alexander Kropp specializes in Kafka and Kubernetes, contributing to cloud platform design and monitoring. Table of Contents Part 1 1 Introduction to Apache Kafka 2 First steps with Kafka Part 2 3 Exploring Kafka topics and messages 4 Kafka as a distributed log 5 Reliability 6 Performance Part 3 7 Cluster management 8 Producing and persisting messages 9 Consuming messages 10 Cleaning up messages Part 4 11 Integrating external systems with Kafka Connect 12 Stream processing 13 Governance 14 Kafka reference architecture 15 Kafka monitoring and alerting16 Disaster management 17 Comparison with other technologies 18 Kafka’s role in modern enterprise architectures Appendixes A Setting up a Kafka test environment B Monitoring setup
Mastering Apache Kafka
Unleash the Power of Distributed Streaming Platform for Real-Time Data Are you ready to delve into the realm of distributed streaming and real-time data processing with Apache Kafka? "Mastering Apache Kafka" is your definitive guide to harnessing the full potential of this cutting-edge platform for building scalable, fault-tolerant, and high-performance data pipelines. Whether you're a data engineer looking to optimize data flows or a software architect aiming to build robust event-driven systems, this book equips you with the knowledge and tools to master the art of Kafka-based data streaming. Key Features: 1. Deep Dive into Apache Kafka: Immerse yourself in the core principles of Apache Kafka, comprehending its architecture, components, and dynamic capabilities. Construct a sturdy foundation that empowers you to manage and process real-time data streams with precision. 2. Installation and Configuration: Master the art of installing and configuring Apache Kafka on diverse platforms. Learn about cluster setup, topic creation, and configuration tuning for optimal performance. 3. Publishing and Consuming Data: Uncover the power of Kafka for publishing and consuming data streams. Explore producer and consumer APIs, message serialization, and different messaging patterns for building resilient data pipelines. 4. Data Streams and Processing: Delve into Kafka Streams for real-time data processing. Learn how to perform transformations, aggregations, and enrichments on data streams without the need for external processing engines. 5. Fault Tolerance and Scalability: Master Kafka's inherent fault tolerance and scalability features. Explore replication, partitioning, and high availability mechanisms that ensure data integrity and system reliability. 6. Connectors and Ecosystem: Explore Kafka's rich ecosystem of connectors and integrations. Learn how to connect Kafka with databases, cloud services, and other systems to facilitate seamless data exchange. 7. Security and Authentication: Discover strategies for securing your Kafka cluster. Learn about encryption, access controls, authentication mechanisms, and best practices to safeguard your data streams. 8. Monitoring and Management: Uncover techniques for monitoring and managing Kafka clusters. Explore tools for tracking performance metrics, diagnosing issues, and ensuring optimal system health. 9. Event Sourcing and Stream Processing Architectures: Embark on a journey into event-driven architectures and stream processing. Learn how Kafka can serve as the backbone for building scalable and responsive systems. 10. Real-World Applications: Gain insights into real-world use cases of Apache Kafka across industries. From IoT data integration to real-time analytics, discover how organizations leverage Kafka for innovative data-driven solutions. Who This Book Is For: "Mastering Apache Kafka" is an indispensable resource for data engineers, software architects, and IT professionals poised to excel in the domain of real-time data streaming with Kafka. Whether you're new to Kafka or seeking advanced techniques, this book will guide you through the intricacies and empower you to harness the full potential of this transformative platform.
Kafka in Action
Master the wicked-fast Apache Kafka streaming platform through hands-on examples and real-world projects. In Kafka in Action you will learn: Understanding Apache Kafka concepts Setting up and executing basic ETL tasks using Kafka Connect Using Kafka as part of a large data project team Performing administrative tasks Producing and consuming event streams Working with Kafka from Java applications Implementing Kafka as a message queue Kafka in Action is a fast-paced introduction to every aspect of working with Apache Kafka. Starting with an overview of Kafka's core concepts, you'll immediately learn how to set up and execute basic data movement tasks and how to produce and consume streams of events. Advancing quickly, you’ll soon be ready to use Kafka in your day-to-day workflow, and start digging into even more advanced Kafka topics. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the technology Think of Apache Kafka as a high performance software bus that facilitates event streaming, logging, analytics, and other data pipeline tasks. With Kafka, you can easily build features like operational data monitoring and large-scale event processing into both large and small-scale applications. About the book Kafka in Action introduces the core features of Kafka, along with relevant examples of how to use it in real applications. In it, you’ll explore the most common use cases such as logging and managing streaming data. When you’re done, you’ll be ready to handle both basic developer- and admin-based tasks in a Kafka-focused team. What's inside Kafka as an event streaming platform Kafka producers and consumers from Java applications Kafka as part of a large data project About the reader For intermediate Java developers or data engineers. No prior knowledge of Kafka required. About the author Dylan Scott is a software developer in the insurance industry. Viktor Gamov is a Kafka-focused developer advocate. At Confluent, Dave Klein helps developers, teams, and enterprises harness the power of event streaming with Apache Kafka. Table of Contents PART 1 GETTING STARTED 1 Introduction to Kafka 2 Getting to know Kafka PART 2 APPLYING KAFK 3 Designing a Kafka project 4 Producers: Sourcing data 5 Consumers: Unlocking data 6 Brokers 7 Topics and partitions 8 Kafka storage 9 Management: Tools and logging PART 3 GOING FURTHER 10 Protecting Kafka 11 Schema registry 12 Stream processing with Kafka Streams and ksqlDB