[Book][Neylson Crepalde] Big Data on Kubernetes [ENG, 2024]

A practical guide to building efficient and scalable data solutions

What is this book about?

With step-by-step instructions and examples, this book will teach you the skills needed to build and deploy complex data pipelines on Kubernetes, resulting in efficient and scalable big data solutions.

This book covers the following exciting features:

• Install and use Docker to run containers and build concise images
• Gain a deep understanding of Kubernetes architecture and its components
• Deploy and manage Kubernetes clusters on different cloud platforms
• Implement and manage data pipelines using Apache Spark and Apache Airflow
• Deploy and configure Apache Kafka for real-time data ingestion and processing
• Build and orchestrate a complete big data pipeline using open-source tools
• Deploy Generative AI applications on a Kubernetes-based architecture

Chapters:

Part 1: Docker and Kubernetes

1. ✅ Getting Started with Containers
2. 📖 Kubernetes Architecture
3. ✅ Getting Hands-On with Kubernetes

Part 2: Big Data Stack

4. 📖 The Modern Data Stack
5. ✅ Big Data Processing with Apache Spark
6. ✅ Building Pipelines with Apache Airflow
7. ✅ Apache Kafka for Real-Time Events and Data Ingestion

Part 3: Connecting It All Together

8. ✅ Deploying the Big Data Stack on Kubernetes
9. ✅ Data Consumption Layer
10. ✅ Building a Big Data Pipeline on Kubernetes
11. ⏸️ Generative AI on Kubernetes
12. 📖 Where to Go from Here

---

Предложить инженеру работу / подработку на проекте с kubernetes, microservices, machine learning, big data, golang