denis256 notes and projects

Previous: Security and Authentication

Book: AWS Certified Data Engineer Associate Study Guide Authors: Sakti Mishra, Dylan Qu, Anusha Challa Publisher: O’Reilly Media ISBN: 978-1-098-17007-3

Data governance is that thing every team says they care about but nobody wants to own. Security gets attention because breaches make headlines. Governance? It just slowly rots your data platform from the inside when you ignore it. This part of Chapter 7 covers the governance pillars beyond security and privacy.

I will be honest with you. This chapter is the one that makes people quit the book. The one people warn you about. “Just skip the speech,” they say. I get it. I also think that is a mistake. You did not read 900 pages to skip the part where the author tells you exactly what the whole thing means.

So let me walk you through it. I will try to keep it digestible.

Previous: Pipeline Resiliency and Cost Optimization

Chapter 7 covers data security and governance. You can build the most elegant data pipeline in the world, but if security is an afterthought, you’re one misconfigured S3 bucket away from a headline nobody wants.

Splitting this chapter into two posts. This first part covers network security, authentication, encryption, and access control. Second part covers data governance.

Previous: Part III, Chapter 5 - Their Brothers’ Keepers

“The Concerto of Deliverance” – and it earns its name. A chapter about a man being set free. Not by escape, not by rescue, but by understanding. Rearden finally sees the full picture, and the picture is devastating.

The Family Trap

The government seizes Rearden’s bank accounts, his property, everything. Official excuse is some tax deficiency from three years ago that never existed. No trial, no hearing, just a notice. When his lawyer says it is fantastic, Rearden asks: “Any more fantastic than the rest?”

Previous: Analytics Operations

Book: AWS Certified Data Engineer Associate Study Guide Authors: Sakti Mishra, Dylan Qu, Anusha Challa Publisher: O’Reilly Media ISBN: 978-1-098-17007-3

Second half of Chapter 6. It covers the stuff that separates a working pipeline from a production-grade pipeline: monitoring, alerting, data quality checks, disaster recovery, Infrastructure as Code, CI/CD, and cost optimization. If Part 1 was about running analytics, Part 2 is about keeping them running and not going broke doing it.