vault backup: 2026-07-21 20:40:18

.obsidian/workspace.json

@@ -13,12 +13,12 @@
             "state": {
               "type": "markdown",
               "state": {
-                "file": "10 Knowledge/CTO Academy/Data/Quizzes/Quiz 01 - Data Foundations.md",
+                "file": "10 Knowledge/CTO Academy/Data/Data Governance.md",
                 "mode": "source",
                 "source": false
               },
               "icon": "lucide-file",
-              "title": "Quiz 01 - Data Foundations"
+              "title": "Data Governance"
             }
           }
         ]
@@ -199,6 +199,7 @@
   "active": "579a503273b0c5ec",
   "lastOpenFiles": [
     "10 Knowledge/CTO Academy/Data/Data Lineage.md",
+    "10 Knowledge/CTO Academy/Data/Data Governance.md",
     "10 Knowledge/CTO Academy/Data/Quizzes/Quiz 01 - Data Foundations.md",
     "10 Knowledge/CTO Academy/Data/Quizzes",
     "10 Knowledge/CTO Academy/Data/Semantic Layer.md",

10 Knowledge/CTO Academy/Data/Data Governance.md

@@ -0,0 +1,774 @@
+**Estimated reading time:** 12–15 minutes
+
+# Data Governance
+
+## Definition
+
+**Data Governance** is the framework of **people, processes, policies, and standards** that ensures data is:
+
+- Accurate
+    
+- Consistent
+    
+- Secure
+    
+- Trusted
+    
+- Well-defined
+    
+- Properly managed throughout its lifecycle
+    
+
+A common misconception is:
+
+> "Data Governance is about data."
+
+It isn't.
+
+> **Data Governance is about how an organization manages its data.**
+
+Think of it this way:
+
+The data itself doesn't become trustworthy.
+
+The **organization makes it trustworthy**.
+
+---
+
+## Simple Mental Model
+
+Think of Data Governance as the rules of a city.
+
+The city already exists.
+
+People already drive.
+
+Buildings already exist.
+
+Governance answers questions like:
+
+- Who owns this road?
+    
+- Who can build here?
+    
+- Who maintains the traffic lights?
+    
+- What happens if something breaks?
+    
+- Who decides the speed limit?
+    
+
+Without those rules, the city still functions…
+
+...just not very well.
+
+Data is the same.
+
+---
+
+## How It Works
+
+Data Governance is built around several fundamental pillars.
+
+```text
+                DATA GOVERNANCE
+
+           ┌────────────────────┐
+           │ Business Ownership │
+           └────────────────────┘
+                    │
+                    ▼
+            Shared Definitions
+                    │
+                    ▼
+             Data Quality
+                    │
+                    ▼
+             Data Security
+                    │
+                    ▼
+             Data Lineage
+                    │
+                    ▼
+             Metadata
+                    │
+                    ▼
+             Stewardship
+```
+
+These pillars work together.
+
+Weakness in one usually affects the others.
+
+---
+
+# Pillar 1 — Ownership
+
+One of the first governance questions is:
+
+> **Who owns this data?**
+
+Not:
+
+> Who built the report?
+
+Not:
+
+> Who manages SQL?
+
+Ownership is a **business responsibility**, not a technical one.
+
+Example:
+
+```text
+Employee Data
+```
+
+Owner:
+
+Human Resources
+
+Not IT.
+
+Example:
+
+```text
+Financial Data
+```
+
+Owner:
+
+Finance.
+
+Not the DBA.
+
+IT manages systems.
+
+The business owns the meaning.
+
+---
+
+## Example
+
+Imagine your company has:
+
+```text
+Unique Viewer
+```
+
+Marketing says:
+
+> "It's anyone who visits."
+
+Product says:
+
+> "It's anyone who watches."
+
+Engineering says:
+
+> "It's a unique device."
+
+Who's correct?
+
+Governance says:
+
+> **There must be one owner responsible for defining the KPI.**
+
+Without ownership:
+
+Everyone has an opinion.
+
+Nobody has responsibility.
+
+---
+
+# Pillar 2 — Business Definitions
+
+Governance also answers:
+
+> What exactly does this KPI mean?
+
+For example:
+
+Revenue.
+
+Simple?
+
+Not really.
+
+Does Revenue mean:
+
+- Gross Revenue
+    
+- Net Revenue
+    
+- Before refunds
+    
+- After refunds
+    
+- Before tax
+    
+- After tax
+    
+
+Same word.
+
+Potentially six different metrics.
+
+This is why we studied [[Semantic Layer]].
+
+A Semantic Layer implements business definitions.
+
+Governance decides those definitions.
+
+---
+
+# Pillar 3 — Data Quality
+
+Governance also asks:
+
+Can we trust the data?
+
+Quality includes things like:
+
+Accuracy
+
+Completeness
+
+Consistency
+
+Timeliness
+
+Validity
+
+Uniqueness
+
+Example:
+
+Suppose:
+
+```text
+Platform
+
+Roku
+roku
+ROKU
+Connected TV
+```
+
+Technically valid?
+
+Yes.
+
+Business useful?
+
+Not really.
+
+Governance establishes standards.
+
+---
+
+# Pillar 4 — Security
+
+Governance determines:
+
+Who may access which data?
+
+Examples:
+
+HR salaries
+
+Medical information
+
+Financial forecasts
+
+Personally identifiable information
+
+Not everyone should access everything.
+
+Governance establishes policies.
+
+Technology enforces them.
+
+---
+
+# Pillar 5 — Data Lineage
+
+As we learned in [[Data Lineage]], governance also requires understanding:
+
+Where data came from
+
+How it changed
+
+Where it's used
+
+Example:
+
+```text
+Executive KPI
+
+↓
+
+Semantic Layer
+
+↓
+
+Fact Table
+
+↓
+
+Gold
+
+↓
+
+Silver
+
+↓
+
+Bronze
+
+↓
+
+Source System
+```
+
+If you cannot explain where a KPI came from…
+
+Governance is incomplete.
+
+---
+
+# Pillar 6 — Metadata
+
+Metadata simply means:
+
+> Data about data.
+
+Examples:
+
+Table owner
+
+Description
+
+Refresh schedule
+
+Business definition
+
+Data sensitivity
+
+Last refresh
+
+Source system
+
+Without metadata:
+
+People ask:
+
+> "What does this table do?"
+
+With metadata:
+
+The answer already exists.
+
+---
+
+# Pillar 7 — Stewardship
+
+Ownership and stewardship are different.
+
+Owner
+
+Responsible for:
+
+Business meaning.
+
+Steward
+
+Responsible for:
+
+Maintaining quality.
+
+Example:
+
+HR owns employee data.
+
+A Data Steward may ensure:
+
+Employee IDs are valid.
+
+Departments exist.
+
+Names follow standards.
+
+Quality checks succeed.
+
+---
+
+## How It Fits Into the Bigger Picture
+
+Everything you've learned now connects.
+
+```text
+Source Systems
+
+↓
+
+[[ETL vs ELT]]
+
+↓
+
+[[Medallion Architecture]]
+
+↓
+
+Bronze
+
+↓
+
+Silver
+
+↓
+
+Gold
+
+↓
+
+[[Fact Table]]
++
+[[Dimension Table]]
+
+↓
+
+[[Star Schema]]
+
+↓
+
+[[Semantic Layer]]
+
+↓
+
+Power BI
+
+↓
+
+Business Decisions
+
+══════════════════════════════
+
+[[Data Governance]]
+
+applies across ALL layers.
+```
+
+Governance isn't another technical layer.
+
+It's a management framework that influences every layer.
+
+---
+
+## Governance vs Management
+
+People often confuse:
+
+Project Management
+
+Data Management
+
+Data Governance
+
+Think:
+
+Project Management
+
+Builds things.
+
+Data Management
+
+Operates systems.
+
+Data Governance
+
+Defines the rules.
+
+Different responsibilities.
+
+---
+
+## Governance vs Data Quality
+
+These are not the same.
+
+Governance asks:
+
+Should this data exist?
+
+Who owns it?
+
+Who defines it?
+
+How should quality be measured?
+
+Data Quality asks:
+
+Is today's data actually good?
+
+Governance creates expectations.
+
+Quality measures whether those expectations were met.
+
+---
+
+## Governance vs Security
+
+Governance says:
+
+Finance salaries should only be visible to Finance leadership.
+
+Security implements:
+
+Active Directory
+
+Azure AD
+
+Permissions
+
+Row-Level Security
+
+Encryption
+
+Governance defines policy.
+
+Technology enforces it.
+
+---
+
+## My Company / Real-World Context
+
+This lesson is probably the closest to your day-to-day job.
+
+Think about your previous conversations with MH regarding demographics.
+
+Marketing wanted:
+
+Age
+
+Gender
+
+Unknown %
+
+The disagreement wasn't technical.
+
+It was governance.
+
+Questions included:
+
+- What does Unknown actually represent?
+    
+- Is the metric acceptable?
+    
+- Who owns the definition?
+    
+- Can it be improved?
+    
+- How should executives interpret it?
+    
+
+Another example:
+
+Imagine your two analysts create:
+
+```text
+Completion Rate
+```
+
+One uses:
+
+95%.
+
+Another uses:
+
+90%.
+
+Neither calculation is technically wrong.
+
+Governance says:
+
+Choose one.
+
+Document it.
+
+Implement it once.
+
+Reuse it everywhere.
+
+That is exactly what your team should eventually own.
+
+---
+
+## CTO Perspective
+
+Many new CTOs spend their time discussing:
+
+Cloud
+
+AI
+
+Microservices
+
+Containers
+
+Kubernetes
+
+Those are important.
+
+But organizations rarely fail because they chose the wrong container technology.
+
+They often fail because:
+
+Nobody trusts the numbers.
+
+Different reports disagree.
+
+Nobody owns the KPI.
+
+Nobody knows where data came from.
+
+Nobody knows what changes will break.
+
+The CTO's role is to create an environment where executives trust the data enough to make decisions.
+
+That trust comes from governance.
+
+---
+
+### Questions to Ask
+
+When someone presents a KPI:
+
+- Who owns this metric?
+    
+- What is its business definition?
+    
+- Is it documented?
+    
+- Where is it calculated?
+    
+- Does everyone use the same definition?
+    
+- Can we trace it through [[Data Lineage]]?
+    
+- What is the data quality?
+    
+- Who approves changes?
+    
+- Who has access?
+    
+- What happens if the source changes?
+    
+
+---
+
+## Meeting Scenario
+
+**Situation**
+
+The CEO asks:
+
+> "Why does Marketing say we have 2.3 million active users while Product says 1.8 million?"
+
+Everyone immediately starts debating SQL.
+
+A CTO-style response would be:
+
+> "Before comparing the SQL, I'd like us to confirm whether we're using the same business definition of Active User. If each department has created its own definition, then the issue isn't technical—it's a governance issue. Let's establish one owner for this KPI, agree on the definition, document it in our Semantic Layer, and ensure every report consumes the same metric."
+
+Notice what happened.
+
+You didn't ask:
+
+> Which report is wrong?
+
+You asked:
+
+> Why does the organization allow two different definitions of the same KPI?
+
+That's governance thinking.
+
+---
+
+## Key Takeaways
+
+- **Data Governance** is the framework that ensures organizational trust in data.
+    
+- Governance is about **people, policies, ownership, and standards**, not just technology.
+    
+- Data Governance spans the entire data architecture.
+    
+- Every important KPI should have a clearly identified business owner.
+    
+- The [[Semantic Layer]] implements business definitions; Governance decides those definitions.
+    
+- [[Data Lineage]] explains where data comes from; Governance ensures it is understood and managed.
+    
+- Governance defines policy; security technologies enforce it.
+    
+- High-quality analytics require both good technical architecture and strong governance.
+    
+
+## Related Concepts
+
+- [[Semantic Layer]]
+    
+- [[Data Lineage]]
+    
+- [[Data Quality]]
+    
+- [[Metadata]]
+    
+- [[Data Steward]]
+    
+- [[Data Owner]]
+    
+- [[Business Glossary]]
+    
+- [[KPI]]
+    
+- [[Measure]]
+    
+- [[Fact Table]]
+    
+- [[Dimension Table]]
+    
+- [[Medallion Architecture]]
+    
+
+---
+
+## 🎯 CTO Reflection
+
+This is actually where your career and these lessons begin to merge.
+
+You told me several weeks ago that you wanted to become a CTO, and that you didn't necessarily want to be the best programmer anymore—you wanted to become someone who **leads technology to produce business results**.
+
+This lesson is the first one where your current job gives you a significant advantage.
+
+When I look at the work you've described over the past months, you've already been doing pieces of Data Governance without calling it that:
+
+- Challenging inconsistent KPI definitions.
+    
+- Asking departments to agree on business meanings.
+    
+- Building executive dashboards.
+    
+- Thinking about ownership instead of just SQL.
+    
+- Questioning whether a metric is actually measuring what its name implies.
+    
+- Wanting reusable definitions instead of every analyst inventing their own.
+    
+
+That's not just reporting.
+
+That's the beginning of governance.
+
+From here, the academy shifts slightly. We've built the technical foundation. The next lessons will increasingly connect **architecture, leadership, governance, and decision-making**—the areas that distinguish a CTO from a senior developer or data engineer. I think that's where the material will become even more directly applicable to your day-to-day role.