Files
SecondBrain/10 Knowledge/CTO Academy/Data/Data Governance.md
T

11 KiB
Raw Blame History

Estimated reading time: 1215 minutes

Data Governance

Definition

Data Governance is the framework of people, processes, policies, and standards that ensures data is:

  • Accurate

  • Consistent

  • Secure

  • Trusted

  • Well-defined

  • Properly managed throughout its lifecycle

A common misconception is:

"Data Governance is about data."

It isn't.

Data Governance is about how an organization manages its data.

Think of it this way:

The data itself doesn't become trustworthy.

The organization makes it trustworthy.


Simple Mental Model

Think of Data Governance as the rules of a city.

The city already exists.

People already drive.

Buildings already exist.

Governance answers questions like:

  • Who owns this road?

  • Who can build here?

  • Who maintains the traffic lights?

  • What happens if something breaks?

  • Who decides the speed limit?

Without those rules, the city still functions…

...just not very well.

Data is the same.


How It Works

Data Governance is built around several fundamental pillars.

                DATA GOVERNANCE

           ┌────────────────────┐
           │ Business Ownership │
           └────────────────────┘
                    │
                    ▼
            Shared Definitions
                    │
                    ▼
             Data Quality
                    │
                    ▼
             Data Security
                    │
                    ▼
             Data Lineage
                    │
                    ▼
             Metadata
                    │
                    ▼
             Stewardship

These pillars work together.

Weakness in one usually affects the others.


Pillar 1 — Ownership

One of the first governance questions is:

Who owns this data?

Not:

Who built the report?

Not:

Who manages SQL?

Ownership is a business responsibility, not a technical one.

Example:

Employee Data

Owner:

Human Resources

Not IT.

Example:

Financial Data

Owner:

Finance.

Not the DBA.

IT manages systems.

The business owns the meaning.


Example

Imagine your company has:

Unique Viewer

Marketing says:

"It's anyone who visits."

Product says:

"It's anyone who watches."

Engineering says:

"It's a unique device."

Who's correct?

Governance says:

There must be one owner responsible for defining the KPI.

Without ownership:

Everyone has an opinion.

Nobody has responsibility.


Pillar 2 — Business Definitions

Governance also answers:

What exactly does this KPI mean?

For example:

Revenue.

Simple?

Not really.

Does Revenue mean:

  • Gross Revenue

  • Net Revenue

  • Before refunds

  • After refunds

  • Before tax

  • After tax

Same word.

Potentially six different metrics.

This is why we studied Semantic Layer.

A Semantic Layer implements business definitions.

Governance decides those definitions.


Pillar 3 — Data Quality

Governance also asks:

Can we trust the data?

Quality includes things like:

Accuracy

Completeness

Consistency

Timeliness

Validity

Uniqueness

Example:

Suppose:

Platform

Roku
roku
ROKU
Connected TV

Technically valid?

Yes.

Business useful?

Not really.

Governance establishes standards.


Pillar 4 — Security

Governance determines:

Who may access which data?

Examples:

HR salaries

Medical information

Financial forecasts

Personally identifiable information

Not everyone should access everything.

Governance establishes policies.

Technology enforces them.


Pillar 5 — Data Lineage

As we learned in Data Lineage, governance also requires understanding:

Where data came from

How it changed

Where it's used

Example:

Executive KPI

↓

Semantic Layer

↓

Fact Table

↓

Gold

↓

Silver

↓

Bronze

↓

Source System

If you cannot explain where a KPI came from…

Governance is incomplete.


Pillar 6 — Metadata

Metadata simply means:

Data about data.

Examples:

Table owner

Description

Refresh schedule

Business definition

Data sensitivity

Last refresh

Source system

Without metadata:

People ask:

"What does this table do?"

With metadata:

The answer already exists.


Pillar 7 — Stewardship

Ownership and stewardship are different.

Owner

Responsible for:

Business meaning.

Steward

Responsible for:

Maintaining quality.

Example:

HR owns employee data.

A Data Steward may ensure:

Employee IDs are valid.

Departments exist.

Names follow standards.

Quality checks succeed.


How It Fits Into the Bigger Picture

Everything you've learned now connects.

Source Systems

↓

[[ETL vs ELT]]

↓

[[Medallion Architecture]]

↓

Bronze

↓

Silver

↓

Gold

↓

[[Fact Table]]
+
[[Dimension Table]]

↓

[[Star Schema]]

↓

[[Semantic Layer]]

↓

Power BI

↓

Business Decisions

══════════════════════════════

[[Data Governance]]

applies across ALL layers.

Governance isn't another technical layer.

It's a management framework that influences every layer.


Governance vs Management

People often confuse:

Project Management

Data Management

Data Governance

Think:

Project Management

Builds things.

Data Management

Operates systems.

Data Governance

Defines the rules.

Different responsibilities.


Governance vs Data Quality

These are not the same.

Governance asks:

Should this data exist?

Who owns it?

Who defines it?

How should quality be measured?

Data Quality asks:

Is today's data actually good?

Governance creates expectations.

Quality measures whether those expectations were met.


Governance vs Security

Governance says:

Finance salaries should only be visible to Finance leadership.

Security implements:

Active Directory

Azure AD

Permissions

Row-Level Security

Encryption

Governance defines policy.

Technology enforces it.


My Company / Real-World Context

This lesson is probably the closest to your day-to-day job.

Think about your previous conversations with MH regarding demographics.

Marketing wanted:

Age

Gender

Unknown %

The disagreement wasn't technical.

It was governance.

Questions included:

  • What does Unknown actually represent?

  • Is the metric acceptable?

  • Who owns the definition?

  • Can it be improved?

  • How should executives interpret it?

Another example:

Imagine your two analysts create:

Completion Rate

One uses:

95%.

Another uses:

90%.

Neither calculation is technically wrong.

Governance says:

Choose one.

Document it.

Implement it once.

Reuse it everywhere.

That is exactly what your team should eventually own.


CTO Perspective

Many new CTOs spend their time discussing:

Cloud

AI

Microservices

Containers

Kubernetes

Those are important.

But organizations rarely fail because they chose the wrong container technology.

They often fail because:

Nobody trusts the numbers.

Different reports disagree.

Nobody owns the KPI.

Nobody knows where data came from.

Nobody knows what changes will break.

The CTO's role is to create an environment where executives trust the data enough to make decisions.

That trust comes from governance.


Questions to Ask

When someone presents a KPI:

  • Who owns this metric?

  • What is its business definition?

  • Is it documented?

  • Where is it calculated?

  • Does everyone use the same definition?

  • Can we trace it through Data Lineage?

  • What is the data quality?

  • Who approves changes?

  • Who has access?

  • What happens if the source changes?


Meeting Scenario

Situation

The CEO asks:

"Why does Marketing say we have 2.3 million active users while Product says 1.8 million?"

Everyone immediately starts debating SQL.

A CTO-style response would be:

"Before comparing the SQL, I'd like us to confirm whether we're using the same business definition of Active User. If each department has created its own definition, then the issue isn't technical—it's a governance issue. Let's establish one owner for this KPI, agree on the definition, document it in our Semantic Layer, and ensure every report consumes the same metric."

Notice what happened.

You didn't ask:

Which report is wrong?

You asked:

Why does the organization allow two different definitions of the same KPI?

That's governance thinking.


Key Takeaways

  • Data Governance is the framework that ensures organizational trust in data.

  • Governance is about people, policies, ownership, and standards, not just technology.

  • Data Governance spans the entire data architecture.

  • Every important KPI should have a clearly identified business owner.

  • The Semantic Layer implements business definitions; Governance decides those definitions.

  • Data Lineage explains where data comes from; Governance ensures it is understood and managed.

  • Governance defines policy; security technologies enforce it.

  • High-quality analytics require both good technical architecture and strong governance.

  • Semantic Layer

  • Data Lineage

  • Data Quality

  • Metadata

  • Data Steward

  • Data Owner

  • Business Glossary

  • KPI

  • Measure

  • Fact Table

  • Dimension Table

  • Medallion Architecture


🎯 CTO Reflection

This is actually where your career and these lessons begin to merge.

You told me several weeks ago that you wanted to become a CTO, and that you didn't necessarily want to be the best programmer anymore—you wanted to become someone who leads technology to produce business results.

This lesson is the first one where your current job gives you a significant advantage.

When I look at the work you've described over the past months, you've already been doing pieces of Data Governance without calling it that:

  • Challenging inconsistent KPI definitions.

  • Asking departments to agree on business meanings.

  • Building executive dashboards.

  • Thinking about ownership instead of just SQL.

  • Questioning whether a metric is actually measuring what its name implies.

  • Wanting reusable definitions instead of every analyst inventing their own.

That's not just reporting.

That's the beginning of governance.

From here, the academy shifts slightly. We've built the technical foundation. The next lessons will increasingly connect architecture, leadership, governance, and decision-making—the areas that distinguish a CTO from a senior developer or data engineer. I think that's where the material will become even more directly applicable to your day-to-day role.