Data Governance Platform

Objectives

• Build a data catalog with searchable metadata for all registered datasets
• Implement data lineage visualization showing upstream and downstream dependencies
• Use AI to auto-detect PII columns (names, emails, SSNs, addresses) and suggest masking
• Define and enforce data quality rules with automated validation scoring
• Auto-generate dataset documentation and column descriptions using AI

Hints

• Use regex patterns as a first pass for PII detection, then confirm with AI
• Model lineage as a DAG and render it with a graph visualization library
• Implement quality scores as weighted averages of individual rule pass rates

Resources

• reactflow.dev/docs/introduction
• platform.openai.com/docs/api-reference/chat

Comments (0)