6 tasks, each one witnessed by the sources that watched the job — and behind every one, a prompt you can use tonight.
You spend most of your day checking that data follows the rules your company set. That means using data catalogs and metadata management tools to look up data definitions, then reviewing data quality dashboards to find missing or wrong values.
You also write or update business rules and data standards documents, meet with IT and business teams to solve data issues, and log fixes in whatever ticket system your company uses. Expect regular reviews and ad-hoc firefighting when a data feed breaks.
Common tools are data catalogs (like Collibra or Alation), metadata management tools, and data quality monitoring platforms (like Great Expectations or Informatica Data Quality). You’ll use the catalog to find what a field means, the metadata tool to track lineage (where data came from), and the quality platform to run checks and alerts.
You also often use spreadsheets, SQL editors, and a ticketing system (Jira or ServiceNow) to record issues and coordinate fixes with IT and business owners.
First, monitor quality dashboards for alerts: high null rates, duplicates, or out-of-range values. The data quality platform will show which dataset and which rule failed. Next, check the metadata and lineage in the data catalog to find the source system and owner.
Then open a ticket, describe the failed rule and evidence, and work with the source owner (often IT or the business unit) to correct the source or apply a transformation. Log the resolution and update the business rule if needed.
AI can help spot patterns, suggest data mappings, or auto-classify fields in a data catalog, but you must not trust it blindly. Use AI suggestions as a starting point, then validate with metadata, samples, and a human review before updating definitions or rules.
Never use AI to make compliance decisions alone—always check outputs against your GDPR policies and data governance rules. Keep records of AI suggestions and who approved changes.
A data steward focuses on rules, definitions, and quality — the policy and ownership side. You maintain metadata, set data standards, and coordinate fixes. Data engineers build and run pipelines that move and transform data; they change code and infrastructure.
Data analysts consume the cleaned data to produce reports and insights. Stewards sit between engineers and analysts: you enforce the standards engineers implement and ensure analysts understand the data definitions in the catalog.
Start with SQL to query data and spot quality issues. Learn one data catalog (Collibra or Alation) and one data quality tool (Great Expectations or a similar platform) so you can read metadata and run checks.
Also practice writing clear business rules and documentation, and get comfortable coordinating with IT and business teams. Basic knowledge of GDPR and other data compliance rules is essential.
Common numbers are data quality KPIs: percent complete (target 95%+), duplicate rate (goal under 1% for key identifiers), and timeliness (e.g., 99% of daily feeds arrive by 07:00). You’ll track rule failure counts and mean-time-to-resolution for incidents.
For metadata, you might measure catalog coverage (percent of critical datasets with definitions; target 100% for high-value data) and data ownership coverage (percent of datasets with assigned owners). These numbers guide your priorities.