Responsibilities
- Create and implement data validation tests for data warehouse components within Microsoft Fabric, including tables, views, and semantic models.
- Verify the correctness and completeness of ETL and ELT workflows, including Dataflows and connected source systems.
- Test and oversee event-based data processing, such as messages, queues, and topics in Azure Service Bus.
- Assess Logic Apps workflows and system integrations responsible for data movement and transformation.
- Conduct full lifecycle testing of data from ingestion through transformation to delivery in BI or downstream platforms.
- Build and sustain automated data validation checks, reconciliation logic, and testing frameworks.
- Detect, investigate, and document data quality problems, including root cause and business impact.
- Work with engineering, analytics, and business teams to define data quality standards, metrics, and validation thresholds.
- Track data quality KPIs, enforce preventive controls, and maintain stable production data pipelines.
- Record test procedures, data rules, and outcomes clearly for both technical and non-technical audiences.
- Apply knowledge of unit testing, automated validation, and integration testing using tools like dbt, Great Expectations, tSQLt, pytest, and Azure testing utilities.
- Execute unit-level testing on Logic Apps and Service Bus message flows to confirm correct behavior.
- Design and manage automated data quality checks and integration tests using dbt, Great Expectations, or custom scripting.
- Validate API endpoints and integration flows using Postman to ensure accurate cross-system data transfer.
- Carry out end-to-end validation of event-driven architectures and service integrations using Postman and automation scripts.
