Responsibilities
- You will build automated frameworks for data ingestion, transformation, orchestration, and deployment.
- You will integrate AI/ML capabilities into pipelines, including anomaly detection, metadata enrichment, and pattern recognition.
- Involved in the implementation of AI and LLM‑based tooling to automate data engineering workflows (e.g., code generation, data quality monitoring, schema drift detection) nice to have.
Requirements
- You will build automated frameworks for data ingestion, transformation, orchestration, and deployment.
- You will integrate AI/ML capabilities into pipelines, including anomaly detection, metadata enrichment, and pattern recognition.
Nice to Have
- Involved in the implementation of AI and LLM‑based tooling to automate data engineering workflows (e.g., code generation, data quality monitoring, schema drift detection) nice to have.
