Truelogic Software is looking for a Senior Data Platform Engineer to join our team. You will take ownership of enhancing and optimizing an enterprise-scale metadata management environment built on OpenMetadata. Your focus will be on extending platform functionality, improving ingestion pipelines, enhancing data lineage capture, and integrating with a modern data stack.
What You'll Do
- Design, build, and maintain custom OpenMetadata connectors for metadata ingestion.
- Extend and automate data lineage capture from multiple systems and repositories.
- Debug, patch, and enhance backend features to improve stability and scalability.
- Manage containerized deployments (Kubernetes/ECS) and implement monitoring solutions.
- Optimize storage and retrieval using RDS (PostgreSQL/MySQL) and OpenSearch/Elasticsearch.
- Orchestrate metadata workflows with Apache Airflow and integrate with existing pipelines.
- Implement and maintain RBAC with Okta, supporting clear role separation.
- Oversee upgrade management, backup strategies, and high-availability configurations.
What We're Looking For
- 5+ years in data engineering or platform engineering roles.
- Hands-on OpenMetadata experience.
- Proficiency in ECS (AWS), Airflow, RDS, and OpenSearch/Elasticsearch.
- Strong Python development skills for API integrations and connector development.
- Proven experience implementing RBAC and identity management integrations (e.g., Okta).
- Skilled in container orchestration, infrastructure automation, and performance optimization.
- Ability to merge and manage open-source updates into customized codebases.
- Strong problem-solving skills and a track record of delivering production-grade, scalable solutions.
Technical Stack
- OpenMetadata, Apache Airflow
- RDS, OpenSearch, Elasticsearch, PostgreSQL, MySQL
- Kubernetes, ECS (AWS)
- Python, Okta
Team & Environment
This is a highly collaborative role requiring close work with platform engineers. You will work with a diverse, global network of over 600 professionals in 25+ countries.
Benefits & Compensation
- 100% Remote Work
- Highly Competitive USD Pay
- Paid Time Off
- Work with Autonomy
- Work with Top American Companies
Work Mode
This is a fully remote position open to candidates in Brazil.
Truelogic Software is an equal opportunity employer.
