As a Staff Data Engineer at Grupo QuintoAndar, you will be a pivotal technical leader and go-to expert for all data-related initiatives within a business unit. You will drive data-driven and AI-driven decision-making at scale by working closely with product, software engineering, and Data&AI leaders.
What You'll Do
- Design, build, and maintain highly scalable, reliable, and performant data pipelines and platforms that process vast amounts of data from diverse sources.
- Partner with data analysts, engineers, and diverse stakeholders to understand and refine business and engineering requirements, proactively identifying and mitigating potential risks.
- Design and implement robust data models and transformation layers to create high-quality, reliable, and easily consumable data products for analytics and machine learning.
- Critically analyze existing data tools and processes, identifying areas for improvement and implementing best practices to enhance data quality, maintainability, and team productivity.
- Actively contribute hands-on with coding, configuration, and testing, leading by example and ensuring high-quality implementations.
- Act as a technical reference for the data engineering team and broader Data&AI organization in your business unit.
- Mentor and guide junior and mid-level data engineers, fostering their technical growth and contributing to building an excellent, high-performing team.
What We're Looking For
- Proven track record applying strong software engineering principles to design, build and operate large-scale data platforms / distributed data systems.
- Solid experience in delivering tangible business results through complex data and engineering projects.
- Expertise in modern data architecture concepts and technologies such as Databricks, Snowflake, Apache Iceberg/Delta Lake.
- Strong proficiency in Python with a passion for writing clean, maintainable, and well-tested code.
- Experience with distributed processing frameworks such as Apache Spark.
- Advanced SQL skills and expertise in data modeling techniques for analytical workloads.
- Experience with Apache Airflow or other data workflow tools.
- Ability to lead and drive projects involving collaboration across multiple engineering, data and business teams.
- Excellent communication skills (verbal and written), with a proactive approach to sharing and seeking context to collaborate effectively across diverse teams.
Nice to Have
- Fluency in cloud data services and infrastructure on at least one major cloud provider (AWS, GCP, or Azure).
- Experience with real-time data streaming technologies such as Apache Kafka or Kinesis and query engines like Trino/Presto.
- Contributed to or designed data platforms that support Machine Learning pipelines or advanced analytics use cases.
- Experience building data pipelines for GenAI applications such as RAG, embeddings, or vector databases.
- Knowledge of infrastructure areas such as containers and orchestration, CI/CD strategies, and infrastructure as code.
Technical Stack
- Languages & Frameworks: Python, Apache Spark, SQL
- Orchestration: Apache Airflow
- Platforms: Databricks, Snowflake
- Table Formats: Apache Iceberg, Delta Lake
- Cloud Providers: AWS, GCP, Azure
- Streaming & Querying: Apache Kafka, Kinesis, Trino, Presto
Team & Environment
You will work within a business unit, partnering with product, software engineering, and Data&AI leaders (Data Science, Analytics and Engineering). You may also contribute to the central data platform team.
Benefits & Compensation
- Competitive salary package
- Bonus
- Meal allowance (Flash Benefícios)
- Public transportation allowance
- Health plan
- Dental plan (optional)
- Life insurance
- Daycare subsidy
- Subsidy to sports practicing (Wellhub)
- Extended maternity and paternity leave
- Reserved room for breast-feeding
- Discount on our parking lot
- Educational discounts
Work Mode
This is a remote-first position. Candidates must be located in Brazil.
Grupo QuintoAndar is committed to an informal environment with a horizontal structure, using the best practices and tools in the market. We foster an environment of innovation, collaboration, high performance, and respect for diversity.
