Shape the Future of Data Infrastructure
As a Senior Software Developer - Data Engineer, you will lead the design and operation of cloud-based data systems that power a growing SaaS platform. Your work will focus on building scalable ETL/ELT workflows, evolving modern lakehouse environments, and enabling secure, standards-based data sharing with external consumers.
Key Responsibilities
- Develop and maintain high-performance data pipelines that extract, transform, and load data from transactional systems into analytics-ready storage layers.
- Design and manage data lake and lakehouse architectures, including storage organization, schema evolution, metadata management, and data lineage.
- Implement Apache Iceberg-based datasets with support for change data capture, incremental updates, and versioned access patterns.
- Enable secure external data access using AWS-native services such as S3, Athena, Glue, and Lake Formation, following governance and tenant isolation standards.
- Orchestrate batch workflows with dependency tracking, watermarking, and cross-engine compatibility across serverless and Spark-based runtimes.
- Enforce data quality, validation, and monitoring practices across production pipelines to ensure accuracy, compliance, and reliability.
- Optimize system performance, cost, and scalability through query tuning, compute selection, and architectural improvements.
- Define clear data contracts and drive platform improvements that reduce system coupling and enhance developer experience.
- Provide technical guidance to junior engineers through code reviews, pair programming, and collaborative problem solving.
- Support production systems through incident response, root cause analysis, and proactive system hardening.
What We’re Looking For
- Minimum of 5 years in software or data engineering, with at least 3 years focused on AWS-based data platforms.
- Proven experience building end-to-end data pipelines from OLTP sources to analytics-ready layers in cloud environments.
- Hands-on expertise with Apache Iceberg, including schema and partitioning strategies, versioning, and metadata access.
- Experience designing CDC and incremental processing workflows with replay safety and synchronization guarantees.
- Strong knowledge of AWS analytics services: S3, Athena, Glue, Glue Catalog, and Lake Formation.
- Understanding of compute tradeoffs between serverless and Spark-based processing engines.
- Experience implementing secure, multi-tenant data access patterns and governance controls.
- Ability to support cross-platform data consumption using open standards and shared metadata models.
- Solid software engineering foundation with experience across the full development lifecycle.
- Track record of mentoring engineers and contributing to technical decision-making.
- Excellent written and verbal communication skills in English.
Preferred Experience
- Work in regulated or compliance-sensitive environments.
- Familiarity with financial, accounting, or audit-related domains.
- Experience building customer-facing data sharing platforms or analytics products.
- Orchestration using AWS Step Functions and EventBridge.
Technology Stack
Java (21+), Spring microservices, Python 3, AWS Lambda, Amazon S3, Apache Iceberg, S3 Tables, AWS Athena, AWS Glue (Spark and serverless), Glue Data Catalog, Glue Iceberg REST Catalog, AWS Lake Formation, IAM, STS, AWS Step Functions, Amazon EventBridge, DynamoDB, SNS/SQS, GitHub, GitHub Actions, Nx Monorepo, IntelliJ IDEA, Atlassian Cloud (Jira, Confluence), Microsoft Teams, Outlook
Benefits & Work Environment
- Indefinite employment contract with full legal benefits
- Prepaid medical insurance, life insurance, and funeral assistance
- Internet and home office allowances
- Competitive salary above market average
- 100% remote work with strong work-life balance
- Annual personal time off (5 days) and generous sick leave top-up (100% employer-paid from Day 3 to 90)
- Service recognition awards including additional paid time off
- Vacation upgrades starting at 5 years of service
- Annual budget for training and professional development
- Performance-based bonuses and recognition programs
- Opportunities for career advancement and global project involvement
- Inclusive culture that values innovation, collaboration, and accountability