eBay is looking for a Software Architect to lead software architecture and data engineering initiatives, tackling complex problems in backend services and data pipelines. You will design and build scalable, production-grade systems and data infrastructure.
What You'll Do
- Design and build data pipelines.
- Develop batch and streaming ETL/ELT processes to ingest data from diverse sources.
- Use SQL, optimize Spark pipelines, and transform raw data into clean, standardized datasets.
- Build reusable data marts and feature sets for downstream teams.
- Tune queries, partitioning, clustering, indexing, and storage formats.
- Optimize compute and storage costs, manage scaling strategies, and right-size resources.
- Implement CI/CD for data code and pipelines; manage environments and releases.
- Develop internal tooling and frameworks to improve developer productivity.
- Build and maintain streaming pipelines using Kafka, Kinesis, Pub/Sub, Flink, or Spark Structured Streaming.
- Design schemas and contracts for event data; ensure exactly-once/at-least-once semantics.
- Translate business needs into technical specs; document datasets, SLAs, and usage guidelines.
- Support incident response and root-cause analysis for data quality issues.
What We're Looking For
- Overall 9+ years of experience with passion for technical excellence.
- BE/Mtech in Computer Science or equivalent professional experience.
- 6+ years of software design, architecture, and development experience.
- Solid foundation in Data Structures, Algorithms, Object-Oriented Programming, and Software Design.
- Architectural expertise in production-grade systems using Java, OpenSearch, microservices, Spring Boot, Kafka, Kibana, SQL, Kubernetes, and caches.
- Hands-on experience with OpenSearch/Elasticsearch.
- Deep understanding of Kafka (producers/consumers, schema evolution, partitions, consumer groups, compaction, DLQs).
- Solid foundation in distributed systems: consistency, fault tolerance, retries, circuit breakers, and timeouts.
- Practical expertise with RESTful service design, API security (OAuth, mTLS), and backward-compatible evolution.
- Production experience with CI/CD (e.g., GitHub Actions/Jenkins), containers (Docker), Kubernetes, and infrastructure-as-code (Helm/Terraform).
- Programming Experience in Java/Scala. Strong in SQL/NoSQL exposure to at least one cloud.
- Good experience in Data Warehouse, Data Lake, and orchestration tools like Airflow.
Nice to Have
- Scala/Kotlin/Python experience.
- Machine Learning exposure.
Technical Stack
- Languages & Frameworks: Java, Scala, Kotlin, Python, Spring Boot
- Data & Streaming: Kafka, OpenSearch, Elasticsearch, SQL, Spark, Parquet, ORC, Kinesis, Pub/Sub, Flink, Spark Structured Streaming, Airflow
- Infrastructure & Tools: Kubernetes, Docker, Caches, Helm, Terraform, GitHub Actions, Jenkins, Kibana
- Architecture: Microservices
eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status.
