State Street is seeking an experienced Senior Cloud Data Engineer to design, build, and optimize scalable data solutions on cloud platforms. You will leverage strong technical expertise in Databricks and Spark, preferably within Financial Services, to deliver robust data pipelines and transformations.
What You'll Do
- Design, develop, and optimize end-to-end data pipelines using Databricks
- Design data pipelines using Bronze / Silver / Gold (medallion) architecture
- Ensure data quality, integrity, and performance across pipelines
- Develop high-performance PySpark and SQL transformations
- Collaborate with Architects, Business Analysts, and downstream consumers
- Support CI/CD implementation for Databricks jobs and notebooks
- Ensure adherence to security, governance, and compliance standards
What We're Looking For
- 5-8 years of hands-on experience with AWS Cloud Data Engineering with the Databricks platform
- Hands-on experience in setting up data pipelines for ETL jobs across multiple data sources
- Knowledge of cluster configuration, autoscaling, and cost optimization in Databricks
- Expertise in Data Modeling and DB design
- Hands-on experience with performance tuning, Git, Jenkins, and enterprise job scheduling tools (Autosys / Airflow)
- Basic understanding of data warehousing and ETL concepts
- Knowledge of CI/CD tools (GitHub, Azure DevOps)
- Advanced SQL and Python skills
- Experience working in Agile delivery environments
Nice to Have
- Experience in regulatory or financial services domain
- Databricks or Cloud certifications
- Experience with visualization tools (PowerBI, Tableau)
- Exposure to Starburst, Spotfire, TDV, ServiceNow
Technical Stack
- Databricks, Spark, PySpark, SQL, Python, AWS
- Git, Jenkins, Autosys, Airflow, GitHub, Azure DevOps
- PowerBI, Tableau, Starburst, Spotfire, TDV, ServiceNow
Team & Environment
You will collaborate with Architects, Business Analysts, and downstream consumers and work across global teams.
Benefits & Compensation
- Strong ownership and delivery focus
- Collaboration and teamwork across global teams
- Willingness to learn new technologies and data platforms
- Proactive identification of risks and improvement opportunities
- Ability to work independently in complex data environments
- Inclusive development opportunities
- Flexible work-life support
- Paid volunteer days
Work Mode
This role operates on a hybrid work model and is based in Hyderabad or Bangalore.
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
