Join phData, a leader in the modern data stack, as a Senior Data Engineer. In this role, you will be responsible for developing complete technical solutions from design through to production, ensuring performance, security, and robust data integration.
What You'll Do
- Develop end-to-end technical solutions into production.
- Ensure performance, security, scalability, and robust data integration.
- Create and deliver detailed presentations.
- Produce detailed solution documentation, such as POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views.
What We're Looking For
- At least 4+ years of experience as a Software Engineer, Data Engineer, or Data Analyst.
- A demonstrated ability to develop end-to-end technical solutions into production.
- Programming expertise in Java, Python, and/or Scala.
- Experience with core cloud data platforms including Snowflake, AWS, Azure, Databricks, and GCP.
- Proficiency with SQL and the ability to write, debug, and optimize SQL queries.
- Strong client-facing written and verbal communication skills.
- A 4-year Bachelor's degree in Computer Science or a related field.
Nice to Have
- Production experience in core data platforms: Snowflake, AWS, Azure, GCP, Hadoop, Databricks.
- Experience with cloud and distributed data storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra or other NoSQL systems.
- Experience with data integration technologies: Spark, Kafka, event/streaming, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services (IICS), Google DataProc.
- Experience with multiple data sources such as queues, relational databases, files, search, and APIs.
- Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment.
- Experience with automated data transformation and curation: dbt, Spark, Spark streaming, or automated pipelines.
- Experience with workflow management and orchestration: Airflow, AWS Managed Airflow, Luigi, NiFi.
Technical Stack
- Languages: Java, Python, Scala
- Platforms: Snowflake, AWS, Azure, Databricks, GCP
- Storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra
- Integration: Spark, Kafka, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica IICS, Google DataProc
- Transformation & Orchestration: dbt, Airflow, AWS Managed Airflow, Luigi
Work Mode
This is a fully remote position open to candidates located in the United States, Latin America, and India.
phData celebrates diversity and is committed to creating an inclusive environment for all employees. We are proud to be an equal opportunity employer.
