ClanX is looking for a Senior Data Engineer to design and build scalable data pipelines and infrastructure that fuel AI and analytics for our mission-driven startup. We are focused on AI-powered energy optimization for climate impact.
What You'll Do
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Design, implement, and maintain data pipelines for ingestion, processing, and transformation in Azure.
- Create data models for analytics purposes.
- Build and maintain ETL operations using Azure Data Factory or comparable technologies.
- Assemble large, complex data sets using Azure Data Factory and Databricks.
- Implement data validation and cleansing procedures to ensure quality, integrity, and dependability.
- Ensure data security and compliance.
- Collaborate with data engineers and other stakeholders to translate requirements into scalable data platform architectures.
What We're Looking For
- 5+ years of experience with Data Engineering using Azure.
- Experience with Azure DevOps, Apache Spark, Python, SQL proficiency, Azure Databricks knowledge, and Big data technologies.
- Core Azure DE skills and coding skills (PySpark, Python, and SQL).
- Well versed in coding, spark core, and data ingestion using Azure.
- Decent communication skills.
Technical Stack
- Azure, Azure SQL Database, Azure Data Lake, Azure Blob Storage
- Azure Data Factory, Azure Databricks
- Apache Spark, Python, SQL, PySpark
Team & Environment
You will collaborate with data engineers and other stakeholders.
Benefits & Compensation
- Compensation: INR 1.5 to 2 LPM
Work Mode
This is a remote position open to candidates in India, specifically Bengaluru, Karnātaka.
ClanX is an equal opportunity employer.
