Remote (Country) Full-time

Unknown Company is hiring a Data Engineer Senior Manager

About the Role

Interface Systems is hiring a Data Engineer Senior Manager to architect and drive our Azure-based data platform. In this senior role, you'll leverage Azure Synapse Analytics, Azure Data Lake, and Apache Spark to build scalable, secure, and high-performance data solutions that power our analytics and business intelligence.

What You'll Do

  • Build and maintain efficient, secure, and reliable ELT pipelines using Azure Synapse Analytics and Apache Spark.
  • Develop and optimize data models (e.g., star schemas, snowflake schemas) for data warehousing and analytics within Azure Synapse Analytics.
  • Implement data governance frameworks, including data quality, lineage, and cataloging, using Azure Purview or similar tools.
  • Ensure compliance with security standards and data privacy regulations (e.g., GDPR, CCPA).
  • Take ownership of existing Azure DevOps pipelines, source code repositories, and branching strategies and produce new artifacts when required.
  • Manage all Azure EDW resources using infrastructure as code tooling.
  • Monitor and optimize the performance of Azure Synapse Analytics, Data Lake, Spark jobs, and on-premise SQL Servers.
  • Collaborate with cross-functional teams (e.g., business analysts, report and application developers) to integrate Azure data solutions with other systems.
  • Provide guidance and mentorship for other less experienced team members.
  • Stay abreast of emerging Azure data technologies, Apache Spark advancements, and industry trends, recommending and implementing innovative solutions.

What We're Looking For

  • Bachelor's degree in computer science, Data Science, Information Technology, or a related field (or equivalent work experience).
  • 7+ years of experience in data architecture, data engineering, or related roles.
  • At least 3 years focused on Azure cloud platforms.
  • Extensive hands-on experience with Azure Synapse Analytics, Azure Data Lake (Gen2), SQL Server, and Apache Spark.
  • Proven track record of designing and implementing large-scale data solutions in a cloud environment.
  • Strong background in DevOps culture with a deep understanding of source control and infrastructure as code.
  • Expertise in Azure data services, including Azure Synapse Analytics / Azure Data Factory and Azure Data Lake Storage.
  • Strong proficiency in Apache Spark for big data processing, including Spark SQL, DataFrames, and RDDs, preferably using PySpark.
  • Expert level in writing efficient SQL statements in several different database technologies.
  • Advanced knowledge of object-functional scripting languages, particularly Python, for data processing, transformation, and automation.
  • Extensive experience in data warehousing concepts, including dimensional modeling, ETL/ELT processes, and data integration.
  • Expertise in data modeling techniques (e.g., Kimball, Inmon) and tools (e.g., ERwin, PowerDesigner).
  • Strong proficiency in SQL and T-SQL for querying, optimizing, and managing data in both Azure and on-premise environments.
  • Highly experienced with DevOps methodologies and flows using Azure DevOps or similar.
  • Deep understanding of source control and branching strategies using tools such as Git.
  • Experienced in maintaining cloud-based resources using IAC tools such as Terraform or Bicep.

Nice to Have

  • Microsoft certifications in Azure data technologies (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert).
  • Familiarity with Power BI or other visualization tools for reporting and dashboard development.
  • Experience with containerization and orchestration tools like Docker and Kubernetes in Azure (e.g., AKS).
  • Experience working with other Azure resources such as API management, Logic Apps, or Event Grid.
  • Familiarity with data integration patterns, including CDC, real-time streaming, and batch processing.
  • Knowledge of data governance tools like Azure Purview or Collibra.

Technical Stack

  • Azure Synapse Analytics, Azure Data Lake, Apache Spark, PySpark, SQL Server
  • Python, Scala, T-SQL
  • Azure DevOps, Git, Terraform, Bicep
  • Azure Purview, Azure Data Factory
  • Docker, Kubernetes, Azure Kubernetes Service (AKS)
  • Azure API Management, Azure Logic Apps, Azure Event Grid
  • Power BI

Team & Environment

You will be part of our data team and collaborate closely with cross-functional teams, including business analysts, report developers, and application developers.

Benefits & Compensation

  • Salary: $130,000 - $150,000

Work Mode

This position is based in the United States.

Interface Systems is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without regard to that individual’s age, race, color, religion or creed, national origin or ancestry, sex (including pregnancy), sexual orientation, gender, gender identity, physical or mental disability, veteran status, genetic information, ethnicity, citizenship, or any other characteristic protected by law.

Required Skills
Azure Synapse AnalyticsAzure Data LakeApache SparkPySparkSQL ServerPythonAzure DevOpsTerraformData EngineeringData ArchitectureETLData ModelingGitScalaCloud Infrastructure
Relocating to Thailand?

Visa and work permit handled by experts

SVBL manages your entire visa process — from application to approval. Work permits, extensions, and compliance all covered. One partner for legal, immigration, and settling in.

Work permit processing
Visa extensions & renewals
Immigration compliance
Banking & housing guidance
Get free consultation
Free initial consultation
About company
?
Job Details
Category data
Posted 7 months ago