Yokne'am Illit, Northern District, Israel Hybrid

NielsenIQ is hiring a Big Data Engineer

Responsibilities

  • Manage full lifecycle data workflows, from gathering requirements and designing architecture to deployment and ongoing operations, covering data ingestion, validation standards, and integration with data science initiatives.
  • Develop scalable batch and real-time data processing pipelines and lakehouse architectures designed for high-volume data handling.
  • Investigate and implement emerging technologies to expand the data platform’s capacity in response to accelerating data growth.
  • Work closely with data science teams to operationalize machine learning and artificial intelligence models within product environments.
  • Coordinate with cloud, DevOps, software development, and client-facing teams to build secure, reliable, and scalable data solutions that address key business challenges.
  • Assess and integrate new data technologies and architectural patterns to advance the data ecosystem as demands increase in scale and complexity.

Work Arrangement

Hybrid

Other

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)
Required Skills
PythonScalaAWSMicrosoft AzureGCPApache SparkKafkaAirflowSQLBig DataData Engineering
About company
NielsenIQ
NielsenIQ delivers the Full View of shopper behaviour to clients through Homescan panel data, capturing real shopper behaviour to provide insights for businesses, particularly in the FMCG sector.
All jobs at NielsenIQ Visit website
Job Details
Department Data and Analytics
Category data
Posted 4 months ago