We are seeking a skilled DevOps Engineer to join our Hadoop/Big Data Infrastructure Team. The role involves managing and supporting large-scale distributed systems and automating infrastructure operations across global data centers, ensuring system reliability, scalability, and performance across 5000+ compute, storage, and distributed systems.
Responsibilities
- Provide operational support for Hadoop clusters and other Big Data tools such as HBase, Scylla, Hive/Hue, Kafka, and Storm.
- Automate deployments and operations to enhance efficiency and reliability.
- Perform upgrades of Hadoop and associated tools as required.
- Fine-tune configurations using management tools such as Puppet and InfraDB (in-house Ruby on Rails CM Database).
- Orchestrate deployments and services using Ansible.
- Implement continuous integration processes following change management protocols using Git and Gerrit.
- Develop monitoring and alerting scripts using Python and Bash/Shell.
- Monitor system health using tools like Nagios, Graphite, Grafana, OpenTSDB, and Prometheus.
- Troubleshoot and optimize system and service performance.
- Collaborate with cross-functional teams, including Data Center Operations, NOC, Network, Database, and Engineering.
- Track and resolve incidents, conduct root cause analysis, and maintain detailed runbooks and documentation.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
- Proven experience in DevOps, Big Data infrastructure, or system administration.
- Hands-on expertise in Linux-based systems, automation tools, and monitoring platforms.
- Strong problem-solving and collaboration skills.
Technical Stack
Hadoop, HBase, Scylla, Hive, Hue, Kafka, Storm, Puppet, InfraDB, Ruby on Rails, Ansible, Git, Gerrit, Python, Bash, Shell, Nagios, Graphite, Grafana, OpenTSDB
Work Arrangement
Remote (Global) — Remote — Night Shift
