Responsibilities
- Proven track record in building and maintaining large Hadoop clusters, including architectural design, capacity forecasting, deployment, optimization, and ongoing monitoring
- Solid knowledge of core Hadoop components including HDFS, MapReduce, streaming, Sqoop, Oozie, and Hive
- Extensive hands-on experience with the Horton Works Hadoop distribution
- Demonstrated experience implementing disaster recovery and business continuity strategies for Hadoop platforms
- Skilled in deploying, managing, and troubleshooting Linux systems and hardware in enterprise settings
- Proficient in system administration tasks such as storage management and performance optimization
- Strong scripting abilities in shell, Perl, and Python
- Hands-on experience configuring and managing security protocols for Hadoop clusters
- Ongoing oversight and monitoring of Hadoop cluster health and infrastructure performance
- Automation of node provisioning and routine operational tasks to improve efficiency
- Maintenance and ownership of Hadoop support runbooks and operational procedures
- Accountability for ensuring high cluster availability with 24x7 on-call support coverage
- Support for deployment activities across development and production environments
Work Arrangement
On-site — Foster City, CA
Other
Provides 24x7 on-call support as part of operational responsibilities