Hadoop Site Reliability Engineer (SRE)

Apple, Inc.
Cupertino, CA 95014
  • Job Code
    200151362
Summary

Summary

Posted: Feb 19, 2020

Weekly Hours: 40

Role Number:200151362

Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and cust...Summary

Summary

Posted: Feb 19, 2020

Weekly Hours: 40

Role Number:200151362

Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.

Apple's Applied Machine Learning team has built systems for a number of large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business, we manage many streams of Apple-scale data. We bring it all together and extract the value. We do all this with an exceptional group of software engineers, data scientists, SRE/devops engineers and managers.

Key Qualifications

  • Experience with Hadoop based technologies - Hive, Spark, HDFS/Yarn cluster administration
  • Have a passion for automation by creating tools using Python, Java or other JVM languages
  • Strong expertise in troubleshooting complex production issues.
  • Expert understanding of Unix/Linux based operating system
  • Excellent problem solving, critical thinking, and communication skills
  • Experience deploying and managing CI/CD pipelines
  • Expertise in configuration management (such as Ansible, salt) for deploying, configuring, and managing servers and systems
  • The candidate should be adapt at prioritizing multiple issues in a high pressure environment
  • Should be able to understand complex architectures and be comfortable working with multiple teams
  • Ability to conduct performance analysis and troubleshoot large scale distributed systems
  • Should be highly proactive with a keen focus on improving uptime availability of our mission-critical services
  • Comfortable working in a fast paced environment while continuously evaluating emerging technologies
  • Proficient in unix, command-line tools, and general system debugging
  • The position requires solid knowledge of secure coding practices and experience with the open source technologies.

Description
- Monitor production, staging, test and development environments for a myriad of applications in an agile and dynamic organization.
- You are an independent problem-solver who is self-directed and capable of exhibiting deftness to handle multiple simultaneous competing priorities and deliver solutions in a timely manner.
- Provide incident resolution for all technical production issues.
- Create and maintain accurate, up-to-date documentation reflecting configuration, and responsible for writing justifications, training users in complex topics, writing status reports, documenting procedures, and interacting with other Apple staff and management.
- Provide guidance to improve the stability, security, efficiency and scalability of systems.
- Determine future needs for capacity and investigate new products and/or features.
- Administer and ensure the proper execution of the backup systems.
- Provide 24x7 on-call support to handle urgent critical issues.

Education & Experience

BS in computer science with 7+ years or MS plus 5+ years experience or related experience.

Additional Requirements

  • - Experience with Kubernetes, Docker Swarm, or other container orchestration framework
  • - Experience building and operating large scale hadoop/spark data infrastructure used for machine learning in a production environment
  • - Experience in tuning complex hive and spark queries
  • - Expertise in debugging hadoop/spark/hive issues using Namenode, datanode, Nodemanager, spark executor logs.
  • - Experience in Capacity management on multi tenant hadoop cluster
  • - Experience in Workflow and data pipeline orchestration (Oozie,Jenkins etc.)
  • - Experience in Jupyter based notebook infrastructure.


Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

Hadoop Site Reliability Engineer (SRE)

Apple, Inc.
Cupertino, CA 95014

Join us to start saving your Favorite Jobs!

Sign In Create Account