HDFS Developer

Cupertino, CA 95014
  • Job Code
    200274177
Summary

Summary

Posted: Aug 4, 2021

Role Number:200274177

Apple's Open Source Engineering team provides development and operational support to teams throughout the company. We provide stabl...Summary

Summary

Posted: Aug 4, 2021

Role Number:200274177

Apple's Open Source Engineering team provides development and operational support to teams throughout the company. We provide stable and reliable open source products that perform at Apple scale. This team achieves these goals in the open, through active collaboration with open source communities. We function as a link between the myriad functional teams within Apple and those communities.

Key Qualifications

  • Experience supporting and operating data systems that span at 10's to 1,000's of machines, 100's of terabytes or more of data under management.
  • A strong track record of collaboration and contribution to the open source communities.
  • Applied and academic knowledge of the implementation of distributed storage systems.
  • Expertise in the Java programming language and the Java Virtual Machine runtime environment.
  • Experience with Linux operating system administrative tasks.
  • Experience with Unix-environment programming languages, such as Shell, Python, Ruby, Perl, etc.

Description

We are looking for a motivated engineer who is excited about the challenge of working on the Apache Hadoop Distributed File System (HDFS) project! This is a Software Engineering role that requires a strong background in the implementation and operation of distributed storage and file-systems. Prior experience contributing to Apache Hadoop is a strong plus. Engagement with the Hadoop community on behalf of users and operators is essential. Are you someone who enjoys working on significant problems? If this sounds like something which you would be interested in, we'd love to hear from you!

The Open Source HDFS team is made up of Apache Hadoop contributors. We own and build the full software for the development of HDFS. We are responsible for the lifecycle of HDFS within Apple. Primary responsibilities include feature development, bug fixes, release management, and production support/triage of HDFS deployments and related systems. We are working in partnership with the Kubernetes infrastructure organization which involves containers, schedulers and orchestration tools such as Docker swarm or Apache Mesos. We partner with the SRE teams who run some of the largest HDFS clusters in the world. We also partner with the application teams who deliver Apple products.

RESPONSIBILITIES OF THE POSITION INCLUDE:
Collaboration with SRE and Development teams to identify requirements of production deployments.

Collaboration with the open source community: architectural and code reviews, documentation, issue triage, mailing list discussions, etc.

Support internal initiatives as they pertain to HDFS, provide HDFS expertise to system architectures, and bring internal innovations back to the open source.

Education & Experience

BS or MS in Computer Science or equivalent industry experience.

Additional Requirements

Before you go...

Our free job seeker tools include alerts for new jobs, saving your favorites, optimized job matching, and more! Just enter your email below.

Share this job:

HDFS Developer

Apple, Inc.
Cupertino, CA 95014

Join us to start saving your Favorite Jobs!

Sign In Create Account