Pipeline Developer
Apply NowCompany: Caltech
Location: Pasadena, CA 91104
Description:
Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating talented people who are passionate about what they do. Join us and be a part of the diverse Caltech community.
Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating dedicated people who are passionate about what they do. Join us and be a part of the diverse Caltech community.
IPAC, in the Physics, Math, and Astronomy Division at Caltech, provides science operations, user support, data and archive services, and scientific vision to enhance discovery with observatories both in space and on the ground. The Nancy Grace Roman Space Telescope is a NASA observatory designed to address key questions in the areas of dark energy, exoplanets and infrared astrophysics. It is slated for launch by May 2027. IPAC is inviting highly qualified individuals to apply for a full-time position as a data processing Pipeline Developer with the Roman team at IPAC. This position requires weekly work on-site.
Job Summary
As a Pipeline Developer, you will work with the engineering and scientific team members on tasks to help develop, operate, and test large, automated pipelines in a cloud environment that process images and spectroscopy taken with Instruments on the Roman Telescope. During operations, you will ensure the automated system is running as expected and carries out maintenance activities, working with the scientists and engineers on the team.
Essential Job Duties
Basic Qualifications
Preferred Qualifications
Beyond these basic qualifications, there are a set of skills and experiences which will add to your ability to contribute to the roles and responsibilities. The following might give you a head start here, but even if these do not describe you or your experience, we would still like to hear from you:
Required Documents
People choose to work at IPAC for many reasons, and the casual, employee-centric culture often leads to fulfilling, long-term careers and positive relationships. Caltech's benefits program offers a quality, competitive benefits package that is affordable for you and the Institute. We also offer a 403(b) defined contribution plan to eligible staff as well as a Voluntary Retirement Savings (TDA) Plan. IPAC staff have access to the Institute's facilities, including the athletic center, libraries, on-site daycare, professional development and enrichment classes, and Athenaeum club membership.
Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating dedicated people who are passionate about what they do. Join us and be a part of the diverse Caltech community.
IPAC, in the Physics, Math, and Astronomy Division at Caltech, provides science operations, user support, data and archive services, and scientific vision to enhance discovery with observatories both in space and on the ground. The Nancy Grace Roman Space Telescope is a NASA observatory designed to address key questions in the areas of dark energy, exoplanets and infrared astrophysics. It is slated for launch by May 2027. IPAC is inviting highly qualified individuals to apply for a full-time position as a data processing Pipeline Developer with the Roman team at IPAC. This position requires weekly work on-site.
Job Summary
As a Pipeline Developer, you will work with the engineering and scientific team members on tasks to help develop, operate, and test large, automated pipelines in a cloud environment that process images and spectroscopy taken with Instruments on the Roman Telescope. During operations, you will ensure the automated system is running as expected and carries out maintenance activities, working with the scientists and engineers on the team.
Essential Job Duties
- Participate in pipeline team meetings and develop code from algorithms to production quality data reduction pipeline modules.
- Manage the operation of automated pipeline processes including aliveness checks, suspending and restarting.
- Participate in testing during development of the pipelines.
- Develop and maintain scripts to assist with the above activities.
- Help develop, review and update system monitoring websites on a regular basis.
- Assist in error resolution in pipeline operations
Basic Qualifications
- Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, Astronomy, Physics, Math or a related technical field.
- Experience in building and maintaining batch-oriented workflows with Apache Airflow or other task schedulers, using a Kubernetes cluster or other distributed computer cluster.
- Experience with developing software code using Python and/or C.
- Familiarity with software configuration management principles and tools, source code version control (e.g., git/GitHub) and issue/bug tracking systems (e.g., Jira).
- Applicants for this position must be a United States (US) person as defined by ITAR regulations - A US person is a citizen of the United States, a lawful permanent resident alien of the US ("Green Card" holder), or individuals granted refugee and Asylee status under US law.
Preferred Qualifications
Beyond these basic qualifications, there are a set of skills and experiences which will add to your ability to contribute to the roles and responsibilities. The following might give you a head start here, but even if these do not describe you or your experience, we would still like to hear from you:
- Experience as a software developer in in a cloud environment using core AWS services (specifically any of the following: S3, ECR, or EKS).
- Good written and interpersonal communication skills, with an emphasis on the ability to share ideas in a collaborative setting.
Required Documents
- Resume
- Short Cover Letter
People choose to work at IPAC for many reasons, and the casual, employee-centric culture often leads to fulfilling, long-term careers and positive relationships. Caltech's benefits program offers a quality, competitive benefits package that is affordable for you and the Institute. We also offer a 403(b) defined contribution plan to eligible staff as well as a Voluntary Retirement Savings (TDA) Plan. IPAC staff have access to the Institute's facilities, including the athletic center, libraries, on-site daycare, professional development and enrichment classes, and Athenaeum club membership.