HPC Engineer/Architect
Apply NowCompany: Diverse Lynx LLC
Location: New York, NY 10025
Description:
Job Description:
You will support day-to-day operations of large-scale parallel file systems, deploy and maintain Linux HPC infrastructure across multiple data centers, and assist HPC engineers and architects with day-to-day operations and tickets.
Support day-to-day operations of large-scale parallel file systems
Deploy and Maintain Linux HPC infrastructure across multiple datacenters
Assist HPC engineers and architects with day-to-day operations and tickets
Required Skills:
Linux Operating Systems (RHEL/CentOS), Parallel file system (GPFS), Job Scheduler LSF/Slrm
Ansible, Python, Shell scripting
GPU-based compute infrastructure (including CUDA)
CentOS 4.5
HPCC
Responsibilities:
Design, architect and oversee implementation of Linux based HPC clusters and storage
Deploy physical hardware using HPC deployment tools and configuration and orchestration tools (Ansible)
Parallel file system (GPFS) performance tuning, monitoring and troubleshooting
Perform systems benchmarking, and developing automated tests for the HPC environment, ensuring the reliability and efficiency of our computational infrastructure
Infiniband network maintenance and troubleshooting
Automate and monitor the HPC user lifecycle process
Slurm installation, configuration, performance tuning and troubleshooting
Plan, design and implement a transition from the LSF scheduler to Slurm
Manage the Slurm scheduler and translate Research policies into scheduler configurations
Consult with faculty and students to develop research pipelines for use on the HPC cluster
Develop and maintain user lifecycle software suite in Python, implement CI/CD pipeline
Test and automate upgrades of critical system applications using Ansible and shell scripts.
The ability to communicate effectively with clinicians, researchers, and other team members to develop technological solutions is key
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
You will support day-to-day operations of large-scale parallel file systems, deploy and maintain Linux HPC infrastructure across multiple data centers, and assist HPC engineers and architects with day-to-day operations and tickets.
Support day-to-day operations of large-scale parallel file systems
Deploy and Maintain Linux HPC infrastructure across multiple datacenters
Assist HPC engineers and architects with day-to-day operations and tickets
Required Skills:
Linux Operating Systems (RHEL/CentOS), Parallel file system (GPFS), Job Scheduler LSF/Slrm
Ansible, Python, Shell scripting
GPU-based compute infrastructure (including CUDA)
CentOS 4.5
HPCC
Responsibilities:
Design, architect and oversee implementation of Linux based HPC clusters and storage
Deploy physical hardware using HPC deployment tools and configuration and orchestration tools (Ansible)
Parallel file system (GPFS) performance tuning, monitoring and troubleshooting
Perform systems benchmarking, and developing automated tests for the HPC environment, ensuring the reliability and efficiency of our computational infrastructure
Infiniband network maintenance and troubleshooting
Automate and monitor the HPC user lifecycle process
Slurm installation, configuration, performance tuning and troubleshooting
Plan, design and implement a transition from the LSF scheduler to Slurm
Manage the Slurm scheduler and translate Research policies into scheduler configurations
Consult with faculty and students to develop research pipelines for use on the HPC cluster
Develop and maintain user lifecycle software suite in Python, implement CI/CD pipeline
Test and automate upgrades of critical system applications using Ansible and shell scripts.
The ability to communicate effectively with clinicians, researchers, and other team members to develop technological solutions is key
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.