High Performance Compute (HPC) Storage Engineer
Hudson River Trading
Overview
As a Storage Engineer at Hudson River Trading, you will design, implement, and manage large-scale storage infrastructure to support our global research and trading environment. You’ll work within a small, collaborative HPC storage team to shape storage direction, experiment with new hardware and software, and improve performance and reliability of storage clusters. This role offers freedom to explore, propose, and test solutions that scale to multi-petabyte environments. You will contribute to a mission-driven culture that values openness and rapid problem solving in a fast-paced setting.
Pay / Benefits- discretionary performance-based bonuses
- competitive benefits package
- Design and manage a variety of storage solutions
- Research and experiment with new storage technologies and approaches
- Troubleshoot complex storage, OS, and networking issues
- Build tools to improve performance and monitoring of storage clusters
- Knowledge of distributed file systems used for large-scale cluster computing (Lustre, CephFS, GPFS, etc.)
- Ability to design a home grown NAS storage solution with redundancy and high availability
- 5+ years of experience in HPC-like environments with large scale storage deployments (>1PB)
- 3+ years of experience with scale-out enterprise storage solutions (Isilon, VAST, NetApp, Pure)
- Extensive experience with Linux troubleshooting and NFS
- Strong knowledge of Linux filesystems (RAID, ZFS, etc.)
- Proficient in Python and shell scripting
- Strong cross-functional communication skills
- Ability to analyze and solve problems quickly in a fast-paced environment
- Exceptional time management and ability to balance independent and collaborative work
- Eager to learn and apply new skills
- Cross-functional communication
- Problem-solving in fast-paced environments
- Time management
- Lustre
- CephFS
- GPFS
Reference: WJ-747_30162456