Storage Engineer, Ceph and Parallel File Systems
You design and build the storage behind GPU clusters: Ceph clusters for block, object and file storage, and parallel file systems for training data. You fit each design to the data and the GPU systems that read it, test it under the client's workloads and hand it over with its configuration in Git and a runbook.
Duties
- Map what each storage cluster must hold, how fast it grows, how it is read and written and where it runs.
- Design Ceph clusters that serve block volumes, S3-compatible object buckets and shared file systems from one cluster.
- Choose the storage network, drives and servers together, with fast NVMe pools and capacity pools on hard drives.
- Set the data protection of each pool, replicas or erasure coding, to match how its data is used.
- Design parallel file systems for training data and checkpoints, matched to how the GPU systems read and write.
- Build each cluster with its configuration declared in Git.
- Test each cluster under the client's workloads before it holds their data.
- Hand each cluster over with its monitoring, its configuration and a runbook the client's team can run it from.
What you bring
- 3+ years designing or building Ceph clusters.
- Experience with a parallel file system for HPC or GPU workloads.
- Strong Linux skills across storage, networking and performance tuning.
- Working knowledge of NVMe drives, hard drives and storage networks.
- Automation with Ansible or similar tools, and Git-based workflows.
Nice to have
- Rook for running Ceph inside Kubernetes.
- CSI drivers for block, object and file storage.
- Lustre, BeeGFS or IBM Storage Scale.
- GPUDirect Storage or RDMA for storage traffic.
Pay and benefits
$126,000 to $176,000 a year
Full-time W-2 employment with health insurance, a retirement plan and paid leave.
No application deadline. We accept applications for this role on an ongoing basis.
Location
Remote, United States
Apply
We review applications as each team grows and contact you when there is a match.
Rillor is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status or any other status protected by law.
If you need an accommodation to apply, email careers@rillor.com.
Notices
Trademarks. NVIDIA, AMD, Ceph, Kubernetes and related product names are trademarks of their owners and are used only to identify products. No affiliation or endorsement is implied.