In this deck from the DDN User Group at SC18 in Dallas, Brock Palen from the University of Michigan presents: HPC at the University of Michigan: A Multi‐Tenant, Multi‐Science Campus Service Provider. Advanced Research Computing — Technology Services provides access to and support for advanced computing resources. ARC-TS facilitates new and more powerful approaches to research challenges in fields ranging from physics to linguistics, and from engineering to medicine." Learn more: https://arc-ts.umich.edu/about/ and http://ddn.com Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter

1. Multi-Tenant, Multi-Science
Campus Service Provider

2. 100 Top 10 Graduate Programs
Scientific Diversity
○ Medicine
○ Engineering
○ Arts

3. Brock Palen | @brockpalen | brockp@umich.edu
Director Adv. Research Computing - Technology Srvs.
● NPACI Student 2004
● Original Campus Champions Group Member
● BSE Nuclear Engineering Reactor Modeling

4. 5

5. History of Campus Storage Offerings
● One size fits all
● Assumes the value of all data are the same
○ Hot vs. Warm vs. Archive/Publication
A lot of build your own

6. Problem: What to Optimize For
● Thousands of Users
○ Novice Level (Generally)
○ Not Leadership Class
○ Tend to Graduate
● Scientific Diversity
○ Protected and Open Data
○ Big IO, Lots of Files

8. Solution: Locker Bulk Storage
● 2 Site - 5 PByte
● Encrypted at rest
● Grow’s in reasonable increments
● Globus / NFS / CIFS

9. Great Lakes Solution: IME + GridScaler
2 PB Spinning
5% NVMe IME
NVMe Metadata + Data in Metadata

10. Great Lakes

11. Thank You - Contact
• hpc-support@umich.edu
• http://arc-ts.umich.edu/
• @ARCTS_UM
• brockp@umich.edu
• http://myumi.ch/aV7kz
12

12. Justification - Flux 1.3 PB
File Size Range Average Size MB % of Total Files % of Total Space
>1GB 5561.053 0.02% 58.14%
>512MB - 1GB 698.909 0.02% 8.73%
>256MB - 512MB 380.379 0.03% 5.96%
>128MB - 256MB 176.324 0.05% 4.90%
>32MB - 128MB 56.892 0.24% 8.12%
>1MB - 32MB 5.435 3.33% 10.98%
0-1MB 0.054 96.32% 3.16%