{"response":{"award":[{"abstractText":"Supercomputers, or high-performance computing (HPC) clusters, are instrumental in propelling scientific and engineering research by offering vast computational resources. These systems are increasingly crucial as artificial intelligence (AI) techniques become pervasive across various fields, including climate modeling, drug discovery, and physics simulations, significantly expanding the need for computational power and data management. However, the existing HPC infrastructures face challenges with extended job wait times and suboptimal resource use, primarily due to the escalating complexity of computations and the burgeoning demands for resources. Unlike traditional HPC tasks, AI algorithms and models exhibit distinct resource requirements, often resulting in either excess or insufficient resource allocation for AI tasks. This project aims to bridge the gap between HPC resource provisioning and AI application demands through an in-depth analysis of resource allocation and utilization within HPC environments running AI workloads. The goal is to identify strategies for minimizing resource waste and reducing the length of job queues by efficiently reallocating idle resources to accommodate large-scale AI tasks. By creating and disseminating datasets, models, algorithms, and system source code, this initiative will contribute valuable tools and insights to the research community. The findings will be broadly shared through research papers, technical reports, book chapters, course materials, and tutorials, enhancing the knowledge base in both HPC and AI fields and supporting the broader objectives of promoting scientific progress, improving national health, prosperity, and welfare, and contributing to national defense. \r\n\r\nThis project centers on advancing the efficiency and productivity of HPC systems by innovatively leveraging idle resources to expedite AI job processing and diminish waiting periods. The research is structured around three interconnected themes, each addressing critical aspects of resource utilization and AI performance enhancement within HPC environments. The initial theme undertakes a comprehensive analysis of idle resources in HPC systems, aiming to identify patterns and opportunities for resource optimization. Building on the insights gained, the second theme explores methodologies for the safe and timely harvesting of idle resources across various categories, ensuring that these resources can be reallocated without compromising system stability or performance. The third theme is dedicated to developing strategies that utilize these harvested resources to boost AI application outcomes significantly and, by extension, enhance the overall productivity of HPC operations. The project will implement a tangible HPC testbed equipped with real-world benchmarks and workloads alongside these thematic investigations. This testbed will serve as a platform for empirically validating developed algorithms and systems, facilitating a rigorous assessment of their effectiveness in improving HPC resource allocation and utilization.\r\n\r\nThis award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.","activeAwd":"false","agency":"NSF","awardAgencyCode":"4900","awardee":"LOUISIANA STATE UNIVERSITY","awardeeAddress":"202 HIMES HALL","awardeeCity":"BATON ROUGE","awardeeCountryCode":"US","awardeeDistrict":"06","awardeeDistrictCode":"LA06","awardeeName":"Louisiana State University","awardeePhone":"2255782760","awardeeStateCode":"LA","awardeeZipCode":"708030001","cfdaNumber":"47.070","date":"04/17/2024","dirAbbr":"CSE","divAbbr":"OAC","estimatedTotalAmt":"300000","expDate":"06/30/2025","fundAgencyCode":"4900","fundProgramName":"OAC-Advanced Cyberinfrast Core","fundsObligated":["FY 2024 = $0.00"],"fundsObligatedAmt":"300000","histAwd":"false","id":"2403398","initAmendmentDate":"04/17/2024","jrnl":[{"artTitl":"Pre-Warming is Not Enough: Accelerating Serverless Inference With Opportunistic Pre-Loading","auth":"Sui, Yifan and Yu, Hanfei and Hu, Yitao and Li, Jianxun and Wang, Hao","authIndCode":"N","dgtlObjId":"https://doi.org/10.1145/3698038.3698509","jrnlYr":"2024","parPblcId":"10585506"},{"artTitl":"Freyr+: Harvesting Idle Resources in Serverless Computing via Deep Reinforcement Learning","auth":"Yu, Hanfei and Wang, Hao and Li, Jian and Yuan, Xu and Park, Seung-Jong","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/TPDS.2024.3462294","jrnlTitl":"IEEE Transactions on Parallel and Distributed Systems","jrnlVol":"35","jrnlYr":"2024","parPblcId":"10585528"},{"artTitl":"Stellaris: Staleness-Aware Distributed Reinforcement Learning with Serverless Computing","auth":"Yu, Hanfei and Wang, Hao and Tiwari, Devesh and Li, Jian and Park, Seung-Jong","authIndCode":"N","dgtlObjId":"https://doi.org/10.1109/SC41406.2024.00045","jrnlYr":"2024","parPblcId":"10585507"}],"latestAmendmentDate":"04/17/2024","managingPec":"090Y00","orgCodeDir":"05000000","orgCodeDiv":"05090000","orgLongName":"Directorate for Computer and Information Science and Engineering","orgLongName2":"Office of Advanced Cyberinfrastructure (OAC)","orgUrl":"https://www.nsf.gov/div/index.jsp?div=OAC","parentUeiNumber":"","pdPIName":"Hao Wang","perfAddress":"202 HIMES HALL","perfCity":"BATON ROUGE","perfCountryCode":"US","perfDistrict":"06","perfDistrictCode":"LA06","perfLocation":"Louisiana State University","perfStateCode":"LA","perfZipCode":"708030001","pi":["Hao Wang hwang9@stevens.edu"],"piEmail":"hwang9@stevens.edu","piFirstName":"Hao","piId":"270063554","piLastName":"Wang","poEmail":"jjli@nsf.gov","poName":"Juan Li","poPhone":"7032922625","primaryProgram":["01002425DB NSF RESEARCH & RELATED ACTIVIT"],"progEleCode":"090Y00","program":"EXP PROG TO STIM COMP RES","progRefCode":"9150","publicAccessMandate":"1","publicationResearch":["2024~Sui, Yifan and Yu, Hanfei and Hu, Yitao and Li, Jianxun and Wang, Hao~https://doi.org/10.1145/3698038.3698509~Pre-Warming is Not Enough: Accelerating Serverless Inference With Opportunistic Pre-Loading~N~10585506~10585506~OSTI~2025-09-30 09:58:26.166","IEEE Transactions on Parallel and Distributed Systems~2024~35~Yu, Hanfei and Wang, Hao and Li, Jian and Yuan, Xu and Park, Seung-Jong~https://doi.org/10.1109/TPDS.2024.3462294~Freyr+: Harvesting Idle Resources in Serverless Computing via Deep Reinforcement Learning~N~10585528~10585528~OSTI~2025-09-30 10:30:03.89","2024~Yu, Hanfei and Wang, Hao and Tiwari, Devesh and Li, Jian and Park, Seung-Jong~https://doi.org/10.1109/SC41406.2024.00045~Stellaris: Staleness-Aware Distributed Reinforcement Learning with Serverless Computing~N~10585507~10585507~OSTI~2025-09-30 09:56:28.31"],"startDate":"07/01/2024","title":"Collaborative Research: OAC: Core: Harvesting Idle Resources Safely and Timely for Large-scale AI Applications in High-Performance Computing Systems","transType":"Standard Grant","ueiNumber":"ECQEYCHRNKJ4"}],"metadata":{"offset":0,"rpp":25,"totalCount":1}}}