trudyniisiТруды НИИСИSRISA Proceedings2225-73493033-6422НИЦ «КУРЧАТОВСКИЙ ИНСТИТУТ» - НИИСИtrudyniisi-108Research ArticleВЫСОКОПРОИЗВОДИТЕЛЬНЫЕ ВЫЧИСЛЕНИЯHIGH-PERFORMANCE COMPUTINGСимулятор системы управления суперкомпьютерными заданиями с внешним интерфейсом управленияSupercomputer Job Management System Simulator with External Control InterfaceЛяховецД. С.LyakhovetsD.

Москва

anetto@inbox.ruБарановА. В.BaranovA.

Москва

abaranov@jscc.ruКудринА. Ю.KudrinA.

Москва

akudrin2002@gmail.comМСЦ РАН – филиал ФГУ ФНЦ НИИСИ РАНРоссия2024091220251447583Copyright © Ляховец Д.С., Баранов А.В., Кудрин А.Ю., 20252025Ляховец Д.С., Баранов А.В., Кудрин А.Ю.Lyakhovets D., Baranov A., Kudrin A.This work is licensed under a Creative Commons Attribution 4.0 License.https://www.t-niisi.ru/jour/article/view/108

Одним из востребованных инструментов исследования поведения систем управления суперкомпьютерными заданиями (СУЗ), как сложных систем коллективного пользования, является имитационное моделирование при помощи симуляторов. В статье сформулированы требования к симулятору высокопроизводительной вычислительной системы, включающей в свой состав территориально распределенные суперкомпьютеры. Соответствие выдвинутым требованиям может быть обеспечено за счет реализации внешнего интерфейса управления симулятором. В статье представлен анализ характеристик современных симуляторов СУЗ с точки зрения выдвинутых требований, предложена архитектура симулятора СУЗ с внешним симулятором управления. Рассмотрены первые результаты применения симулятора Elytra, реализующего предложенную архитектуру.

Simulators are popular tools for studying the supercomputer workload managers as complex multiuser systems. The paper formulates requirements for a simulator of a HPC system that includes geographically distributed supercomputers. Compliance with the stated requirements can be ensured by implementing an external simulator control interface. An analysis of the characteristics of modern HPC workload manager simulators is presented from the stated requirements point of view. The architecture of a workload manager simulator with external control interface is proposed. The first results of using the Elytra simulator, which implements the proposed architecture, are considered.

высокопроизводительные вычисленияимитационное моделированиепланирование заданийсистема управления заданиямиhigh performance computingsimulatingjob schedulingworkload managerРабота была выполнена в рамках государственного задания по теме FNEF-2024-0016.ReferencesА.В. Баранов, А.И. Тихомиров. Методы и средства организации глобальной очереди заданий в территориально распределенной вычислительной системе. «Вестник ЮУрГУ. Серия: Вычислительная математика и информатика», Т. 6 (2017), № 4, 28-42.А.В. Баранов, А.И. Тихомиров. Методы и средства организации глобальной очереди заданий в территориально распределенной вычислительной системе. «Вестник ЮУрГУ. Серия: Вычислительная математика и информатика», Т. 6 (2017), № 4, 28-42.А.Г. Феоктистов, А.С. Корсуков, Ю.А. Дядькин. Инструментальные средства имитационного моделирования предметно-ориентированных распределенных вычислительных систем. «Системы управления, связи и безопасности», № 4 (2016), 30–60.А.Г. Феоктистов, А.С. Корсуков, Ю.А. Дядькин. Инструментальные средства имитационного моделирования предметно-ориентированных распределенных вычислительных систем. «Системы управления, связи и безопасности», № 4 (2016), 30–60.D. Cameron, R. Carvajal-Schiano, A. Millar, C. Nicholson, K. Stockinger, F. Zini. OptorSim: A simulation tool for scheduling and replica optimisation in data grids. “Computing in High Energy and Nuclear Physics”, 2010, 707-711.D. Cameron, R. Carvajal-Schiano, A. Millar, C. Nicholson, K. Stockinger, F. Zini. OptorSim: A simulation tool for scheduling and replica optimisation in data grids. “Computing in High Energy and Nuclear Physics”, 2010, 707-711.S. Bąk, M. Krystek, K. Kurowski, A. Oleksiak, W. Piatek, J. Waglarz. GSSIM - A tool for distributed computing experiments. “Scientific Programming”, V. 19 (2017), 231-251.S. Bąk, M. Krystek, K. Kurowski, A. Oleksiak, W. Piatek, J. Waglarz. GSSIM - A tool for distributed computing experiments. “Scientific Programming”, V. 19 (2017), 231-251.W. Chen, E. Deelman. WorkflowSim: A toolkit for simulating scientific workflows in distributed environments. “2012 IEEE 8th International Conference on E-Science, e-Science 2012”, 2012, 1-8.W. Chen, E. Deelman. WorkflowSim: A toolkit for simulating scientific workflows in distributed environments. “2012 IEEE 8th International Conference on E-Science, e-Science 2012”, 2012, 1-8.S. Ostermann, K. Plankensteiner, R. Prodan, T. Fahringer. GroudSim: An Event-Based Simulation Framework for Computational Grids and Clouds. “Euro-Par 2010 Parallel Processing Workshops. Euro-Par 2010. Lecture Notes in Computer Science”, V. 6586 (2011), 305–313.S. Ostermann, K. Plankensteiner, R. Prodan, T. Fahringer. GroudSim: An Event-Based Simulation Framework for Computational Grids and Clouds. “Euro-Par 2010 Parallel Processing Workshops. Euro-Par 2010. Lecture Notes in Computer Science”, V. 6586 (2011), 305–313.P.-F. Dutot, M. Mercier, M. Poquet, O. Richard. Batsim: A Realistic Language-Independent Resources and Jobs Management Systems Simulator. “Job Scheduling Strategies for Parallel Processing. Lecture Notes in Computer Science”, V. 10353 (2017), 178-197.P.-F. Dutot, M. Mercier, M. Poquet, O. Richard. Batsim: A Realistic Language-Independent Resources and Jobs Management Systems Simulator. “Job Scheduling Strategies for Parallel Processing. Lecture Notes in Computer Science”, V. 10353 (2017), 178-197.M. Obaida, J. Liu. Simulation of HPC job scheduling and large-scale parallel workloads. “2017 Winter Simulation Conference (WSC)”, 2017, 920-931.M. Obaida, J. Liu. Simulation of HPC job scheduling and large-scale parallel workloads. “2017 Winter Simulation Conference (WSC)”, 2017, 920-931.D. Klusáček, M. Soysal, F. Suter. Alea – Complex Job Scheduling Simulator. “Parallel Processing and Applied Mathematics. PPAM 2019. Lecture Notes in Computer Science”, V. 12044 (2020), 217-229.D. Klusáček, M. Soysal, F. Suter. Alea – Complex Job Scheduling Simulator. “Parallel Processing and Applied Mathematics. PPAM 2019. Lecture Notes in Computer Science”, V. 12044 (2020), 217-229.N. Capit, G. Da Costa, Y. Georgiou, G. Huard, C. Martin, G. Mounié, P. Neyron, O. Richard. A batch scheduler with high level components. “CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid”, V. 2 (2005), 776-783.N. Capit, G. Da Costa, Y. Georgiou, G. Huard, C. Martin, G. Mounié, P. Neyron, O. Richard. A batch scheduler with high level components. “CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid”, V. 2 (2005), 776-783.D. Klusáček, M. Soysal. Walltime Prediction and Its Impact on Job Scheduling Performance and Predictability. “Job Scheduling Strategies for Parallel Processing. JSSPP 2020. Lecture Notes in Computer Science”, V. 12326 (2020), 127-144.D. Klusáček, M. Soysal. Walltime Prediction and Its Impact on Job Scheduling Performance and Predictability. “Job Scheduling Strategies for Parallel Processing. JSSPP 2020. Lecture Notes in Computer Science”, V. 12326 (2020), 127-144.V. Chlumský, D. Klusáček. Improving Accuracy of Walltime Estimates in PBS Professional Using Soft Walltimes. “Job Scheduling Strategies for Parallel Processing. JSSPP 2022. Lecture Notes in Computer Science”, V. 13592 (2023), 192-210.V. Chlumský, D. Klusáček. Improving Accuracy of Walltime Estimates in PBS Professional Using Soft Walltimes. “Job Scheduling Strategies for Parallel Processing. JSSPP 2022. Lecture Notes in Computer Science”, V. 13592 (2023), 192-210.D. Lyakhovets, A. Baranov. Efficiency Thresholds of Group Based Job Scheduling in HPC Systems. “Lobachevskii Journal of Mathematics”, V. 43 (2023), 2863-2876.D. Lyakhovets, A. Baranov. Efficiency Thresholds of Group Based Job Scheduling in HPC Systems. “Lobachevskii Journal of Mathematics”, V. 43 (2023), 2863-2876.M. Jaros, D. Klusáček, J. Jaros. Optimizing Biomedical Ultrasound Workflow Scheduling Using Cluster Simulations. “Job Scheduling Strategies for Parallel Processing. JSSPP 2020. Lecture Notes in Computer Science”, V. 12326 (2020), 68-84.M. Jaros, D. Klusáček, J. Jaros. Optimizing Biomedical Ultrasound Workflow Scheduling Using Cluster Simulations. “Job Scheduling Strategies for Parallel Processing. JSSPP 2020. Lecture Notes in Computer Science”, V. 12326 (2020), 68-84.A. Baranov, D. Lyakhovets. Accuracy Comparison of Various Supercomputer Job Management System Models. “Accuracy Comparison of Various Supercomputer Job Management System Models”, V. 42 (2021), 2510–2519.A. Baranov, D. Lyakhovets. Accuracy Comparison of Various Supercomputer Job Management System Models. “Accuracy Comparison of Various Supercomputer Job Management System Models”, V. 42 (2021), 2510–2519.G. I. Savin, B. M. Shabanov, P. N. Telegin, and A. V. Baranov, “Joint Supercomputer center of the Russian Academy of Sciences: Present and future,” Lobachevskii J. Math. 40 (2019). 1853–1862.G. I. Savin, B. M. Shabanov, P. N. Telegin, and A. V. Baranov, “Joint Supercomputer center of the Russian Academy of Sciences: Present and future,” Lobachevskii J. Math. 40 (2019). 1853–1862.А.В. Баранов, Д.С. Ляховец. Имитационная модель системы пакетирования суперкомпьютерных заданий на базе симулятора Alea. «Программные продукты и системы», №4 (2022), 631-643.А.В. Баранов, Д.С. Ляховец. Имитационная модель системы пакетирования суперкомпьютерных заданий на базе симулятора Alea. «Программные продукты и системы», №4 (2022), 631-643.W. Cirne and F. Berman, “A model for moldable supercomputer jobs,” in Proceedings of the 15th International Parallel and Distributed Processing Symposium IPDPS 2001 (2001), p. 8.W. Cirne and F. Berman, “A model for moldable supercomputer jobs,” in Proceedings of the 15th International Parallel and Distributed Processing Symposium IPDPS 2001 (2001), p. 8.D. Lyakhovets, A. Baranov, P. Telegin. Scale Ratio Tuning of Group Based Job Scheduling in HPC Systems. “Lobachevskii Journal of Mathematics”, V. 44 (2024), 5012-5026.D. Lyakhovets, A. Baranov, P. Telegin. Scale Ratio Tuning of Group Based Job Scheduling in HPC Systems. “Lobachevskii Journal of Mathematics”, V. 44 (2024), 5012-5026.

The authors declare that there are no conflicts of interest present.