{"id":3350,"date":"2023-09-27T14:06:00","date_gmt":"2023-09-27T12:06:00","guid":{"rendered":"https:\/\/www.lirmm.fr\/adac\/?p=3350"},"modified":"2023-11-28T17:10:24","modified_gmt":"2023-11-28T16:10:24","slug":"adac-scientific-seminar-analyzing-gpu-utilization-in-ml-training","status":"publish","type":"post","link":"https:\/\/www.lirmm.fr\/adac\/2023\/09\/27\/adac-scientific-seminar-analyzing-gpu-utilization-in-ml-training\/","title":{"rendered":"ADAC Scientific Seminar: Analyzing GPU Utilization in ML Training"},"content":{"rendered":"\n<figure class=\"wp-block-image aligncenter size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"640\" height=\"288\" src=\"https:\/\/www.lirmm.fr\/adac\/wp-content\/uploads\/sites\/37\/2023\/11\/Paul-Delestrac-1.png\" alt=\"\" class=\"wp-image-3351\" srcset=\"https:\/\/www.lirmm.fr\/adac\/wp-content\/uploads\/sites\/37\/2023\/11\/Paul-Delestrac-1.png 640w, https:\/\/www.lirmm.fr\/adac\/wp-content\/uploads\/sites\/37\/2023\/11\/Paul-Delestrac-1-300x135.png 300w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Presenter:<\/strong> Paul DELESTRAC<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Abstract:<\/strong><br>Recent advances in Machine Learning have brought human-level intelligence to many popular domains such as computer vision or natural language processing. These improvements came with a huge increase in the amount of compute required by these models. Training is becoming more and more a bottleneck for these multi-billion parameters models and GPUs are still the prevailing architecture for such a task. However, the complex execution flow of ML training on GPUs is often misunderstood and this can stand in the way of exploration for more compute-efficient solutions. In this talk, our main goal is to provide a better understanding of the execution of ML training on GPUs. We describe and analyze the execution flow from top down, starting with the ML framework, going to the execution of operations on the GPU cores. We share our experience of using GPUs for ML training. Finally, we provide some performance evaluation and results from our last findings.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Date:<\/strong>\u00a0September 27, 2023 from 2 to 4 pm (salle de s\u00e9miniaires, LIRMM*) <\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>Presenter: Paul DELESTRAC Abstract:Recent advances in Machine Learning have brought human-level intelligence to many popular domains such as computer vision or natural language processing. These improvements came with a huge increase in the amount of compute required by these models. Training is becoming more and more a bottleneck for these multi-billion parameters models and GPUs [&hellip;]<\/p>\n","protected":false},"author":45,"featured_media":3349,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","_crdt_document":"","footnotes":""},"categories":[33],"tags":[],"class_list":["post-3350","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/posts\/3350","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/users\/45"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/comments?post=3350"}],"version-history":[{"count":1,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/posts\/3350\/revisions"}],"predecessor-version":[{"id":3352,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/posts\/3350\/revisions\/3352"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/media\/3349"}],"wp:attachment":[{"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/media?parent=3350"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/categories?post=3350"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lirmm.fr\/adac\/wp-json\/wp\/v2\/tags?post=3350"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}