Please register with your official e-mail address to prove your affiliation via HLRS.
Learn how to accelerate your applications with OpenACC, how to train and deploy a neural network to solve real-world problems, and how to effectively parallelize training of deep neural networks on Multi-GPUs.
The workshop combines an introduction to Deep Learning and Deep Learning for Multi-GPUs with a lecture on Accelerated Computing with OpenACC.
The lectures are interleaved with many hands-on sessions using Jupyter Notebooks. The exercises will be done a the AI partition of HLRS's cluster Hawk.
This course is organized in cooperation with HLRS (Germany). All instructors are NVIDIA certified University Ambassadors.
1st day: Lecture on Accelerated Computing with OpenACC
Upon completion, you'll be ready to use OpenACC to GPU accelerate CPU-only applications.
2nd day: Introduction to Deep Learning
Upon completion, you’ll be able to start solving problems on your own with deep learning.
3rd day: Introduction to Deep Learning for Multi-GPUs
Upon completion, you'll be able to effectively parallelize training of deep neural networks using TensorFlow.
1st day: Lecture on Accelerated Computing with OpenACC (9:00 - 17:00)
On the first day you learn the basics of OpenACC, a high-level programming language for programming on GPUs. Discover how to accelerate the performance of your applications beyond the limits of CPU-only programming with simple pragmas.
2nd day: Introduction to Deep Learning (9:00 - 17:00)
Explore the fundamentals of deep learning by training neural networks and using results to improve performance and capabilities.
During this day, you’ll learn the basics of deep learning by training and deploying neural networks.
3rd day: Introduction to Deep Learning for Multi-GPUs (9:00 - 17:00)
The computational requirements of deep neural networks used to enable AI applications like self-driving cars are enormous. A single training cycle can take weeks on a single GPU or even years for larger datasets like those used in self-driving car research. Using multiple GPUs for deep learning can significantly shorten the time required to train lots of data, making solving complex problems with deep learning feasible.
On the third day we will teach you how to use multiple GPUs to train neural networks.
For day one, you need basic experience with C/C++ or Fortran. Suggested resources to satisfy prerequisites: the learn-c.org interactive tutorial, https://www.learn-c.org/.
On day two, you need an understanding of fundamental programming concepts in Python 3, such as functions, loops, dictionaries, and arrays; familiarity with Pandas data structures; and an understanding of how to compute a regression line.
Suggested resources to satisfy prerequisites: Python Beginner’s Guide.
Experience with Deep Learning using Python 3 and, in particular, gradient descent model training will be needed on day three.
Familiarity with TensorFlow and Keras will be a plus as it will be used in the hands-on sessions. For those who did not use these before, you can find tutorials here: github.com/tensorflow/docs/tree/master/site/en/r1/tutorials/keras.
The exercises will be carried out on HLRS's cluster Hawk.
English
Dr. Momme Allalen, PD Dr. Juan Durillo Barrionuevo, Dr. Volker Weinberg (LRZ and NVIDIA University Ambassadors).
The course is open for people from academia and industry.
The following categories can be selected during registration:
Course | Deep Learning and GPU programming using OpenACC @ HLRS (register via HLRS) |
Number | hdlw1s23 |
Available places | 32 |
Date | 11.07.2023 – 13.07.2023 |
Price | EUR 30.00 – 600.00 |
Location | Universität Stuttgart - Höchstleistungsrechenzentrum Stuttgart Nobelstraße 19 70569 Stuttgart |
Room | 0.439 / Rühle Saal |
Registration deadline | 12.06.2023 23:55 |
education@lrz.de |
No. | Date | Time | Leader | Location | Room | Description |
---|---|---|---|---|---|---|
1 | 11.07.2023 | 09:00 – 17:00 | Volker Weinberg Momme Allalen |
Universität Stuttgart - Höchstleistungsrechenzentrum Stuttgart | 0.439 / Rühle Saal | Lecture |
2 | 12.07.2023 | 09:00 – 17:00 | Juan Durillo Barrionuevo | Universität Stuttgart - Höchstleistungsrechenzentrum Stuttgart | 0.439 / Rühle Saal | Lecture |
3 | 13.07.2023 | 09:00 – 17:00 | Juan Durillo Barrionuevo | Universität Stuttgart - Höchstleistungsrechenzentrum Stuttgart | 0.439 / Rühle Saal | Lecture |