Wizdeo Analytics

Deep-dive into the AI Hardware of ChatGPT

Ajouté le lun. 20 févr. 2023 Science et technologie Rectangular HD

With our special offer you can get 2 years of NordPass with 1 month free for a personal account: https://www.nordpass.com/highyieldnordpass
Or use code highyieldnordpass at checkout.

Business accounts (must register with a biz domain) can get a free 3-month trial of NordPass: https://www.nordpass.com/highyieldbusiness with code highyieldbusiness in the form.
....

What hardware was used to train ChatGPT and what does it take to keep it running? In this video we will take a look at the AI hardware behind ChatGPT and figure out how Microsoft & OpenAI use machine learning and Nvidia GPUs to create advanced neural networks.

Support me on Patreon: https://www.patreon.com/user?u=46978634
Follow me on Twitter: https://twitter.com/highyieldYT

Links
The Google research paper that changed everything: https://arxiv.org/abs/1706.03762
The OpenAI research paper confirming Nvidia V100 GPUs: https://arxiv.org/abs/2005.14165

0:00 Intro
0:28 AI Training & Inference
2:22 Microsoft & OpenAI Supercomputer
4:08 NordPass
5:57 Nvidia Volta & GPT-3
9:05 Nvidia Ampere & ChatGPT
13:23 GPT-3 & ChatGPT Training Hardware
14:41 Cost of running ChatGPT / Inference Hardware
16:06 Nvidia Hopper / Next-gen AI Hardware
17:58 How Hardware dictates the Future of AI