Broken Silicon 49: Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview (Patreon)
Downloads
Content
Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.
1) 1:08 AI Buzzwords & Introductions (some sound issues in the first 5 min)
2) 5:50 What is a Neural Network?
3) 12:40 Challenges in Training Neural Networks
4) 16:08 Sparsity and Pruning
5) 23:50 How will AI Improve our Lives?
6) 35:29 Bottlenecks to AI Research
7) 40:15 AI & ML in Gaming
8) 45:55 CUDA Intrenchment, AMD’s ability to enter the market
9) 49:10 Cerebras & Graphcore
10) 54:05 AMD vs Nvidia Graphics
11) 1:01:25 Comparing Synthetic AI to Biological Brains
https://www.thispersondoesnotexist.com/
https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
https://arxiv.org/pdf/1803.03635.pdf
https://arxiv.org/pdf/1807.01281.pdf
https://en.wikipedia.org/wiki/Reinforcement_learning
https://en.wikipedia.org/wiki/Concept_learning
https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
https://arxiv.org/abs/1912.02875
https://arxiv.org/pdf/1912.02877.pdf
https://www.alexirpan.com/2018/02/14/rl-hard.html
https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/