Broken Silicon 49: Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview (Patreon)

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

1) 1:08 AI Buzzwords & Introductions (some sound issues in the first 5 min)

2) 5:50 What is a Neural Network?

3) 12:40 Challenges in Training Neural Networks

4) 16:08 Sparsity and Pruning 

5) 23:50 How will AI Improve our Lives?

6) 35:29 Bottlenecks to AI Research

7) 40:15 AI & ML in Gaming

8) 45:55 CUDA Intrenchment, AMD’s ability to enter the market

9) 49:10 Cerebras & Graphcore

10) 54:05 AMD vs Nvidia Graphics

11) 1:01:25 Comparing Synthetic AI to Biological Brains

https://www.thispersondoesnotexist.com/

https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/

https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/

https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE

https://arxiv.org/pdf/1803.03635.pdf

https://arxiv.org/pdf/1807.01281.pdf

https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6

https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI

https://en.wikipedia.org/wiki/Reinforcement_learning

https://en.wikipedia.org/wiki/Concept_learning

https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2

https://arxiv.org/abs/1912.02875

https://arxiv.org/pdf/1912.02877.pdf

https://www.alexirpan.com/2018/02/14/rl-hard.html

https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/

https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/

https://openai.com/blog/jukebox/

https://www.pnas.org/content/pnas/116/43/21854.full.pdf