Home Artists Posts Import Register

Content

Tomorrow I should be chatting with an AI Developer still at University for the next Broken Silicon Episode.

We will discuss loosely what he does (Reinforcement Learning, Upside Down RL, and more) so that hopefully people get a real idea of what these researchers are actually doing with Volta, Vega, Ampere, and soon RDNA 2.  Eventually we will touch on gaming AI & ML as well.

Put your questions/comments/concerns BELOW!  Be thoughtful, be concise, use good grammar, and we may just get to your posts.

Comments

Anonymous

Thoughts on Nvidia’s new TF32 vs BF16?

Anonymous

What do you think is the future for AI training/ inference- ASIC or GPGPUs?

Anonymous

Where does one even start wrangling Robobo's artificial brain into thinking the thoughts you want it to think these days? Lots of stuff about The Deeds, not much on Where Do I Sign Up ;)

Anonymous

Where is the bottleneck in AI training? Is it the actual compute power or is it something else entirely that we (the general public) do not really understand?

Anonymous

How do you feel about 'AI' being an overused buzzword in some situations?

Edward Huff

What is your opinion on the synapse vs parameter question? Artificial spiking neural networks perform really poorly compared standard stuff, which may imply 1 paramater > 1 synapse. Though software is an enormous aspect of the problem, in terms of minimal viable compute for human-level agents once we have enough memory/bandwidth to handle models with as many paramaters as human's have synapses, around 100 trillion, will this be insufficient, good enough, more than enough hardware?

hhectorlector

What’s the most complex AI someone with a 3950x and 2080ti (or Radeon VII) could run?

The Immortal Cameraman

How many people approach you with Terminator/iRobot doomsday scenarios when discussing AI? How often are you approached with such scenarios?

Cleansweep

How big a disparity is there between the common person/the media's perception of AI for commercial use and the reality of current development? For example, there've been articles about how AI for information processing/generation tasks like news reporting could be created within 5-10 years, but can that kind of AI be realized in that time frame?

Anonymous

What will it take for Machine Learning to shift away from a reliance on CUDA? Is there any worthwhile pipeline for non-CUDA ML dev?

Dominik Koc

Where does the fundamental problem lay, in allowing AI to be trained/train itself, in a manner simialir to the human mind? What is that quantum leap and how are researchers and developers being taught to approach this conundrum?

Jake_ Dude_23

If you were to compare the most powerful supercomputer to an animal’s brain, what kind of animal would it be comparable to? For example, are we closer in processing power to an insect’s brain or, say, a squirrel’s brain?

Benni_Berlin

Since the "Johannes Gutenberg" (Introducer of the printing press in europe ;-) ) university in Mainz is using the MOGON II supercomputer to find a cure for Covid-19 and it took them 2 months (more than 30 billion individual calculations) to narrow it down to 300 candidates (and afterwards some more time to narrow it down even further to 10 candidates) - what impact does Nividias GA-100 announcement have for guys like you working in this field? FYI: MOGON II uses Xeon e5-2630v4 and Xeon gold-6130 cpu's as far as I know.

Anonymous

Listening to mainstream media, one might get the idea AI is the solution to everything, from self-driving cars to AI-accelerated assistants like Siri. To which extent do you think AI will really revolutionize our daily lives during the next decade? Are there unexpected areas in which you see it as a gamechanger?

Anonymous

I often hear the perception that AI's in video games have been stagnant and have not improved since the first F.E.A.R with the exception of Alien Isolation. Why do you think that is? Is it because game developers are emphasizing too much on graphics or is there something more? And what could developers do to change this perception and develop better AI for all games?

Edward Huff

Great episode. Will note, people like me who think AI is a likely risk do not think they will spontaneously become evil, nor do we think they will be programmed to be evil. We think the space of possible goals is very large, that specifying human values is an unsolved problem, and lacking a solution to the value specification problem we will be left with an ecosystem of agents with a wide variety of utility functions. If you know anything about natural selection, you know this is unlikely to be a safe equilibrium. Stuart Russel, who literally wrote the book on AI, has a great book called Human Compatible which makes the case for taking AI risk seriously. If you do not feel like buying the book, Scott Alexander has a great review of it here: https://slatestarcodex.com/2020/01/30/book-review-human-compatible/