OpenAI New Patents, Gavin Uberti and the Path to More Intelligence (Patreon)

Exploring new patents from OpenAI that seemingly no other outlet else spotted, plus an exclusive interview with Gavin Uberti, CEO of Etched AI, on how verification and this kind of mass sampling could push models to the state of the art in intelligence.

Gavin Uberti - Etched.AI (they are hiring)

OpenAI Patent 1: https://www.freepatentsonline.com/y2024/0020116.html

Patent 2: https://www.freepatentsonline.com/y2024/0020096.html

OpenAI Codex: https://openai.com/blog/openai-codex

AlphaCode 2: https://storage.googleapis.com/deepmind-media/AlphaCode2/AlphaCode2_Tech_Report.pdf

Meta 350k: https://uk.pcmag.com/ai/150532/zuckerbergs-meta-is-spending-billions-to-buy-350000-nvidia-h100-gpus

Gemini Claim: https://deepmind.google/technologies/gemini/#capabilities

MMMU: https://arxiv.org/pdf/2311.16502.pdf

Gemini Paper: https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf

Altman on Ilya: https://www.youtube.com/watch?v=QFXp_TU-bO8&t=1147s

Verify: https://arxiv.org/pdf/2305.20050.pdf

Alignment Impact: https://openai.com/research/improving-mathematical-reasoning-with-process-supervision

Speculative Decoding: https://miro.medium.com/v2/resize:fit:1400/format:webp/0*7RxMK7wm3rJxKePy.png

Phi 2: https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/