OpenAI New Patents, Gavin Uberti and the Path to More Intelligence (Patreon)
Downloads
Content
Exploring new patents from OpenAI that seemingly no other outlet else spotted, plus an exclusive interview with Gavin Uberti, CEO of Etched AI, on how verification and this kind of mass sampling could push models to the state of the art in intelligence.
Gavin Uberti - Etched.AI (they are hiring)
OpenAI Patent 1: https://www.freepatentsonline.com/y2024/0020116.html
Patent 2: https://www.freepatentsonline.com/y2024/0020096.html
OpenAI Codex: https://openai.com/blog/openai-codex
AlphaCode 2: https://storage.googleapis.com/deepmind-media/AlphaCode2/AlphaCode2_Tech_Report.pdf
Meta 350k: https://uk.pcmag.com/ai/150532/zuckerbergs-meta-is-spending-billions-to-buy-350000-nvidia-h100-gpus
Gemini Claim: https://deepmind.google/technologies/gemini/#capabilities
MMMU: https://arxiv.org/pdf/2311.16502.pdf
Gemini Paper: https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf
Altman on Ilya: https://www.youtube.com/watch?v=QFXp_TU-bO8&t=1147s
Verify: https://arxiv.org/pdf/2305.20050.pdf
Alignment Impact: https://openai.com/research/improving-mathematical-reasoning-with-process-supervision
Speculative Decoding: https://miro.medium.com/v2/resize:fit:1400/format:webp/0*7RxMK7wm3rJxKePy.png
Phi 2: https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/