Why "Grokking" AI Would Be A Key To AGI

Check out HubSpot's Free ChatGPT resource to power up your work efficiency????: https://clickhubspot.com/hyx

Check out my newsletter:
https://mail.bycloud.ai

Are We Done With MMLU?
[Paper] https://arxiv.org/abs/2406.04127

Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
[Paper] https://arxiv.org/abs/2406.02061

Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
[Paper] https://arxiv.org/abs/2405.15071

Grokfast: Accelerated Grokking by Amplifying Slow Gradients
[Paper] https://arxiv.org/abs/2405.20233
[Code] https://github.com/ironjr/grokfast

This video is supported by the kind Patrons & YouTube Members:
????Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth

[Discord] https://discord.gg/NhJZGtH
[Twitter] https://twitter.com/bycloudai
[Patreon] https://www.patreon.com/bycloud

[Music] massobeats - noon
[Profile & Banner Art] https://twitter.com/pygm7
[Video Editor] Silas