Udio, the Mysterious GPT Update, and Infinite Attention

It’s been a strange 48 hours in the world of AI, with the ‘ChatGPT moment for Music’ from Udio, that has reminded millions of what AI is capable of, and papers from Google that show that models can give infinite attention to text but we also got befuddling updates from OpenAI that suggest that not all is smooth sailing. We’ll begin with the quirky new tool on Udio.com and how musicians are reacting to it, then cover the strange manner of the release of GPT-4-Turbo with Vision and quickly touch on Mixtral 8 x 22b and Command R+ before turning to a fascinating new ‘Infinite Context’ paper from Google. One of the authors worked on Gemini, but that may or may not be relevant…

https://www.assemblyai.com/dashboard/signup
https://www.assemblyai.com/research/universal-1

AI Insiders: https://www.patreon.com/AIExplained

Udio Intro: https://www.udio.com/
https://twitter.com/udiomusic/status/1778045322654003448
‘The Site Is ****ing Down’ https://twitter.com/udiomusic/status/1778093021378089240
Musicians React: https://www.reddit.com/r/Music/comments/1c0mjkg/udio_ai_music_generation_is_scary/
Investors: https://www.udio.com/about-us
Will.i.am: https://twitter.com/iamwill?lang=en
https://suno.com/
Mixtral 8 x 22B and Command R+ Benchmarked: https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1/discussions/4?s=09
LIveCodeBench Leaderboard: https://livecodebench.github.io/leaderboard.html
Majorly Improved: https://twitter.com/OpenAI/status/1777772582680301665
MATH Benchmark: https://twitter.com/GanjinZero/status/1777926220132626753
Function-calling Usable with Vision: https://twitter.com/OpenAIDevs/status/1777769463258988634
GPT-4 Turbo Vision Benchmarked on GPQA: https://twitter.com/EpochAIResearch/status/1778463039932584205
Hassabis Chafes: https://www.theinformation.com/articles/googles-demis-hassabis-chafes-under-new-ai-push?rc=sy0ihq
Robot Football Simulation Paper: https://www.science.org/doi/10.1126/scirobotics.adi8022
Video: https://www.youtube.com/watch?v=dOBfnOMuTz4
Udio Origin Story: https://www.theinformation.com/articles/more-google-deepmind-staff-depart-to-launch-an-ai-startup?rc=sy0ihq
Leave No Context Behind: https://arxiv.org/pdf/2404.07143.pdf
Manaal Faruqui: https://scholar.google.co.uk/citations?view_op=view_citation&hl=en&user=W-CxZCgAAAAJ&sortby=pubdate&citation_for_view=W-CxZCgAAAAJ:PoWvk5oyLR8C
Gemini 1.5: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf
Llama 3 Coming: https://www.theinformation.com/articles/meta-platforms-to-launch-small-versions-of-llama-3-next-week?rc=sy0ihq


AI Insiders: https://www.patreon.com/AIExplained