Eugene Cheah of Recursal/Featherless and Dan Fu of Together bring a concise 30 mins updating all the work on RWKV and State Space Models this year, and riff on some hot takes on long context vs RAG
2024 in Post-Transformers Architectures…
Eugene Cheah of Recursal/Featherless and Dan Fu of Together bring a concise 30 mins updating all the work on RWKV and State Space Models this year, and riff on some hot takes on long context vs RAG