Building Blocks by Metamatics

Building Blocks by Metamatics

Share this post

Building Blocks by Metamatics
Building Blocks by Metamatics
LLM State-of-the-Art before Deepseek: Detailed List of Architecture Innovations
Copy link
Facebook
Email
Notes
More

LLM State-of-the-Art before Deepseek…

Feb 1

Share this post

Building Blocks by Metamatics
Building Blocks by Metamatics
LLM State-of-the-Art before Deepseek: Detailed List of Architecture Innovations
Copy link
Facebook
Email
Notes
More

Before DeepSeek, LLMs evolved through key innovations like Transformers, RLHF, RAG, MoE, and FlashAttention, enabling scalable, efficient, and context-aware AI systems.

Read →
Comments
User's avatar
© 2025 Metamatics
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More