LLMs1 min read
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
By OpenSmartRoute editorial · attributed excerpt
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
Read the original at Ahead of AI (Sebastian Raschka): Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention
Source: https://magazine.sebastianraschka.com/p/recent-developments-in-llm-architectures
Keep reading
LLMs1 min read
arXiv:2609.16340v1 Announce Type: new Abstract: Machine translation systems are periodically upgraded to stronger models, but the available preference signal is human post-edits of an older system's outputs, which the newer model may alr...
LLMs1 min read
arXiv:2609.15996v1 Announce Type: new Abstract: Chen, Zhao, and Cohan introduce a valuable distributional evaluation of LLM-generated research ideas. This comment raises a narrower identification concern: their human baseline consists of...
LLMs1 min read
Tool: Gemini Live audio Google released Gemini 3.8 Live and 3.8 Live Extended Thinking today - two new speech-to-speech models that are a similar shape to OpenAI's GPT-Live family. I pointed GPT-6 Astra Extra High at the documentation an...
