AI Blog · AI 博客 · MAE
AI Blog
Essays · Writers Ahead of AI · Sebastian Raschka Understanding Positional Embeddings in Modern LLMs The Methods Behind How LLMs Represent Token Positions Ahead of AI · Sebastian Raschka Building Reasoning Models from the Ground Up: A Full Video Course Over 11 hours of coding videos on evaluation, inference-time scaling, reinforcement learning, and di… Ahead of AI · Sebastian Raschka Language Models for Text Classification: From Bag-of-Words to Jev A Visual Guide to RNNs, CNNs, Transformers, and Calibration, with Hands-On Experiments on Accuracy a… Ahead of AI · Sebastian Raschka GPT-6 Astra, Looped Transformers, and Hidden Reasoning A Look at Recurrent Depth, Hidden Chains of Thought, and Recent Research on Looping Transformer Bloc… Ahead of AI · Sebastian Raschka How Claude Watermarks AI-Generated Text A 48-minute video walkthrough of token sampling, watermark detection, and removal Ahead of AI · Sebastian Raschka Building an AI Text Detector From Scratch An End-to-End Project With Dataset Construction, Model Training, Local Deployment, and RLVR Ahead of AI · Sebastian Raschka Controlling Reasoning Effort in LLMs How LLMs Learn Low-, Medium-, and High-Effort Reasoning Modes Ahead of AI · Sebastian Raschka Using Local Coding Agents Using Open-Weight Models in Local Coding Harnesses as an Alternative to Claude Code and Codex Subscr… Ahead of AI · Sebastian Raschka LLM Research Papers: The 2026 List (January to May) A curated roundup of notable LLM research papers that came out this year Ahead of AI · Sebastian Raschka Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs Ahead of AI · Sebastian Raschka My Workflow for Understanding LLM Architectures A learning-oriented workflow for understanding new open-weight model releases Ahead of AI · Sebastian Raschka Components of A Coding Agent How coding agents use tools, memory, and repo context to make LLMs work better in practice Ahead of AI · Sebastian Raschka A Visual Guide to Attention Variants in Modern LLMs From MHA and GQA to MLA, sparse attention, and hybrid architectures Ahead of AI · Sebastian Raschka A Dream of Spring for Open-Weight LLMs: 10 Architectures from Jan-Feb 2026 A Round Up And Comparison of 10 Open-Weight LLM Releases in Spring 2026 Ahead of AI · Sebastian Raschka Categories of Inference-Time Scaling for Improved LLM Reasoning And an Overview of Recent Inference-Scaling Papers Ahead of AI · Sebastian Raschka The State Of LLMs 2025: Progress, Problems, and Predictions A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchma… Ahead of AI · Sebastian Raschka LLM Research Papers: The 2025 List (July to December) In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid su… Ahead of AI · Sebastian Raschka From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates Understanding How DeepSeek's Flagship Open-Weight Models Evolved Ahead of AI · Sebastian Raschka Beyond Standard LLMs Linear Attention Hybrids, Text Diffusion, Code World Models, and Small Recursive Transformers Ahead of AI · Sebastian Raschka Understanding the 4 Main Approaches to LLM Evaluation (From Scratch) Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples Ahead of AI · Sebastian Raschka Understanding and Implementing Qwen3 From Scratch A Detailed Look at One of the Leading Open-Source LLMs