Skip to content

Coverage & Gaps

What this collection covers, where it is thin, and what is queued next - papers and explainers.

This page exists so the collection's boundaries are explicit. A curated list is only trustworthy if it says what it left out. Entries here are candidates, not promises - see CONTRIBUTING.md if you want to write one.

Last reviewed: 2026-10-16 ยท Papers at review time: 156

On 2026-09-30 the collection broadened from research papers to "everything AI": landmark essays joined as a paper category, robotics got its own category, and unnumbered explainers now cover what no single paper does - model families, benchmarks, compute and economics, policy, the ecosystem and the open questions.


Coverage map

Area Papers State
Transformer architecture & attention variants 01, 11, 16, 54, 66, 73, 75, 141 Strong
Sequence-model alternatives (SSM, MoE, sparse) 20, 37, 55, 67, 131, 156 Good
Language model lineage (GPT, LLaMA, Claude, Gemini, DeepSeek, Qwen, Mistral, Phi) 03, 04, 15, 17, 26-28, 30-31, 33, 36, 40-43, 47, 64-65, 93-95, 135, 148 Strong - plus a lineage explainer per family
Alignment (RLHF, CAI, DPO, KTO, GRPO, RLVR) 05, 14, 19, 38, 39, 63, 103, 146, 147, 155 Strong
Instruction tuning & synthetic data 79, 80, 140 Good
Reasoning (CoT, ToT, PRM, STaR, test-time compute) 09, 25, 34, 35, 50, 51, 77, 97-99, 152, 154 Strong
Agents & tool use 21, 24, 58, 59, 78, 100, 115 Strong
Diffusion & image generation 02, 06, 07, 44, 48, 57, 69-72, 74, 89-92, 119, 120 Strong
3D generation 117, 118 Good
Self-supervised vision pretraining 11, 88 Good
Multimodal (vision-language, speech, video) 08, 23, 29, 32, 40, 46, 47, 49 Good
Audio generation 121, 122 Good
Robotics & embodied AI 123-125 Good
Retrieval 13, 60, 87 Good
Long context 130, 132 Good
Inference & serving efficiency 16, 45, 52, 86 Strong
Training systems, numerics & optimizers 76, 94, 142-144 Good
Data curation & tokenization 133, 136 Good
Efficiency of fine-tuning & distillation 10, 22, 134 Good
Scaling behaviour 12, 18, 81 Good
Interpretability 82, 126, 151 Good
Safety & adversarial robustness 83, 96, 127-129, 149, 153 Good
Evaluation & benchmarks 84, 85, 137-139, 145 Good - plus five benchmark explainers
Code generation & software engineering 56 Thin
Reinforcement learning & world models 102, 104, 105 Adequate for scope
Science applications (biology, mathematics, algorithms) 61, 62, 68, 101, 106, 107 Good
Deep learning prerequisites (pre-2015) 53, 55, 57, 66, 73, 74 Deliberately partial
Essays & landmark posts 108-116, 150 Good

Explainers are not numbered and so are not in this map; EXPLAINERS.md lists them all with their review dates.


Queued: recent work (added 2026-10-16)

2025 is the thinnest year in the collection (even after the 2026-10-16 additions) and 2026 has one paper. Candidates, none yet summarised (check the dates against the source before writing):

  • Kimi k1.5 / K2 - the Moonshot line (Muon is already 144).
  • LLaDA - diffusion language models, a line the collection does not cover at all.
  • More 2026 papers - Mamba-3 is the only one so far; Raschka's 2026 list (architecture section: Nemotron 3 Super, Gated DeltaNet-2, Attention Residuals) is a starting point, rest of it is paywalled.

Queued: classics and cross-cutting

  • Greshake et al. 2023 (indirect prompt injection) - the paper the queued jailbreak explainer needs.
  • LLM watermarking (Kirchenbauer et al., 2023) and Concrete Problems in AI Safety (2016).
  • Model merging (task arithmetic, TIES), Lost in the Middle, MemGPT, WebArena, DINOv2.
  • AI 2027 (essay, forecast) and GPTs are GPTs (Eloundou et al., 2023) - the anchor for an AI-and-jobs explainer.

Queued: high priority

Papers whose absence is most likely to leave a reader with a hole in their mental model.

Code and software engineering

  • SWE-agent (Yang et al., 2024) - the agent-computer interface paper, the other half of SWE-bench.
  • AlphaCode (Li et al., 2022) - competition-level code generation by sampling and filtering at scale.

Interpretability & safety

  • Toy Models of Superposition (Elhage et al., 2022) - why features share neurons; the setup that Sparse Autoencoders answer.
  • Alignment Faking in Large Language Models (Greenblatt et al., 2024) - pairs with Sleeper Agents.
  • Constitutional Classifiers (Anthropic, 2025) - the production defence against universal jailbreaks.

Long context & efficiency

  • Ring Attention / context parallelism - the systems answer to million-token contexts.
  • Medusa / EAGLE - the successors to Speculative Decoding.

Evaluation

  • HELM (Liang et al., 2022) and BIG-Bench (Srivastava et al., 2022) - holistic evaluation and the crowd-sourced benchmark suite.
  • GPQA and Humanity's Last Exam - covered in the knowledge benchmarks explainer, not yet summarised on their own.

Queued: medium priority

Generative modelling beyond images

  • MusicLM / Stable Audio - music generation, next to AudioLM.
  • Veo, Movie Gen and open video models - video generation after Sora.

Techniques

  • Self-RAG, HyDE, and query rewriting - the retrieval techniques practitioners reach for after Dense Retrieval.
  • Mixture-of-Depths and early-exit - conditional compute in the depth dimension.
  • DPO variants (IPO, SimPO, ORPO) - the preference-optimisation family after DPO.

Robotics

  • Diffusion Policy (Chi et al., 2023) and Gemini Robotics (2025) - the other major lines beside RT-2 and pi0.

Deep learning prerequisites

The collection covers roots selectively (Word2Vec, Seq2Seq, VAE, PPO, ResNet, U-Net, Adam). Candidates for completing that layer: AlexNet (2012), Batch/Layer Normalization, Dropout, LSTM (1997), and DQN / AlphaGo - the run-up to AlphaZero. Each is foundational; each is one step further from generative AI, so they stay optional rather than assumed.


Queued: explainers

  • Model families: xAI Grok, Microsoft Phi (beyond phi-1), Moonshot Kimi.
  • Concepts: mixture-of-experts routing in practice, multimodal tokenization (how images and audio become tokens), embeddings beyond retrieval.
  • Applications: AI for code (the coding-assistant landscape), AI in science, AI search.
  • Safety: jailbreaks and prompt injection as a threat class (linking AI threat modelling).
  • Concepts: hallucination (pairs with 149) and multilingual / non-English models.
  • Society: AI and jobs, copyright and training data litigation, energy use.

Deliberately out of scope

  • Model cards and system cards that contain no methodological contribution - their facts go into the model-family explainers instead.
  • Incremental version bumps where the previous entry already covers the technique.
  • Papers with no public write-up - if there is nothing citable to link, there is nothing to summarize.
  • Hands-on build guides and certification prep - those are the site's Build pillar and certification guides, not paper summaries.
  • Anything the summary would have to invent details about. Every entry here is written from the published record; where a number is uncertain the summary says so rather than guessing.

How to close a gap

  1. Pick an entry above (or propose one).
  2. For a paper, follow "Adding a new paper summary" in CONTRIBUTING.md; for an explainer, follow "Adding an explainer" there.
  3. Update the coverage table (papers only) and remove the entry from the queue above.