AI Compass
Compass
LEARNING PATHS

IN DEPTH

Understanding language models

How a matrix multiplication becomes a language model, computed layer by layer.

about 5 hours

12 articles

  1. 01Neural networks2 min
  2. 02Tokenisation2 min
  3. 03Embeddings2 min
  4. 04Attention2 min
  5. 05The transformer architecture2 min
  6. 06How a language model is trained2 min
  7. 07RLHF and alignment2 min
  8. 08Sampling and temperature2 min
  9. 09Context windows in depth2 min
  10. 10Why models hallucinate2 min
  11. 11Reasoning models · optional2 min
  12. 12Mixture of experts · optional2 min
AI OPERATING PLATFORM

You don't have to know all of this yourself.

This wiki explains what needs doing. The LumeSec platform does it: it brings together what your AI systems are doing, holds them inside the agreed limits, and records the evidence as it goes.

See the platform
  • CorrelateOne picture of what your systems are actually doing.
  • ContainThe agreed limits hold at runtime, not just on paper.
  • AttestEvidence accrues in operation, not the week before an audit.
Understanding language models