RL Glossary
Contact
Home
  • What is this?
  • Training +
  • Data +
  • Rewards +
  • Optimization +
  • Agents +
  • Inference +
  • Evaluation +
  • RLOps +
  • GPU cost calculator
  • FAQ
Home
  • What is this?
  • Training +
  • Data +
  • Rewards +
  • Optimization +
  • Agents +
  • Inference +
  • Evaluation +
  • RLOps +
  • GPU cost calculator
  • FAQ
← Home

Pretraining

The LLM training phase that produces the foundation model. Raw text, no human labels, next-word prediction at massive scale. Most of what an LLM knows comes from this phase.

Talk to an RL expert