Term · Checked October 29, 2026

Inference

Inference is running an already-trained AI model to produce an answer, such as a chatbot reply. It is separate from training, which builds the model, and it runs for every user request.

Source: Wikipedia

AI basics

Related terms

Training compute (FLOP): Training compute is the total count of floating-point operations (FLOP) used to train an AI model. It is a count of work done, unlike FLOPS, which measures operations per second.
Token: A chunk of text, often part of a word, that models read and write. API prices are quoted per million tokens.
Large language model (LLM): An AI model trained on huge amounts of text to predict the next word, which lets it answer questions, write and code. Grok is a family of LLMs.

All explained