Compute & chips
Related terms
Related terms
- Inference
- Inference is running an already-trained AI model to produce an answer, such as a chatbot reply. It is separate from training, which builds the model, and it runs for every user request.
- GPU
- A GPU (graphics processing unit) is a chip first built to speed up graphics. Its strength at parallel math also makes it the main chip for training and running AI models, which is why AI clusters are counted in GPUs.
- Parameters
- The adjustable numbers inside a model that training sets; a rough measure of the model's size.