Chain of thought prompting

Copy link

Chain of thought prompting is a prompting method which involves asking language models to "think step-by-step" in order to encourage longer outputs with more steps that resemble reasoning about the problem. This method has been shown to improve the output of models for complex reasoning tasks [1].

Image credits: J. Wei et al, https://arxiv.org/pdf/2201.11903.pdf

No items found.

Learn More

Join Beta

Previous Term

No Next Term!

Check out our other Terms

Next Term

No Previous Term!

Check out our other Terms

No Next Term!

No Previous Term!

Paged Attention

Tensor Parallelelism

Context Length

Rate Limits

HIPPA

Docker

Llava

Containerized

Public Cloud

Virtual Private Cloud (VPC)

Self-hosted models

Compression

Bandwidth

Autoscaling

API-based large language models

API

CI/CD Pipelines

Kubernetes

Node

Inference

Inference Server

Mixture of Expert Models (MoE)

Continuous batching

Multi-GPU inference

Zero shot learning

Unsupervised learning

Weight

Turing Test

Transformer

Training set

Transfer learning

Training data

TPU

Top P

Top K

Tokenization

Token

Throughput

Titan Takeoff Inference Server

Synthetic data

Supervised learning

Serving

Speculative decoding

Sentiment analysis

Sampling temperature

Rust

Recurrent neural network (RNN)

Repetition penalty

RAG (Retrieval Augmented Generation)

Quantization aware training

Quantization

Pruning

Prompt engineering

Pretrained model

On-prem

Perplexity

Natural language processing (NLP)

Ngram

Natural language understanding (NLU)

Neural networks

Model serving

Model parallelism

Human in the loop

Model monitoring

Model

Model compilation

Mistral

Machine learning (ML)

LLaMA

Latency

Large language model

Language model

Kernel

Inference optimization

Instruction tuning

Machine learning inference

Hallucination

GPT