tinygrad/docs/env_vars.md

List of environment variables that control tinygrad behavior.

This is a list of environment variable that control the runtime behavior of tinygrad and its examples. Most of these are self-explanatory, and are usually used to set an option at runtime.

Example: GPU=1 DEBUG=4 python3 -m pytest

However you can also decorate a function to set a value only inside that function.

# in tensor.py (probably only useful if you are a tinygrad developer)
@Context(DEBUG=4)
def numpy(self) -> ...

Or use contextmanager to temporarily set a value inside some scope:

with Context(DEBUG=0):
  a = Tensor.ones(10, 10)
  a *= 2

Global Variables

The columns of this list are are: Variable, Possible Value(s) and Description.

• A # means that the variable can take any integer value.

These control the behavior of core tinygrad even when used as a library.

Variable	Possible Value(s)	Description
DEBUG	[1-6]	enable debugging output, with 4 you get operations, timings, speed, generated code and more
GPU	[1]	enable the GPU backend
CUDA	[1]	enable CUDA backend
AMD	[1]	enable AMD backend
NV	[1]	enable NV backend
METAL	[1]	enable Metal backend (for Mac M1 and after)
METAL_XCODE	[1]	enable Metal using macOS Xcode SDK
CLANG	[1]	enable Clang backend
LLVM	[1]	enable LLVM backend
BEAM	[#]	number of beams in kernel beam search
GRAPH	[1]	create a graph of all operations (requires graphviz)
GRAPHUOPS	[1]	create a graph of uops (requires graphviz and saves at /tmp/uops.{svg,dot})
GRAPHPATH	[/path/to]	where to put the generated graph
DEFAULT_FLOAT	[HALF, ...]	specify the default float dtype (FLOAT32, HALF, BFLOAT16, FLOAT64, ...), default to FLOAT32
IMAGE	[1-2]	enable 2d specific optimizations
FLOAT16	[1]	use float16 for images instead of float32
PTX	[1]	enable the specialized PTX assembler for Nvidia GPUs. If not set, defaults to generic CUDA codegen backend.
PROFILE	[1]	enable output of perfetto compatible profile. This feature is supported in NV and AMD backends.
VISIBLE_DEVICES	[list[int]]	restricts the NV/AMD devices that are available. The format is a comma-separated list of identifiers (indexing starts with 0).
JIT	[0-2]	0=disabled, 1=jit enabled (default), 2=jit enabled, but graphs are disabled