Definitions of Quantization

A process that reduces the precision of a neural network's weights and activations from floating-point numbers to lower-bit integers, decreasing model size and computational cost with minimal accuracy loss.