From Dev.to
INT4 Absmax Quantization: One Outlier Zeroed 4,095 of 4,096 Values
I planted one number in a vector of 4,096 floats. I set it to 60, quantized the vector to INT4 with absmax scaling, and looked at what was left. All 4,095 of the other values were exactly zero. Not "a...
