Asia & global innovation
Sign inJoin us
TechStar AsiaIdeas without bordersAsia & global innovation
← Latest news

From Dev.to

INT4 Absmax Quantization: One Outlier Zeroed 4,095 of 4,096 Values

I planted one number in a vector of 4,096 floats. I set it to 60, quantized the vector to INT4 with absmax scaling, and looked at what was left. All 4,095 of the other values were exactly zero. Not "a...

Read the full report at Dev.to ↗