Thanks for the fantastic explanation! Would it be more efficient to calculate so...

		brookst 9 months ago \| parent \| context \| favorite \| on: Lossless LLM compression for efficient GPU inferen... Thanks for the fantastic explanation! Would it be more efficient to calculate some kind of per-model or per-layer mean, and then only specify standard deviations, maybe by fp8 or smaller?