Token Lab搜索

← 全部实验
量化与离群值 / 5 OF 5

全零张量

The zero-range safeguard reconstructs all zeros exactly.

本地计算 / 模拟

本地教学实验,不调用外部 API。合成示例不能替代生产环境测量。

学习指南与本课目录LEARNING CONTRACT

理解 → 实现 → 研究

目标:解释本课机制、复现一个例子、测试一个失败案例。读完不自动代表掌握。

02 · 预测与配置

技术场景说明、参数名称与参考答案目前为英文。

03 · 检查证据

运行实验后查看结果。

方法与参考资料

Symmetric per-tensor scalar quantizer with range ±(2^(bits−1)−1). This is not LLM.int8(), GPTQ or AWQ. Ideal compression ignores scale metadata and runtime packing. Scalar error does not measure language-model accuracy.

Text / 原始公式
scale=max|x|/(2^(bits−1)−1); q=round(x/scale); x̂=q×scale

Low scalar MSE does not guarantee stable downstream model quality.

LLM.int8() · outliers and mixed precision ↗

练习题

quantization-5 / 01What does “All-zero tensor” test?

The zero-range safeguard reconstructs all zeros exactly.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 02Which computation produces the result in “All-zero tensor”?

; ; ×scale

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 03What is the baseline configuration for “All-zero tensor”?

{"values":"0,0,0,0","bits":4}

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 04What numerical result should you check for “All-zero tensor”?

{"MSE":0,"Max absolute error":0,"Ideal compression vs FP32":8,"Scale":1}

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 05How would you run a controlled comparison for “All-zero tensor”?

Keep the supplied fixture and other settings fixed; change bits. Compare reconstruction error, MSE, scale and ideal compression.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 06What failure could invalidate a conclusion from “All-zero tensor”?

Low scalar MSE does not guarantee stable downstream model quality.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 07Is “All-zero tensor” a benchmark of a deployed language model?

No. Symmetric per-tensor scalar quantizer with range ±(2^(bits−1)−1). This is not LLM.int8(), GPTQ or AWQ. Ideal compression ignores scale metadata and runtime packing. Scalar error does not measure language-model accuracy.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 08Which evidence should you report for “All-zero tensor”?

Compare reconstruction error, MSE, scale and ideal compression. Export inputs, engine, result and method; distinguish synthetic fixtures from observed production data.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 09How can another researcher reproduce “All-zero tensor”?

Open quantization-5, reset the preset, retain the exact inputs and run. The calculation is deterministic for identical inputs.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
quantization-5 / 10What is the next validation step after “All-zero tensor”?

Low scalar MSE does not guarantee stable downstream model quality. Test the hypothesis on a representative held-out workload and document a baseline, success metric and stopping rule before claiming deployment readiness.

Original teaching answer / local derivation. Method reference: LLM.int8() · outliers and mixed precision ↗

打开实验 →
MATHEMATICAL REVIEW · 2026-10-26

假设、参考实现与验收

这是对称逐张量舍入;理想压缩率不含元数据。全零张量安全尺度取 1。标量重建 MSE 不是 LLM 质量。

已复核引擎公式、场景预设及数值保护。固定种子的合成输入不是生产基准。

有限张量值 → 尺度 = 最大幅值 / qmax → 舍入并限制整数 → 反量化 → 重建误差
机制图:从上到下跟踪每次变换。

运行前:预测一个边界情况

The zero-range safeguard reconstructs all zeros exactly.

提示:隔离假设

固定基线输入,只改变一个参数或边界;同时比较数值与声明单位。单例通过仅验证该样例。

最小可运行算例

将算例及所链接模块保存在同一目录。使用 Node.js 22 或更高版本,然后运行 node quantization-5.mjs. 无需第三方运行依赖。

import {calculate,network} from './academy-core.mjs';
const params={
  "values": "0,0,0,0",
  "bits": 4
};
const result=calculate('quantization',params);
console.log(result.metrics);

测试与迁移

The zero-range safeguard reconstructs all zeros exactly.

在下方笔记记录输入、代码版本、期望值和实测值;再构造违反上述假设的反例,解释原结论为何不再成立。

下载完整代码包(.tar.gz) · 完整参考代码与回归检查

预测、检验与证据记录

展开答案前先预测一个结果;练习后记录差异和迁移测试。记录仅存本地,在不同语言版本间共用。

打开记录/导出/清除 →

数学复核范围逐篇记录,不代表完成论文实证复现;可在笔记中记录疑似错误。 复核范围