投機的デコーディング実験
採択率と遅延を明示し、ドラフトモデルが速くなる条件を検討します。
Study guide & lesson outline
LEARNING CONTRACTUnderstand → implement → investigate
Goal: explain the mechanism in this lesson, reproduce one example and test a failure case. Reading alone does not mark mastery.
- Understand: state assumptions, shapes/units and a counterexample.
- Implement: reproduce a numerical example and inspect boundaries.
- Investigate: compare one alternative under a matched budget.
01設定
02入力を追加
設定して例を読み込むか、データを貼り付けてください。
03結果を確認
設定して例を読み込むか、データを貼り付けてください。
表示を省略する場合がありますが、JSONレポートは全計算結果を含みます。
結果の読み方
標準的な提案・検証サイクルの概念モデルです。各回γ個を提案し、独立で一定の採択率αに従って接頭辞を採択し、修正/追加トークンを1個出します。時間はγ×ドラフト遅延＋検証遅延。検証コストは入力値で、実際にはγと共に増え得ます。実モデルや品質評価ではなく、KV、通信、バッチ、スケジューリングを除外します。
E[出力] = 1 + α + … + α^γ。加速率 = E[出力] × 基準遅延 /（γ × ドラフト遅延 + 検証遅延）。1未満は基準より遅いことを意味します。
手法の参考資料
Assumptions, implementation & acceptance
Expected emissions 1+α+…+α^γ assume independent identical acceptance and a fixed verifier latency. This latency simulator is distinct from exact rejection-sampling correctness.
Reviewed counting units, statistical assumptions and numerical examples. Provider accounting and actual GPU allocation still require external measurement.
Before running: predict a boundary case
Expected emissions 1+α+…+α^γ assume independent identical acceptance and a fixed verifier latency. This latency simulator is distinct from exact rejection-sampling correctness.
Hint: isolate the assumption
Keep the baseline input fixed, change one parameter or boundary, and compare both the numerical result and the claimed units. A passing example verifies this fixture only.
Minimal executable example
Save the example and linked modules in one folder. Use Node.js 22 or newer, then run node speculative-decoding.mjs. npm install gpt-tokenizer@4.1.0
import {encode as rawEncode} from 'gpt-tokenizer/encoding/cl100k_base';
import {promptDiff,inspectDataset,chunkDocument,compareScores,estimateVRAM,samplingLab,speculativeLab} from './research-core.mjs';
const encode=s=>rawEncode(s,{disallowedSpecial:new Set()});
const result=speculativeLab(4,1,3,40,30,100,42);
console.log(result.expected,result.observed); // 5 5, under independent acceptance modelTest and transfer
Expected emissions 1+α+…+α^γ assume independent identical acceptance and a fixed verifier latency. This latency simulator is distinct from exact rejection-sampling correctness.
Record input, code version, expected result and observed result in the notebook below. Then construct a counterexample that violates the assumption above and explain why the original conclusion no longer follows.
Download complete kit (.tar.gz) · Complete reference kit and regression checksPredict, test and keep evidence
Before revealing an answer, predict one result. After the exercise, record the discrepancy and a transfer test. Saved locally across language editions.
Open notebook / export / clear →The mathematical review scope is recorded per lesson. It does not establish empirical paper reproduction; report suspected errors in your notes. Review scope