Token LabSearch

← All experiments
Model routing & fallbacks / 2 OF 5

All strong model

Strong-only routing provides a simple cost baseline.

Local calculation / simulation

Local educational experiment. No external API calls. Synthetic fixtures are not production measurements.

Study guide & lesson outlineLEARNING CONTRACT

Understand → implement → investigate

Goal: explain the mechanism in this lesson, reproduce one example and test a failure case. Reading alone does not mark mastery.

02 · Predict & configure

Technical scenario notes, parameter names and reference answers are currently in English.

03 · Inspect the evidence

Run this experiment to see results.

Methods & references

Analytical expectation with user-supplied synthetic per-request prices and latencies, not current provider rates. Sequential one-time fallback; failed primary attempts are charged; fallback always succeeds. No quality prediction, queueing, correlated failures or tail-latency model.

Text / 原始公式
E[C]=s(Ccheap+f×Cstrong)+(1−s)Cstrong; E[T]=s(Tcheap+f×Tstrong)+(1−s)Tstrong

A cheaper route may violate task-quality requirements; this estimator does not measure quality.

AWS Builders Library · timeouts, retries and backoff ↗

Practice questions

routing-2 / 01What does “All strong model” test?

Strong-only routing provides a simple cost baseline.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 02Which computation produces the result in “All strong model”?

E[C]=s(Ccheap+f×Cstrong)+(1−s)Cstrong; E[T]=s(Tcheap+f×Tstrong)+(1−s)Tstrong

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 03What is the baseline configuration for “All strong model”?

{"requests":1000,"cheap":0,"failure":0.1,"cheapCost":0.001,"strongCost":0.02,"cheapMs":200,"strongMs":1000}

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 04What numerical result should you check for “All strong model”?

{"Expected USD/request":0.02,"Expected total USD":20,"Expected latency (ms)":1000,"Fallback calls":0}

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 05How would you run a controlled comparison for “All strong model”?

Keep the supplied fixture and other settings fixed; change failure. Compare expected cost, mean latency and fallback volume with observed production traces.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 06What failure could invalidate a conclusion from “All strong model”?

A cheaper route may violate task-quality requirements; this estimator does not measure quality.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 07Is “All strong model” a benchmark of a deployed language model?

No. Analytical expectation with user-supplied synthetic per-request prices and latencies, not current provider rates. Sequential one-time fallback; failed primary attempts are charged; fallback always succeeds. No quality prediction, queueing, correlated failures or tail-latency model.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 08Which evidence should you report for “All strong model”?

Compare expected cost, mean latency and fallback volume with observed production traces. Export inputs, engine, result and method; distinguish synthetic fixtures from observed production data.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 09How can another researcher reproduce “All strong model”?

Open routing-2, reset the preset, retain the exact inputs and run. The calculation is deterministic for identical inputs.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
routing-2 / 10What is the next validation step after “All strong model”?

A cheaper route may violate task-quality requirements; this estimator does not measure quality. Test the hypothesis on a representative held-out workload and document a baseline, success metric and stopping rule before claiming deployment readiness.

Original teaching answer / local derivation. Method reference: AWS Builders Library · timeouts, retries and backoff ↗

Open lab →
MATHEMATICAL REVIEW · 2026-10-26

Assumptions, implementation & acceptance

Failed cheap calls are billed and fallback is assumed successful. Expected latency is serial and excludes queues; aggregate expectation is not p95 latency.

Engine formulas, scenario presets and numerical safeguards reviewed. Seeded synthetic inputs are not a production benchmark.

Classify cheap vs strong route → Charge attempted cheap call → Failure → sequential fallback → Weighted expected cost and latency
Mechanism map: follow the transformations from top to bottom.

Before running: predict a boundary case

Strong-only routing provides a simple cost baseline.

Hint: isolate the assumption

Keep the baseline input fixed, change one parameter or boundary, and compare both the numerical result and the claimed units. A passing example verifies this fixture only.

Minimal executable example

Save the example and linked modules in one folder. Use Node.js 22 or newer, then run node routing-2.mjs. No third-party runtime dependencies.

import {calculate,network} from './academy-core.mjs';
const params={
  "requests": 1000,
  "cheap": 0,
  "failure": 0.1,
  "cheapCost": 0.001,
  "strongCost": 0.02,
  "cheapMs": 200,
  "strongMs": 1000
};
const result=calculate('routing',params);
console.log(result.metrics);

Test and transfer

Strong-only routing provides a simple cost baseline.

Record input, code version, expected result and observed result in the notebook below. Then construct a counterexample that violates the assumption above and explain why the original conclusion no longer follows.

Download complete kit (.tar.gz) · Complete reference kit and regression checks

Predict, test and keep evidence

Before revealing an answer, predict one result. After the exercise, record the discrepancy and a transfer test. Saved locally across language editions.

Open notebook / export / clear →

The mathematical review scope is recorded per lesson. It does not establish empirical paper reproduction; report suspected errors in your notes. Review scope