Lista de herramientas permitidas
A disallowed calculator call stops the workflow.
Cálculo / simulación localExperimento educativo local, sin API externa. Los datos sintéticos no son mediciones de producción.
Study guide & lesson outline
LEARNING CONTRACTUnderstand → implement → investigate
Goal: explain the mechanism in this lesson, reproduce one example and test a failure case. Reading alone does not mark mastery.
- Understand: state assumptions, shapes/units and a counterexample.
- Implement: reproduce a numerical example and inspect boundaries.
- Investigate: compare one alternative under a matched budget.
02 · Predice y configura
Las notas técnicas, los parámetros y las respuestas están actualmente en inglés.
03 · Analiza la evidencia
Métodos y referencias
A deterministic state machine executes your plan against mock tools, not an autonomous language model. Each executed tool costs a synthetic $0.01. The write action never changes external data. Each mock result is truncated to 1,000 characters to bound memory. Guards are illustrative policy rules, not a complete security system.
Text / 原始公式
Plan → allowlist → approval → budget → mock tool → FIFO memory → next step
A tool allowlist alone cannot prevent data exfiltration or prompt injection in a real agent.
ReAct · reasoning and tool actions ↗Preguntas de práctica
agent-3 / 01What does “Tool allowlist” test?
A disallowed calculator call stops the workflow.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 02Which computation produces the result in “Tool allowlist”?
Plan → allowlist → approval → budget → mock tool → FIFO memory → next step
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 03What is the baseline configuration for “Tool allowlist”?
{"plan":"search,calculator,recall,write","allowed":"search,recall","steps":6,"budget":0.1,"memory":3,"approval":0}
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 04What numerical result should you check for “Tool allowlist”?
{"Executed / observed steps":2,"Simulated cost (USD)":0.01,"Memory entries":1}
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 05How would you run a controlled comparison for “Tool allowlist”?
Keep the supplied fixture and other settings fixed; change steps. Inspect the trace, stopping reason, simulated spend and retained memory.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 06What failure could invalidate a conclusion from “Tool allowlist”?
A tool allowlist alone cannot prevent data exfiltration or prompt injection in a real agent.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 07Is “Tool allowlist” a benchmark of a deployed language model?
No. A deterministic state machine executes your plan against mock tools, not an autonomous language model. Each executed tool costs a synthetic $0.01. The write action never changes external data. Each mock result is truncated to 1,000 characters to bound memory. Guards are illustrative policy rules, not a complete security system.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 08Which evidence should you report for “Tool allowlist”?
Inspect the trace, stopping reason, simulated spend and retained memory. Export inputs, engine, result and method; distinguish synthetic fixtures from observed production data.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 09How can another researcher reproduce “Tool allowlist”?
Open agent-3, reset the preset, retain the exact inputs and run. The calculation is deterministic for identical inputs.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →agent-3 / 10What is the next validation step after “Tool allowlist”?
A tool allowlist alone cannot prevent data exfiltration or prompt injection in a real agent. Test the hypothesis on a representative held-out workload and document a baseline, success metric and stopping rule before claiming deployment readiness.
Original teaching answer / local derivation. Method reference: ReAct · reasoning and tool actions ↗
Abrir laboratorio →Assumptions, implementation & acceptance
Tool budgets are nonnegative integers. Allowlist checks precede execution; exhausted budgets stop the loop. This deterministic mock tests orchestration, not an LLM’s planning competence.
Engine formulas, scenario presets and numerical safeguards reviewed. Seeded synthetic inputs are not a production benchmark.
Before running: predict a boundary case
A disallowed calculator call stops the workflow.
Hint: isolate the assumption
Keep the baseline input fixed, change one parameter or boundary, and compare both the numerical result and the claimed units. A passing example verifies this fixture only.
Minimal executable example
Save the example and linked modules in one folder. Use Node.js 22 or newer, then run node agent-3.mjs. No third-party runtime dependencies.
import {calculate,network} from './academy-core.mjs';
const params={
"plan": "search,calculator,recall,write",
"allowed": "search,recall",
"steps": 6,
"budget": 0.1,
"memory": 3,
"approval": 0
};
const result=calculate('agent',params);
console.log(result.metrics);Test and transfer
A disallowed calculator call stops the workflow.
Record input, code version, expected result and observed result in the notebook below. Then construct a counterexample that violates the assumption above and explain why the original conclusion no longer follows.
Download complete kit (.tar.gz) · Complete reference kit and regression checksPredict, test and keep evidence
Before revealing an answer, predict one result. After the exercise, record the discrepancy and a transfer test. Saved locally across language editions.
Open notebook / export / clear →The mathematical review scope is recorded per lesson. It does not establish empirical paper reproduction; report suspected errors in your notes. Review scope