Do we already have this?
Write the requirement as the customer sent it, or take one from the specification we already hold. The assessment reads the files, looks for past jobs of the same kind, and comes back with a finding, the sentences it rests on, and what it will not answer. It is allowed to refuse, and a refusal is a result.
Runs a model over the corpus. Tens of seconds, and a few cents — which is why it runs when you ask and not as you type.
One we ran earlier
pnpm steering:worked-example CR-K2-0101 · 2026-09-14
The actual output, not a description of it — the finding, the sentences it rests on and what it refused to price. This is what the loop said on one occasion; whether it says it reliably is what the eval suite is for.
Rack force capacity
K2 Electric Power Steering — Customer Requirement Specification · Rev B, in force
K2 Electric Power Steering — Customer Requirement Specification § 4.1.1
The steering system shall deliver a peak rack force of at least 8000 N at 20 °C and 13.5 V supply.
- safety level
- B
- priority
- must
- verified by
- test
- comparable on
- rack_force_capacity
What it did
Every call it made, in order. The model never touches the database or the index — it asks for a search and is handed the result.
- 1searched the documents10 passage(s) from 4 file(s): requirements/PRG-KST-K2/system-requirements-PRG-KST-K2.md, requirements/PRG-KST-K2/CRS-KST-K2-001_RevB.md1487ms
- 2searched the documents0 passage(s) from 0 file(s): 934ms
- 3searched the documents10 passage(s) from 5 file(s): requirements/PRG-KST-K2/system-requirements-PRG-KST-K2.md, requirements/PRG-KST-K2/CRS-KST-K2-001_RevB.md2092ms
- 4searched the documents10 passage(s) from 4 file(s): requirements/PRG-KST-K2/CRS-KST-K2-001_RevB.md, requirements/PRG-KST-K2/CRS-KST-K2-001_RevA.md1389ms
- 5searched the documents10 passage(s) from 4 file(s): requirements/PRG-KST-K2/CRS-KST-K2-001_RevA.md, requirements/PRG-KST-K2/CRS-KST-K2-001_RevB.md1523ms
- 6looked for comparable past jobsok2455ms
It exists, and it has to change
Something in the estate is close, and modifying or re-evidencing it is the work.
CR-K2-0101 is specified in the programme (CRS and system requirements) with verification by test and the supplier is required to provide a test report, but I find no test report in the programme documents demonstrating the 8000 N result. The requirements set also contain an unresolved ambiguity about whether the figure is measured at the rack or at the motor, which must be resolved before claiming the requirement is demonstrated.
No price
Only 0 past job(s) match change_class = "validation_only", element_kind = "mechanical", asil = "B", safety_case_impact = false, tooling_required = false, out of 203 with attributable hours. Fewer than 3 is not enough for a median to mean anything, so there is no price. What each part of the filter costs you — safety_case_impact: 146 on its own, 0 without it · asil: 43 on its own, 0 without it · change_class: 19 on its own, 0 without it · element_kind: 17 on its own, 0 without it. Those are COUNTS, not prices: a median over a wider set is a different number about different work, and dropping a field that matters to this requirement would produce a confident wrong answer. Drop one only if it is genuinely irrelevant here, and say which you dropped. This needs a bottom-up estimate from somebody who has done one; history cannot help and should not be made to look like it can.
0 comparable jobs · a figure without its evidence count cannot be judged, so it is never shown alone
The sentences it rests on
Each one names a file and a line. The line is found by us in the file, not supplied by the model, so a challenged figure traces to a place rather than to a row nobody can account for.
requirements/PRG-KST-K2/system-requirements-PRG-KST-K2.md:16
The EPS assembly shall deliver at least 8000 N at the rack. Motor and gearbox output shall exceed this by the internal friction losses between motor and rack. - attribute: rack_force_capacity [N] - ASIL: B · verification: test · owner: systems - traces to: CR-K2-0101 - rationale: CR-K2-0101 plus the motor-to-rack friction budget. The customer figure is AT THE RACK, so the gearbox must be sized above it.
requirements/PRG-KST-K2/CRS-KST-K2-001_RevB.md:33
| | ID | § | Title | Value | Verif. | ASIL | Class | |---|---|---|---|---|---|---|---| | | | CR-K2-0101 | 4.1.1 | Rack force capacity | >= 8000 N | test | B | must |
requirements/PRG-KST-K2/CRS-KST-K2-001_RevA.md:33
| 1. Rack force capacity. The system should achieve 7.5kN, peak, 20 °C, 13.5 V. (test, ASIL B)
requirements/PRG-KST-K2/CRS-KST-K2-001_RevA.md:83
5. VERIFICATION Verification method per requirement is given above. Where the method is "test", the supplier shall provide a test report referencing this document and the requirement identifier. END OF DOCUMENT
requirements/PRG-KST-K2/review-notes-PRG-KST-K2.md:10
2. The rack force figure is stated at the rack in §4.1 and at the motor in §5.2. These are not the same number and the document does not say which governs.
requirements/PRG-KST-K2/architecture-PRG-KST-K2.md:43
| EL-K2-MOT-01 | EL-K2-GEAR-01 | mechanical | assist torque | — ms | B | | EL-K2-GEAR-01 | EL-K2-RACK-01 | mechanical | rack force | — ms | B |
3 found word for word, 5 with the line corrected.
The documents disagree
Two files state different things about the same point. Which one is true changes the answer, so it is put to a person rather than settled here.
measurement point for the required 8000 N (at the rack vs at the motor)
The EPS assembly shall deliver at least 8000 N at the rack. Motor and gearbox output shall exceed this by the internal friction losses between motor and rack. - attribute: rack_force_capacity [N] - ASIL: B · verification: test · owner: systems - traces to: CR-K2-0101 - rationale: CR-K2-0101 plus the motor-to-rack friction budget. The customer figure is AT THE RACK, so the gearbox must be sized above it.
requirements/PRG-KST-K2/system-requirements-PRG-KST-K2.md:16The rack force figure is stated at the rack in §4.1 and at the motor in §5.2. These are not the same number and the document does not say which governs.
requirements/PRG-KST-K2/review-notes-PRG-KST-K2.md:10For a person to decide
The one place this is allowed to ask for a decision rather than take one. Everything above is evidence for these questions.
Should the 8000 N requirement be interpreted and verified 'at the rack' (as SR-EPS-0407 and RevA's wording indicate) or 'at the motor' (as the review notes warn §5.2 may imply)?
Whether the value is measured at the rack or motor changes sizing and test procedure (gearbox friction margin), impacts whether existing hardware meets the requirement, and thus whether a simple validation test suffices or a redesign is needed.
systems engineering
Are the explicit test conditions (20 °C, 13.5 V) from CRS Rev A still required for the verification, and should they be re-inserted into the Rev B text/test protocol?
Test conditions define the load point to be demonstrated; missing or different conditions change the test setup and the measured outcome, affecting pass/fail and test cost.
test engineering / project manager
Is a supplier-provided test report (per the CRS verification clause) acceptable evidence, or does the programme require witnessed or third‑party validation?
Acceptance of supplier test reports reduces programme test scope and cost; requiring witnessed/third-party tests increases schedule, oversight, and cost.
project manager / quality
Stated without a citation
Things the answer asserts that no document backs. Listed rather than removed — an unsupported sentence you can see is worth more than one quietly deleted.
- No supplier test report demonstrating CR-K2-0101 (>= 8000 N) was found in the programme documents returned by the search.
agents-sdk · 7 turns · 6 tool calls · 76.8s · stopped because model_finished