Software engineering. Applied AI.

Lab / Interactive study

What does the
task require?

Change the requirements and see which approach meets them at the lowest illustrative cost.

Every task has
its own frontier.

Change the task, required quality and response time. Compare the approaches that meet those requirements.

Illustrative study · Synthetic data
Evaluation tasks passed (%) Cost–quality frontier
94% required10080600.000.050.100.150.20
Lower costCost per task (A$)
94%
Minimum share of evaluation tasks passed

Routed system

Match effort to the task.

Routine work takes a compact path. Difficult cases take a more capable path. Evaluation determines where the boundary belongs.

A$0.029per task
95%tasks passed

Retrieve → Route → Verify

In a real engagement, your tasks set the test.
Quality, response time and total operating cost set the bar.

Inspect the study data

Example values illustrate architecture selection. Quality is the share of tasks passing evaluation; cost covers the complete route. The line joins candidates for which no alternative is both cheaper and at least as capable. The selection is the lowest-cost candidate meeting your requirements. This study runs entirely in your browser.

Synthetic measurements. Response time is p95.
SystemA$ / taskQualityResponse
Compact modelA$0.00778%0.32s
Cache + compactA$0.01186%0.44s
Retrieval + compactA$0.01692%0.85s
Routed systemA$0.02995%1.35s
Specialist systemA$0.04094%1.90s
Large modelA$0.08694%2.70s
Large model + toolsA$0.12598%3.80s

Reading the study

Compare the complete task.

The selected approach is the least expensive option that meets the required quality and, when selected, response time. If no option meets both, the study says so.

All values are synthetic. They demonstrate a comparison method, not results for a provider, model or Form From project. A real evaluation would use representative work, complete costs and recorded operating conditions.

Read the field note