How-to
Select a portfolio under budget
Choose the asset combination worth keeping, ranked by delta-per-cost, every decision at a Bonferroni-corrected interval, with a rejection log.
Valuation answers “which assets improve the agent?” Selection answers “which combination should I keep?”
kno select --value-run-id <value run id> --pool pool.jsonl --max-context-tokens 10000
What you get
Selected 2, greedy on delta-per-cost
RANK ASSET DESTINATION DELTA (95% CI)
1 refund-policy context +0.4000 [-0.1000, 0.9000]
2 pricing-tier context +0.3000 [-0.0500, 0.6500]
Rejected 1
old-faq redundant duplicates refund-policy
- Budget, selection fits a context budget (tokens) and a cost budget (dollars) simultaneously.
- Bonferroni-corrected intervals, the error budget is the family of decisions, not any one of them.
- Rejection log, every reject carries a reason:
no-effect,regression,redundant,cost-dominated,wrong-mechanism,irrelevant,budget-exhausted,measurement-failed. - Honest caveat, the selection-time gain is inflated by the winner’s curse; the honest number is the validate report’s holdout gain.
“Include nothing new” is a legal, first-class answer.
Details: Select a portfolio recipe.