uhhm/portal
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 89 Wiki Activity

answer --seed, and runs/spread.sh: a score comes with its spread

Browse Source 
Every score so far was one run of a small visitor. `answer --seed n`
answers the same tasks with other shuffles and sampling, and
runs/spread.sh prints a run's score per seed, so a change can be told
from the visitor's mood.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
Bendik Aagaard Lynghaug
2026-09-23 22:46:25 +02:00
co-authored by Claude Fable 5.1
parent ec2f07da77
commit cc50249d7f
3 changed files with 29 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
src/score.rs
+1 -1
View File
@@ -34,7 +34,7 @@ pub fn run(argv: &[String]) -> anyhow::Result<()> {
let mut summary = serde_json::Map::new();
for (mode, tasks, skim) in [("full", &tasks_full, false), ("skim", &tasks_skim, true)] {
eprintln!("score: the visitor answers {mode}");
let answers = crate::answer_blind(&cmd, &std::fs::read_to_string(tasks)?, Some(&site))?;
let answers = crate::answer_blind(&cmd, &std::fs::read_to_string(tasks)?, Some(&site), 0)?;
let answers_path = out.join(format!("answers-{mode}.jsonl"));
std::fs::write(&answers_path, &answers)?;
let (tasks_arg, answers_arg) = (s(tasks), s(&answers_path));