Release Notes Template

Release Identity

  • Release name:
  • Date (UTC):
  • Commit:
  • Data tag:
  • Baseline tag:

Scope

  • Benchmark task:
  • Verification mode(s):
  • Split visibility (public or full):

Runtime

  • Replay runtime image tag:
  • Replay runtime image id:
  • Runtime manifest path:

Split

  • Input index path:
  • split_manifest.json path:
  • contamination_report.json path:
  • heldout_test_commitments.json path:
  • license_policy:
  • max_leak_fraction:
  • Observed leak fraction:

Baselines

  • Suite config path:
  • Suite output path:
  • suite_results.json path:
  • suite_summary.md path:
  • model_error_run_count:

Checksums

  • Baseline bundle path:
  • SHA256SUMS path:
  • Verification command:

Notes

  • Known limitations:
  • Deviations from default protocol:
  • Follow-up items: