Skip to content
Novus Examples
json95 B

MRR Eval Ground Truth (JSON)

Mean reciprocal rank ground truth for search eval harness tests.

Model evaluation
Preview, first 9 linesjson
{
  "queries": [
    {
      "q": "sample",
      "first_relevant_rank": 2
    }
  ]
}

Specifications

Metric
MRR

Testing contract

Reference control
Scenario
Exercise MRR Eval Ground Truth (JSON) in its ranking workflow. Mean reciprocal rank ground truth for search eval harness tests.
Expected result
top-level keys are queries; array lengths: queries=1. Declared feature checks: metric=MRR.

What is a .json file?

JSON (JavaScript Object Notation) is a lightweight, text-based data-interchange format representing objects, arrays, strings, numbers, booleans, and null. It is language-independent, human-readable, and the dominant format for web APIs and configuration. It requires a single well-formed root value.

How to use this file

Use an example JSON file to test parsers and serializers, schema validation, Unicode and number-precision handling, and API request or response processing.

How to use this file for testing

“MRR Eval Ground Truth (JSON)” is a deterministic Novus Examples fixture for Model evaluation. Benchmark results, confusion matrices, ROC curves, and classification reports in CSV and JSON, for testing eval dashboards, metric parsers, and leaderboard importers.

Documented properties for this file: JSON · 95 bytes. Compare results against paired or grouped companions on this page when present (clean↔damaged, searchable↔scanned, or format twins) so scores stay reproducible across runs.

Download the file once, keep the path stable in CI or local scripts, and treat the spec table as the contract: dimensions, seeds, field lists, and roles are intentional. Corrupt or invalid samples are labelled as such, expect parsers to fail loudly rather than silently accept them.

AI/ML fixtures are fully synthetic with documented schemas, no real people or data. Test data loaders, tokenizers, annotation converters, embedding/vector stores, or eval-metric parsers against the known structure and fixed seeds.

Code examples

import json

with open("mrr-eval.json") as f:
    data = json.load(f)
print(type(data), len(data))

Related files

Generated by generation/ai_wave_f.py. Free for any use, no attribution required, license.