0 / 0

Hit rate evaluation metric

Last updated: May 08, 2025
Hit rate evaluation metric

The hit rate evaluation metric measures whether there is at least one relevant context among the retrieved contexts.

Metric details

Hit rate is a retrieval quality metric for generative AI quality evaluations that measures the quality of how retrieval systems rank relevant contexts.

Scope

The hit rate metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks: Retrieval Augmented Generation (RAG)
  • Supported languages: English

Scores and values

The hit rate metric score whether at least one relevant context is among the retrieved contexts. If the score is trending upwards, at least one relevant context is in the retrieved context. If the score is trending downwards, no relevant contexts are retrieved.

  • Range of values: 0.0-1.0
  • Best possible score: 1.0
  • Ratios:
    • At 0: No relevant contexts are retrieved
    • Over 0: Increasing rate of relevant contexts are retrieved

Settings

  • Thresholds:
    • Lower limit: 0
    • Upper limit: 1

Parent topic: Evaluation metrics