langsmith.client.Client.evaluate_run#

Client.evaluate_run(run: ls_schemas.Run | ls_schemas.RunBase | str | uuid.UUID, evaluator: ls_evaluator.RunEvaluator, *, source_info: Dict[str, Any] | None = None, reference_example: ls_schemas.Example | str | dict | uuid.UUID | None = None, load_child_runs: bool = False) → ls_evaluator.EvaluationResult[source]#

Evaluate a run.

Parameters:

  • run (Run or RunBase or str or UUID) – The run to evaluate.

  • evaluator (RunEvaluator) – The evaluator to use.

  • source_info (Dict[str, Any] or None, default=None) – Additional information about the source of the evaluation to log as feedback metadata.

  • reference_example (Example or str or dict or UUID or None, default=None) – The example to use as a reference for the evaluation. If not provided, the run’s reference example will be used.

  • load_child_runs (bool, default=False) – Whether to load child runs when resolving the run ID.

  • Returns –

  • ------- –

  • Feedback – The feedback object created by the evaluation.

Return type:

ls_evaluator.EvaluationResult

On this page