langsmith.client.Client.aevaluate_run#

async Client.aevaluate_run(run: ls_schemas.Run | str | uuid.UUID, evaluator: ls_evaluator.RunEvaluator, *, source_info: Dict[str, Any] | None = None, reference_example: ls_schemas.Example | str | dict | uuid.UUID | None = None, load_child_runs: bool = False) ls_evaluator.EvaluationResult[source]#

Evaluate a run asynchronously.

Parameters:
  • run (Run or str or UUID) – The run to evaluate.

  • evaluator (RunEvaluator) – The evaluator to use.

  • source_info (Dict[str, Any] or None, default=None) – Additional information about the source of the evaluation to log as feedback metadata.

  • reference_example (Optional Example or UUID, default=None) – The example to use as a reference for the evaluation. If not provided, the run’s reference example will be used.

  • load_child_runs (bool, default=False) – Whether to load child runs when resolving the run ID.

  • Returns

  • -------

  • EvaluationResult – The evaluation result object created by the evaluation.

Return type:

ls_evaluator.EvaluationResult