langsmith.evaluation.evaluator.comparison_evaluator#

langsmith.evaluation.evaluator.comparison_evaluator(func: Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]]) DynamicComparisonRunEvaluator[source]#

Create a comaprison evaluator from a function.

Parameters:

func (Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]]) –

Return type:

DynamicComparisonRunEvaluator