Skip to main content
Ctrl+K
This is a legacy site. Please use the latest API reference instead.
🦜️🛠️ LangSmith  documentation - Home 🦜️🛠️ LangSmith  documentation - Home
  • client
  • async_client
  • evaluation
  • run_helpers
  • run_trees
    • schemas
    • utils
    • anonymizer
    • _testing
    • _expect
    • middleware
Ctrl+K
Docs
  • GitHub
  • X / Twitter
Ctrl+K
  • client
  • async_client
  • evaluation
  • run_helpers
  • run_trees
  • schemas
  • utils
  • anonymizer
  • _testing
  • _expect
  • middleware
Docs
  • GitHub
  • X / Twitter

Section Navigation

  • langsmith.evaluation._arunner.AsyncExperimentResults
  • langsmith.evaluation._runner.ComparativeExperimentResults
  • langsmith.evaluation._runner.ExperimentResultRow
  • langsmith.evaluation._runner.ExperimentResults
  • langsmith.evaluation.evaluator.Category
  • langsmith.evaluation.evaluator.ComparisonEvaluationResult
  • langsmith.evaluation.evaluator.DynamicComparisonRunEvaluator
  • langsmith.evaluation.evaluator.DynamicRunEvaluator
  • langsmith.evaluation.evaluator.EvaluationResult
  • langsmith.evaluation.evaluator.EvaluationResults
  • langsmith.evaluation.evaluator.FeedbackConfig
  • langsmith.evaluation.evaluator.RunEvaluator
  • langsmith.evaluation.llm_evaluator.CategoricalScoreConfig
  • langsmith.evaluation.llm_evaluator.ContinuousScoreConfig
  • langsmith.evaluation._arunner.aevaluate
  • langsmith.evaluation._arunner.aevaluate_existing
  • langsmith.evaluation._arunner.async_chain_from_iterable
  • langsmith.evaluation._runner.evaluate
  • langsmith.evaluation._runner.evaluate_comparative
  • langsmith.evaluation._runner.evaluate_existing
  • langsmith.evaluation.evaluator.comparison_evaluator
  • langsmith.evaluation.evaluator.run_evaluator
  • evaluation
  • langsmith.evaluation.evaluator.run_evaluator

langsmith.evaluation.evaluator.run_evaluator#

langsmith.evaluation.evaluator.run_evaluator(func: Callable[[Run, Example | None], EvaluationResult | EvaluationResults | dict | Awaitable[EvaluationResult | EvaluationResults | dict]])[source]#

Create a run evaluator from a function.

Decorator that transforms a function into a RunEvaluator.

Parameters:

func (Callable[[Run, Example | None], EvaluationResult | EvaluationResults | dict | Awaitable[EvaluationResult | EvaluationResults | dict]]) –

On this page
  • run_evaluator()

© Copyright 2024, LangChain Inc.