langsmith.client.Client.run_on_dataset#

Client.run_on_dataset(dataset_name: str, llm_or_chain_factory: Any, *, evaluation: Any | None = None, concurrency_level: int = 5, project_name: str | None = None, project_metadata: Dict[str, Any] | None = None, dataset_version: datetime | str | None = None, verbose: bool = False, input_mapper: Callable[[Dict], Any] | None = None, revision_id: str | None = None, **kwargs: Any) → Dict[str, Any][source]#

Run the Chain or language model on a dataset.

Deprecated since version 0.1.0: This method is deprecated. Use langsmith.aevaluate() instead.

Parameters:

  • dataset_name (str) –

  • llm_or_chain_factory (Any) –

  • evaluation (Any | None) –

  • concurrency_level (int) –

  • project_name (str | None) –

  • project_metadata (Dict[str, Any] | None) –

  • dataset_version (datetime | str | None) –

  • verbose (bool) –

  • input_mapper (Callable[[Dict], Any] | None) –

  • revision_id (str | None) –

  • kwargs (Any) –

Return type:

Dict[str, Any]