langchain.smith.evaluation.config.EvalConfig

class langchain.smith.evaluation.config.EvalConfig(*, evaluator_type: EvaluatorType)

Bases: BaseModel

Configuration for a given run evaluator.

Parameters

evaluator_type (EvaluatorType) – The type of evaluator to use.

get_kwargs()

Get the keyword arguments for the evaluator configuration.

Create a new model by parsing and validating input data from keyword arguments.

Raises ValidationError if the input data cannot be parsed to form a valid model.

param evaluator_type: langchain.evaluation.schema.EvaluatorType [Required]

get_kwargs() → Dict[str, Any]

Get the keyword arguments for the load_evaluator call.

Returns

The keyword arguments for the load_evaluator call.

Return type

Dict[str, Any]