Version 0.3.0 - 2025-10-02
Added
Added
pushfunctionality toPromptMetricCategoricalandPromptMetricNumericfor submitting metric data.Added
pullfunctionality toPromptMetricCategoricalandPromptMetricNumericfor retrieving metric data by name or ID.Added
from_configmethod toPromptMetricfor easier instantiation from configuration.Added
sdk_config_to_backend_configandbackend_config_to_sdk_configfunctions for configuration conversion.Added parameter and URL parameter processing in the SDK client.
Added metrics endpoint to the SDK client.
Changed
Refactored metric backend to use Rhesis instead of native.
Refactored common metric functionality into base classes.
Improved metric configuration to accept enums.
Improved configuration handling for metrics.
Updated
BaseMetricto accept enums for categorical metrics.
Fixed
Resolved linting errors in test_metric.py.
Fixed default arguments for
prompt_metric_categorical.Fixed metric backend configuration.
Fixed enum and string validation in metrics.
Fixed handling of categories in
PromptMetric.Fixed raising errors for incorrect metric types.
Fixed prompt metric imports.
Fixed test data leakage in
test_metric.py.Fixed handling of
Noneconfig in prompt synthesizer.