Skip to content

Feature/evaluation - LLM AS A JUDGE INTEGRATION#1900

Merged
RonShakutai merged 2 commits intoronshakutai/presidio-evaluation-repofrom
ronshakutai/evaluation-llm-as-judge
Mar 9, 2026
Merged

Feature/evaluation - LLM AS A JUDGE INTEGRATION#1900
RonShakutai merged 2 commits intoronshakutai/presidio-evaluation-repofrom
ronshakutai/evaluation-llm-as-judge

Conversation

@RonShakutai
Copy link
Collaborator

…rce tracking

- Updated EntityComparison component to handle multiple sources for entities and revised status types.
- Enhanced logic for combining and classifying entities from Presidio, LLM, and predefined datasets.
- Improved context retrieval for entities using indexOf for accurate highlighting.
- Adjusted UI badges for entity statuses to reflect new terminology.

Implement LLM Judge functionality in Anonymization page

- Added state management for LLM Judge including model selection, connection status, and progress tracking.
- Integrated API calls to fetch model configurations and analyze records.
- Enhanced user feedback with loading indicators and error handling.

Fetch and display sampled records in Human Review page

- Implemented API calls to load records and LLM results on component mount.
- Updated record handling to support dynamic data fetching and error management.
- Improved UI to reflect loading states and error messages.

Enhance dataset management in Setup page

- Added functionality to fetch saved datasets from the backend on component mount.
- Introduced fields for dataset name and description during dataset upload.
- Implemented editing and deletion capabilities for existing datasets.

Update types to include new dataset properties

- Modified UploadedDataset interface to include name, description, and path fields.
@RonShakutai RonShakutai requested a review from a team as a code owner March 9, 2026 06:59
@RonShakutai RonShakutai merged commit de286e1 into ronshakutai/presidio-evaluation-repo Mar 9, 2026
@RonShakutai RonShakutai deleted the ronshakutai/evaluation-llm-as-judge branch March 9, 2026 07:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant