EXCEEDS logo
Exceeds
Maria Bagdasarova

PROFILE

Maria Bagdasarova

Developed an end-to-end evaluation infrastructure for case-level faithfulness within the NVIDIA-NeMo/Gym repository, focusing on automated assessment of model outputs across QA, summarization, and data-to-text tasks. Built the RAGTruth Resources Server using Python, FastAPI, and Pydantic, enabling dataset preparation, verification scoring, and comprehensive unit testing. Implemented robust parsing logic with regex to handle noisy model outputs, including the removal of extraneous tags and JSON fences. The system reports accuracy and F1 metrics and can operate as a standalone scorer without requiring a full model server, supporting flexible deployment in air-gapped environments and facilitating reproducible, automated evaluation workflows.

Overall Statistics

Feature vs Bugs

100%Features

Repository Contributions

1Total
Bugs
0
Commits
1
Features
1
Lines of code
999
Activity Months1

Work History

July 2026

1 Commits • 1 Features

Jul 1, 2026

July 2026 monthly summary for NVIDIA-NeMo/Gym focused on delivering end-to-end evaluation infrastructure for case-level faithfulness. Key feature delivered: RAGTruth Resources Server enabling automated evaluation of model outputs across multiple task slices (QA, Summary, Data2txt) with dataset preparation, verification scoring, and comprehensive unit tests. The system reports accuracy and F1 metrics and is wired to stand up via a standalone scorer (no full model server).

Activity

Loading activity data...

Quality Metrics

Correctness100.0%
Maintainability100.0%
Architecture100.0%
Performance80.0%
AI Usage80.0%

Skills & Technologies

Programming Languages

No languages yet

Technical Skills

FastAPIJSONPydanticPythonRegexUnit Testing

Repositories Contributed To

1 repo

Overview of all repositories you've contributed to across your timeline

NVIDIA-NeMo/Gym

Jul 2026 Jul 2026
1 Month active

Languages Used

No languages

Technical Skills

FastAPIJSONPydanticPythonRegexUnit Testing