EvolvingLMMs-Lab/lmms-eval
Mar 2026 – Mar 2026
1 Month active
Languages Used
PythonYAML
Technical Skills
Python programmingdata analysismachine learningvideo processing
Karun
PROFILE
Karun
Developed an end-to-end benchmark for vision-language models within the EvolvingLMMs-Lab/lmms-eval repository, targeting video-based counting tasks such as exercise repetition analysis. The work centered on introducing PushUpBench, a dataset and evaluation suite comprising 227 annotated workout video samples. Leveraging Python and YAML, the developer implemented robust evaluation metrics including exact match, mean absolute error, off-by-one, and R² to assess model performance. The approach emphasized reproducibility and clarity, with comprehensive documentation and dataset hosting on HuggingFace. This feature enhanced the repository’s capabilities for benchmarking machine learning models in video processing and data analysis, supporting more rigorous model evaluation workflows.
Overall Statistics
Feature vs Bugs
100%Features
Repository Contributions
1Total
Bugs
0
Commits
1
Features
1
Lines of code
317
Activity Months1
Your Network
95 peopleWork History
March 2026
1 Commits • 1 Features
Mar 1, 2026March 2026 monthly performance for EvolvingLMMs-Lab/lmms-eval focused on delivering a new end-to-end benchmark for vision-language models applied to video-based counting tasks, with clear business value through improved model evaluation and benchmarking capabilities.
1 Commits • 1 Features
Mar 1, 2026March 2026 monthly performance for EvolvingLMMs-Lab/lmms-eval focused on delivering a new end-to-end benchmark for vision-language models applied to video-based counting tasks, with clear business value through improved model evaluation and benchmarking capabilities.
March 2026
Activity
Loading activity data...
Quality Metrics
Correctness100.0%
Maintainability100.0%
Architecture100.0%
Performance100.0%
AI Usage60.0%
Skills & Technologies
Programming Languages
PythonYAML
Technical Skills
Python programmingdata analysismachine learningvideo processing
Repositories Contributed To
Overview of all repositories you've contributed to across your timeline