EXCEEDS logo
Exceeds
Karthik Kothuri

PROFILE

Karthik Kothuri

Worked on model optimization and backend improvements for large language models, focusing on quantization and precision alignment. In the vllm-project/llm-compressor repository, developed a data-free input embedding quantization workflow using Python and PyTorch, enabling memory-efficient deployment of large-vocabulary models without requiring calibration data. Demonstrated near-lossless accuracy across multiple architectures and ensured compatibility with vLLM’s Embedding module. In jeejeelee/vllm, implemented FP32 precision support for the language model head, aligning training and inference for generation models and supporting reinforcement learning workflows. Added comprehensive validation tests and collaborated with cross-team reviewers to ensure production readiness and reproducibility in model generation tasks.

Overall Statistics

Feature vs Bugs

100%Features

Repository Contributions

2Total
Bugs
0
Commits
2
Features
2
Lines of code
427
Activity Months2

Work History

July 2026

1 Commits • 1 Features

Jul 1, 2026

July 2026 monthly summary: Delivered FP32 lm_head support for generation models in jeejeelee/vllm to align training and inference, enabling reinforcement learning–based workflows. Implemented a new FP32 logits projection in LogitsProcessor and added comprehensive validation tests. This work improves numerical stability, reproducibility, and production readiness for generation tasks.

June 2026

1 Commits • 1 Features

Jun 1, 2026

June 2026 monthly summary for vLLM compressor efforts focused on memory-efficient embedding quantization and validating data-free workflows to enable scalable deployment of large-vocabulary models.

Activity

Loading activity data...

Quality Metrics

Correctness100.0%
Maintainability80.0%
Architecture90.0%
Performance90.0%
AI Usage80.0%

Skills & Technologies

Programming Languages

Python

Technical Skills

Machine LearningModel OptimizationPython ScriptingQuantizationbackendllmmachine_learningpythonpytorch

Repositories Contributed To

2 repos

Overview of all repositories you've contributed to across your timeline

vllm-project/llm-compressor

Jun 2026 Jun 2026
1 Month active

Languages Used

Python

Technical Skills

Machine LearningModel OptimizationPython ScriptingQuantization

jeejeelee/vllm

Jul 2026 Jul 2026
1 Month active

Languages Used

No languages

Technical Skills

backendllmmachine_learningpythonpytorch