Rohit Kumar

Research Engineer · LLMs & Generative Models

Currently an AI Engineer at Armada AI, I build grounded LLM systems and inference-planning tools. Previously at Avataar AI, I worked on product-image generation and novel-view synthesis. M.Tech in AI, IISc Bangalore. My research explores visual storytelling and learning from limited data.

Rohit Kumar

Research

Selected publications

CVPR 2026 Workshop

AttriStory

Fine-Grained Attribute Realization for Visual Storytelling with Diffusion Models

Manogna Sreenivas*, Rohit Kumar*, Soma Biswas

Research summary

AttriStory pairs a benchmark of 200 five-scene stories across 10 artistic styles with AttriLoss, an inference-time method for binding requested attributes to the correct objects. It refines latent codes to align attribute–object attention during early diffusion steps, integrating with SDXL, ConsiStory and StoryDiffusion without retraining. With AttriLoss, StoryDiffusion VQAScore increased from 0.8363 to 0.8636 on the AttriStory benchmark (Table 1).

WACV 2025

TACLE

Task and Class-aware Exemplar-free Semi-supervised Class Incremental Learning

Jayateja Kalla*, Rohit Kumar*, Soma Biswas

Research summary

TACLE learns new classes from few labels and current-task unlabeled data without retaining earlier examples. It combines task-adaptive pseudo-label selection, class-aware weighted losses and classifier alignment using labeled and confident pseudo-labeled data. Evaluated on CIFAR-10, CIFAR-100 and ImageNet-Subset100, including one-shot and imbalanced settings. On CIFAR-100 with 0.8% labels over 10 tasks, TACLE reached 92.35% average incremental accuracy versus 88.23% for SLCA+FT (+4.12 percentage points; same ImageNet-pretrained ViT, Table 1).

* Equal contribution.

Invited reviewer · NeurIPS, CVPR & ECCV 2026.

Engineering

Selected engineering

Support RAG Agent

Armada AI

A grounded question-answering system for Armada’s internal Customer Support team, searching runbooks, help-center content and vendor documentation.

Sole owner, from discussions with the support team and an empty repository through production integration.

Almanac: air-gapped document Q&A

Armada AI

An on-device RAG application designed for document question answering on Armada edge hardware without internet access.

Sole engineering owner across document ingestion, local model serving, retrieval and cited question answering.

LLM Inference Planning & Optimization

Armada AI

Engine-independent predictions of KV-cache capacity, latency, throughput and serving cost from spec sheets, with optional GPU-profile calibration.

Built the planner and used its predictions to choose serving configurations, then deployed them. Spec-sheet KV-cache capacity predictions were exact on 25/25 dense and MoE configurations.

With brief GPU profiling, dense mean error falls from 15.9% to 3.6% for TTFT (n=174) and 13.8% to 5.2% for batched TPOT (n=242). Errors are mean absolute percentages; profiled results are partly in-sample.

Diffusion-based product imagery

Avataar AI

A lifestyle-image generation pipeline that preserves the product while adapting its appearance to a new scene.

Built the Flux and ControlNet pipeline; modified diffusion sampling and product-relighting work were both adopted into Avataar’s production pipeline.

Cricket-Shot Predictor

Independent project

Video classification for cricket shots, from frame extraction to a runnable prediction demo.

Built embedding-based video classifiers and fine-tuned VideoMAE.

All engineering work

More projects

Virtual Try-On

Virtual try-on using Florence2 and IDM-VTON, with a three-stage CAT-TryOff pipeline and a single-stage Any2Any-Tryon/FLUX approach.

Experience

AI Engineer · Armada AI

Trivandrum, India

Manager: Naveen Nair

Jun 2025 - Present

Research Engineer · Avataar AI

Bangalore, India

Managers: Sohil Shah, Shubham Goel

Jul 2024 - Apr 2025

Teaching Assistant · IISc Bangalore

Bangalore, India

Aug 2023 - Apr 2024
Tools & capabilities
Languages
Python · SQL · MATLAB
AI/ML
LLMs · RAG · CRAG · Agentic AI · Computer Vision · Novel-view Synthesis · Diffusion Models · NLP · Supervised fine-tuning (SFT) · LoRA · QLoRA · Hybrid Search · BM25 · Evals (RAGAS) · Document-model evaluation · AWQ · GPTQ · Weight/activation quantization (WxAy)
Frameworks & Tools
ONNX · PyTorch · LangGraph · LangChain · HuggingFace · FastAPI · Chainlit · Playwright · Docling
Infrastructure
Kubernetes · Ray · vLLM · Keycloak · Distributed training · SLURM · Docker · Helm · AWS · PostgreSQL · Qdrant · Langfuse · SSO/RBAC

Background

I started in electrical engineering and chose AI research at IISc Bangalore. My M.Tech work explored learning new classes without retaining examples from earlier tasks, leading to TACLE at WACV 2025.

M.Tech in Artificial Intelligence

Indian Institute of Science (IISc), Bangalore

Thesis advisor: Prof. Soma Biswas

2022 - 2024

B.Tech in Electrical Engineering

Bhagalpur College of Engineering, Bhagalpur

Advisor: Prof. Arjun Kumar

2018 - 2021

Diploma in Electrical Engineering

Government Polytechnic Muzaffarpur, Muzaffarpur

2015 - 2018
Achievements & certifications

Contact