Publications

Selected peer-reviewed papers in HCI, AR, and Computer Vision.
Google Scholar Profile →

2026
Coming Soon
ICRA 2026 Coming Soon

OVTAS: Zero-Shot Action Segmentation

Exploring Vision-Language Models for Open-Vocabulary Zero-Shot Action Segmentation.

Asim Unmesh, Ramesh Kaki, Rahul Jain, Mayank Patel, Karthik Ramani
LBInv
Generative AI Under Review

LBInv: Gradient-Free Image Inversion

Gradient-Free Image Inversion via Quasi-Newton Diffusion Solvers.

Rahul Jain, Mayank Patel, Karthik Ramani
NA-VQA
Video Understanding Under Review

NA-VQA: Narrative Aligned QA

Narrative Aligned Long Form Video Question Answering.

Rahul Jain, Keval Doshi, Burak Uzkent, Garin Kessler
Canvas 3D
IUI 2026 Published

CANVAS-3D: Spatial Control for Generation

Empowering Precise Spatial Control for Image Generation with Constraints from a 3D Virtual Canvas.

Runlin Duan*, Yuzhao Chen*, Rahul Jain, Yichen Hu, Jingyu Shi, Karthik Ramani
Coming Soon
CHI 2026 Coming Soon

ARify: Instructional Videos to AR

Leveraging Narrated Instructional Videos to Create Augmented Reality Tutorials for Procedural Tasks.

Xiyun Hu, Chenfei Zhu, Shao-Kang Hsia, Dizhi Ma, Rahul Jain, Karthik Ramani
2025
Dynamo
ICRA 2026 Published

DYNAMO: Assembly Motion Prediction

Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction.

Mayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani
Caring AI
CHI 2025 Published

CARING-AI: Context-aware AR

Towards Authoring Context-aware Augmented Reality Instruction through Generative AI.

Jingyu Shi*, Rahul Jain*, Seung-gun Chi, Karthik Ramani
Adaptive Sliders
CHI 2025 Published

AdaptiveSliders: Semantic Editing

User-aligned Semantic Slider-based Editing of Text-to-Image Model Output.

Rahul Jain, Amit Goel, Koichiro Niinuma, Aakar Gupta
Transparent Barriers
CHI 2025 Published

Transparent Barriers

Natural Language Access Control Policies for XR-Enhanced Everyday Objects.

Kentaro Taninaka, Rahul Jain, Jingyu Shi, Kazunori Takashio, Karthik Ramani
Causality
TVCG 2025 Published

Causality in Mixed Reality

Visualizing Causality in Mixed Reality for Manual Task Learning: A Study.

Rahul Jain*, Jingyu Shi*, Andrew Benton, Moiz Rasheed, Hyungjun Doh, Subramanian Chidambaram, Karthik Ramani
PowVR
VR 2025 Published

PowVRtool: Haptic Feedback

A handheld haptic device for realistic power tool feedback in VR-based manufacturing training.

Mayank Patel, Asim Unmesh, Rahul Jain, et al.
Storytelling
arXiv Published

AR Storytelling

An Exploratory Study on Multi-modal Generative AI in AR Storytelling.

Hyungjun Doh*, Jingyu Shi*, Rahul Jain*, Heesoo Kim, Karthik Ramani
2024
Interacting Objects
RAL 2024 Published

Interacting Objects Dataset

A Dataset of Object-Object Interactions for Richer Dynamic Scene Representations.

Asim Unmesh, Rahul Jain, Jingyu Shi, et al.
Avattar
UIST 2024 Published

Avattar: Table Tennis Training

Stroke training with embodied and detached visualization in augmented reality.

Dizhi Ma, Xiyun Hu, Jingyu Shi, Mayank Patel, Rahul Jain, et al.
AnnotateXR
JCISE 2024 Published

AnnotateXR

An extended reality workflow for automating data annotation to support computer vision.

Subramanian Chidambaram*, Rahul Jain*, Sai Swarup Reddy, et al.
ConceptVis
IDETC 2024 Published

ConceptVis

Generating and Exploring Design Concepts for Early-Stage Ideation Using LLMs.

Runlin Duan, Nachiketh Karthik, Jingyu Shi, Rahul Jain, Maria C Yang, Karthik Ramani
2023 and Onwards
Ubi-Touch
UIST 2023 Published

Ubi-TOUCH

Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in AR.

Rahul Jain*, Jingyu Shi*, Runlin Duan, et al.
Ubi-Touch
arXiv Published

HCI-Centric Survey

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

Jingyu Shi*, Rahul Jain*, Hyungjun Doh, Ryo Suzuki, Karthik Ramani
Art Study
arXiv Published

Gen AI in Art

Understanding generative AI in art: an interview study with artists on G-AI from an HCI perspective.

Jingyu Shi, Rahul Jain, Runlin Duan, Karthik Ramani