Publications
Selected peer-reviewed papers in HCI, AR, and computer vision. Full list on Google Scholar.

2026

Thumbnail
Coming Soon
OVTAS

Exploring Vision-Language Models for Open-Vocabulary Zero-Shot Action Segmentation

Asim Unmesh, Ramesh Kaki, Rahul Jain, Mayank Patel, Karthik Ramani
Coming Soon ICRA 2026 Coming Soon
LBInv thumbnail
LBInv

Gradient-Free Image Inversion via Quasi-Newton Diffusion Solvers

Rahul Jain, Mayank Patel, Karthik Ramani
Coming Soon Under Review
NA-VQA thumbnail
NA-VQA

Narrative Aligned Long Form Video Question Answering

Rahul Jain, Keval Doshi, Burak Uzkent, Garin Kessler
Coming Soon Under Review
CANVAS-3D thumbnail
CANVAS-3D

Canvas3D: Empowering Precise Spatial Control for Image Generation with Constraints from a 3D Virtual Canvas

Runlin Duan*, Yuzhao Chen*, Rahul Jain, Yichen Hu, Jingyu Shi, Karthik Ramani
PDF IUI 2026
Thumbnail
Coming Soon
ARify

Leveraging Narrated Instructional Videos to Create Augmented Reality Tutorials for Procedural Tasks

Xiyun Hu, Chenfei Zhu, Shao-Kang Hsia, Dizhi Ma, Rahul Jain, Karthik Ramani
Coming Soon CHI 2026 Coming Soon

2025

DYNAMO thumbnail
DYNAMO

Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction

Mayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani
PDF ICRA 2026
CARING-AI thumbnail
CARING-AI

CARING-AI: Towards Authoring Context-aware Augmented Reality Instruction through Generative AI.

Jingyu Shi*, Rahul Jain*, Seung-gun Chi, Karthik Ramani
PDF CHI 2025
AdaptiveSliders thumbnail
AdaptiveSliders

User-aligned Semantic Slider-based Editing of Text-to-Image Model Output

Rahul Jain, Amit Goel, Koichiro Niinuma, Aakar Gupta
PDF CHI 2025
Transparent Barriers thumbnail
Transparent Barriers

Natural Language Access Control Policies for XR-Enhanced Everyday Objects

Kentaro Taninaka, Rahul Jain, Jingyu Shi, Kazunori Takashio, Karthik Ramani
PDF CHI 2025
Causality in MR thumbnail
Causality in MR

Visualizing Causality in Mixed Reality for Manual Task Learning: A Study

Rahul Jain*, Jingyu Shi*, Andrew Benton, Moiz Rasheed, Hyungjun Doh, Subramanian Chidambaram, Karthik Ramani
PDF TVCG 2025
PowVRtool thumbnail
PowVRtool

A handheld haptic device for realistic power tool feedback in VR-based manufacturing training

Mayank Patel, Asim Unmesh, Ananya Ipsita, Levi Erickson, Priyam Maheshwari, Rahul Jain, Jingyu Shi, Laura H Blumenschein, Karthik Ramani
PDF Virtual Reality 2025
AR Storytelling thumbnail
AR Storytelling

An Exploratory Study on Multi-modal Generative AI in AR Storytelling

Hyungjun Doh*, Jingyu Shi*, Rahul Jain*, Heesoo Kim, Karthik Ramani
PDF arXiv

2024

Interacting Objects thumbnail
Interacting Objects

A Dataset of Object-Object Interactions for Richer Dynamic Scene Representations

Asim Unmesh, Rahul Jain, Jingyu Shi, V. K. Chaithanya Manam, Hyung-Gun Chi, Subramanian Chidambaram, Alexander Quinn, Karthik Ramani
PDF RAL 2024
Avattar thumbnail
Avattar

Table tennis stroke training with embodied and detached visualization in augmented reality

Dizhi Ma, Xiyun Hu, Jingyu Shi, Mayank Patel, Rahul Jain, Ziyi Liu, Zhengzhe Zhu, Karthik Ramani
PDF UIST 2024
AnnotateXR thumbnail
AnnotateXR

An extended reality workflow for automating data annotation to support computer vision applications

Subramanian Chidambaram*, Rahul Jain*, Sai Swarup Reddy, Asim Unmesh, Karthik Ramani
PDF JCISE 2024
ConceptVis thumbnail
ConceptVis

Generating and Exploring Design Concepts for Early-Stage Ideation Using Large Language Model

Runlin Duan, Nachiketh Karthik, Jingyu Shi, Rahul Jain, Maria C Yang, Karthik Ramani
PDF IDETC/CIE 2024

2023 and Onwards

HCI Centric Survey thumbnail
HCI-Centric Survey

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

Jingyu Shi*, Rahul Jain*, Hyungjun Doh, Ryo Suzuki, Karthik Ramani
PDF arXiv
Ubi-TOUCH thumbnail
Ubi-TOUCH

Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality

Rahul Jain*, Jingyu Shi*, Runlin Duan, Zhengzhe Zhu, Xun Qian, Karthik Ramani
PDF UIST 2023
GEN AI in ART thumbnail
Gen AI in Art

Understanding generative AI in art: an interview study with artists on G-AI from an HCI perspective

Jingyu Shi, Rahul Jain, Runlin Duan, Karthik Ramani
PDF arXiv