I am a Research Tech Lead at Descript, where I lead teams working on video and audio generation research, and on multi-modal understanding that helps creators produce content at the speed of thought.
I completed my PhD at the University of British Columbia, advised by Prof. Helge Rhodin. My research centers on computer vision, machine learning, and generative models — for images, shapes, and physics.
Before UBC, I spent a year at Dartmouth College as a research intern advised by Prof. Bo Zhu, working on physics-based machine learning. I received my M.Sc. from Rutgers University, and B.Sc. from the University of Liverpool / Xi'an Jiaotong-Liverpool University, advised by Prof. Corina Constantinescu.
A state-of-the-art lipsync generation stack from scratch, including highly compressed video VAEs and diffusion generators. The system improved audio-visual alignment, identity preservation, and fine facial dynamics across challenging poses. Example videos.
A state-of-the-art audio inpainting model from scratch, including highly compressed audio VAEs and diffusion generators. The system not only preserves the identity and talking pace, but also room tone, including background noise and music. Example audio clips.
A training-free video-to-video model that scales sequence length for consistency, supporting generation and editing of static-camera videos beyond two hours. Example videos.
