|
HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awareness
Zihui Xue, Mi Luo, Changan Chen, Kristen Grauman
arXiv 2024
paper |
project
|
|
Action2Sound: Ambient-Aware Generation of
Action Sounds from Egocentric Videos
Changan Chen*, Puyuan Peng*, Ami Baid, Sherry Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
ECCV 2024 (Oral)
paper |
project |
data |
code
|
|
Sim2Real Transfer for Audio-Visual Navigation with
Frequency-Adaptive Acoustic Field Prediction
Changan Chen*, Jordi Ramos*, Anshul Tomar*, Kristen Grauman
IROS 2024
paper |
project
|
|
ActiveRIR: Active Audio-Visual Exploration for Acoustic Environment Modeling
Arjun Somayazulu, Sagnik Majumder, Changan Chen, Kristen Grauman
IROS 2024
paper |
project
|
|
SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
Changan Chen, Kumar Ashutosh, Rohit Girdhar, David Harwath, Kristen Grauman
CVPR 2024
paper |
project
|
|
Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, ..., Changan Chen, ...,
Pablo Arbelaez, Gedas Bertasius, David Crandall, Dima Damen, Jakob Engel, Giovanni Maria Farinella,
Antonino Furnari, Bernard Ghanem, Judy Hoffman, C. V. Jawahar, Richard Newcombe, Hyun Soo Park,
James M. Rehg, Yoichi Sato, Manolis Savva, Jianbo Shi, Mike Zheng Shou, Michael Wray
CVPR 2024 (Oral)
website |
paper |
video
|
|
Self-Supervised Visual Acoustic Matching
Arjun Somayazulu, Changan Chen, Kristen Grauman
NeurIPS 2023
paper |
project
|
|
Replay: Multi-modal Multi-view Acted Videos for Casual Holography
Roman Shapovalov*, Yanir Kleiman*, Ignacio Rocco*, David Novotny, Andrea Vedaldi, Changan Chen, Filippos Kokkinos, Ben Graham, Natalia Neverova
ICCV 2023
paper |
project |
data
|
|
Novel-View Acoustic Synthesis
Changan Chen, Alexander Richard, Roman Shapovalov, Vamsi Krishna
Ithapu, Natalia Neverova, Kristen Grauman, Andrea Vedaldi
CVPR 2023
paper |
project |
code |
data
|
|
Learning Audio-Visual Dereverberation
Changan Chen, Wei Sun, David Harwath, Kristen Grauman
ICASSP 2023
paper |
project |
code
|
|
Retrospectives on the Embodied AI Workshop
Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot,
Changan Chen, Claudia Pérez D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony Francis,
Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz,
Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín,
Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva,
Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason,
Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu
arXiv 2022
paper |
website
|
|
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
Changan Chen*, Carl Schissler*, Sanchit Garg*, Philip Kobernik, Alexander Clegg, Paul Calamia, Dhruv Batra, Philip W Robinson, Kristen Grauman
NeurIPS 2022
Distinguished Paper Award at EgoVis Workshop, CVPR 2024
paper |
project |
website |
code
|
|
Few-Shot Audio-Visual Learning of Environment Acoustics
Sagnik Majumder, Changan Chen*, Ziad Al-Halah*, Kristen Grauman
NeurIPS 2022
paper |
project
|
|
Visual Acoustic Matching
Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman
CVPR 2022 (Oral)
paper |
video |
project |
code
Media coverage:
|
|
Sound Adversarial Audio-Visual Navigation
Yinfeng Yu, Wenbing Huang, Fuchun Sun, Changan Chen, Yikai Wang, Xiaohong Liu
ICLR 2022
paper |
project |
code
|
|
Semantic Audio-Visual Navigation
Changan Chen, Ziad Al-Halah, Kristen Grauman
CVPR 2021
paper |
project |
code
|
|
Learning to Set Waypoints for Audio-Visual Navigation
Changan Chen, Sagnik Majumder, Ziad Al-Halah, Ruohan Gao,
Santhosh K. Ramakrishnan, Kristen Grauman
ICLR 2021
paper |
project |
code
|
|
VisualEchoes: Spatial Image Representation Learning through Echolocation
Ruohan Gao, Changan Chen, Carl Schissler,
Ziad Al-Halah, Kristen Grauman
ECCV 2020
paper |
project |
code
|
|
SoundSpaces: Audio-Visual Navigation in 3D Environments
Changan Chen*, Unnat Jain*, Carl Schissler, Sebastia Vicenc Amengual Gari,
Ziad Al-Halah, Vamsi Krishna Ithapu, Philip Robinson, Kristen Grauman
ECCV 2020 (Spotlight)
paper |
project |
code |
website
Media coverage:
|
|
Relational Graph Learning for Crowd Navigation
Changan Chen*, Sha Hu*, Payam Nikdel, Greg Mori, Manolis Savva
IROS 2020
paper |
code
|
|
Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep
Reinforcement Learning
Changan Chen, Yuejiang Liu, Sven Kreiss, Alexandre Alahi
ICRA 2019
paper |
code
|
|
Constraint-Aware Deep Neural Network Compression
Changan Chen, Frederick Tung, Naveen Vedula, and Greg Mori
ECCV 2018
paper |
code
|
Dec 2023 |
Invited talk at NYU, "4D Audio-Visual Perception: Simulating, Synthesizing and Navigating with Sounds in Spaces" (Slides)
|
June 2023 |
Keynote talk at PerDream Workshop, ICCV 2023, "Audio-Visual Embodied AI: From Simulating to Navigating with Sounds in Spaces" (Slides)
|
June 2023 |
Keynote talk at Sight and Sound Workshop, CVPR 2023, "Novel-view Acoustic Synthesis" (Slides)
|
June 2023 |
Keynote talk at Ambient AI Workshop, ICASSP 2023, "Visual-acoustic Learning" (Slides)
|
Feb 2023 |
Invited talk at Texas Acoustics, "Visual Learning of Sound in Spaces" (Slides)
|
Jan 2023 |
Invited talk at MIT, "Visual Learning of Sound in Spaces" (Slides)
|
Nov 2022 |
Invited talk at FAIR, Meta AI, "Visual Learning of Sound in Spaces" (Slides)
|
June 2022 |
Oral talk at CVPR 2022, "Visual Acoustic Matching" (Slides)
|
June 2021 |
Invited talk at Facebook Reality Labs, "Learning Audio-Visual Dereverberation" (Slides)
|
June 2021 |
Invited talk at EPIC Workshop, CVPR 2021, "Semantic Audio-Visual Navigation" (Slides)
|
Sept. 2020 |
Invited talk at CS391R: Robot Learning at UT Austin, ""Audio-Visual Navigation" (Slides)
|
Dec. 2018 |
Invited talk at SwissAI Meetup, "Navigation in Crowds: From 2D Navigation to Visual Navigation"
|
Nov. 2018 |
Invited talk at Swiss Machine Learning Day, "Crowd-aware Robot Navigation with Attention-based DRL"
|
 
|
 
|
 
|
 
|
 
|
 
|
ZJU, China 2014-2016 |
SFU, Canada 2016-2019 |
EPFL, Switzerland 2018 |
FAIR, USA & UK 2020 - 2022 |
UT AUSTIN, USA 2019 - 2024 |
Stanford, USA 2024 - present |
|