Removing an existing object from a scene is a hard problem. It not only requires the completion of geometry and texture, but also the removal of associated lighting effects (e.g. shadows, interreflections).
Major industrial players (e.g. IKEA, Amazon, Apple) offer Augmented Reality (AR) applications that allow users to place furniture virtually inside a room. There is an increasing interest in also performing the opposite: virtually removing existing furniture from a room. This empowers the users to completely reimagine their homes without having to physically move a single piece of furniture.
In this workshop, we invite researchers and industry practitioners to come together and discuss possible ways to efficiently tackle the problem of object removal. We separate the problem into several key components: room layout estimation, image inpainting and shadow removal. Each component is discussed within short presentation sessions. We also invite participants to discuss any relevant work comprising, but not limited to, Diminished Reality, inverse rendering, neural radiance fields, and room geometry estimation. The last session is a live Demo of our solution, which brings these components together to form a viable commercial Furniture Eraser application.
The workshop is in conjunction with the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2022.
Paper Submission Deadline | July 27th, 2022 AoE |
Paper Notification | August 8th, 2022 AoE |
Camera-Ready Submission Deadline | August 29th, 2022 AoE |
Workshop date | October 21st, 2022; 4pm-7pm SGT (Singapore Time) |
To submit your work, please make a submission through our EasyChair portal.
NOTE: For each presented paper, the presenter/speaker needs to make at least a one-day-conference pass registration payment (expected to be $350SGD).
Time | Session | Speaker | Title & Description |
15 min | Welcome & Introduction [slides] [video] | Salma Jiddi (Geomagical Labs) | Introduction
|
25 min | Presentation | Shohei Mori (Graz University of Technology) | How Far Can We Go for Diminished Reality Without Neural Networks?
|
25 min | presentation and Demo [slides] [video] | Prakhar Kulshreshtha (Geomagical Labs) | RGB image inpainting for indoor scenes
|
25 min | Presentation [slides] [video] | Nektarios Lianos (Geomagical Labs) | Room Layout estimation
|
15 min | coffee break | ||
10 min | Workshop paper 1 [paper] [slides] [video] | Kiyoshi Kiyokawa (Cybernetics & Reality Engineering Laboratory, NAIST) | Kato, Taiki, Naoya Isoyama, Norihiko Kawai, Hideaki Uchiyama, Nobuchika Sakata, and Kiyoshi Kiyokawa. "Online Adaptive Integration of Observation and Inpainting for Diminished Reality with Online Surface Reconstruction." |
25 min | Presentation [slides] [video] | Dimitrios Zarpalas Vasileios Gkitsas (Centre for Research & Technology, Hellas) | Diminished reality for indoor spherical panoramas
|
25 min | Presentation [slides] [video] | Salma Jiddi (Geomagical Labs) | Shadow Removal
|
10 min | Conclusion | Closing remarks |
NOTE: We expect 10 minutes per presenter, 6-7 minutes for presentation, and 3-4 minutes for questions. These timings are subject to change as we collect and finalize the participants list.
The goal of the workshop is to act as a very flexible platform for the participants to showcase their work, and open up discussions around emerging techniques in this domain. We accept submissions of length 2-6 pages excluding references. We are open to submissions of different kinds:
Submissions are invited on topics including:
The accepted papers will be published in ISMAR 2022 adjunct proceedings and IEEE Xplore. The submission template is the same as the ISMAR 2022 template for conference papers (IEEE Computer Society VGTC format).
To submit your work, please make a submission through our EasyChair portal.
is an Applied Research Engineer at Geomagical Labs, Inc. He leads a research project focused on developing a commercial furniture eraser solution. He obtained his Masters in Computer Vision from Carnegie Mellon University, where he worked with Prof. Michael Kaess on long term mapping for SLAM in a dynamic environment.
His research interests are Computer Vision and Machine Learning, with a focus on utilizing Deep Learning and 3D geometry for Computer Vision applications.
is a Research Scientist who heads the Research team at Geomagical Labs, Inc. She completed her PhD on Photometric Registration of Indoor Real Scenes using an RGB-D Camera with Application to Mixed Reality, at Technicolor and Irisa Rennes – Bretagne Atlantique, in the Rainbow team, under the supervision of Eric Marchand (Irisa) and Philippe Robert (Technicolor).
Her research interests are Computer Vision and Computer Graphics, with a focus on the geometric and photometric alignment of real and virtual worlds.
is an Applied Scientist, who leads the 3D Reconstruction team at Geomagical Labs, Inc. He previously obtained his Masters in Robotics at ETH Zürich, where he worked with Prof. Marc Pollefeys on visual odometry and deep learning.
His research interests include 3D Computer Vision, Machine Learning, and SLAM.