Helge Rhodin
Assistant Professor in Computer Science

Dept. Computer Science, UBC
201-2366 Main Mall
Vancouver, V6T 1Z4, Canada
Office: X653 ICICS/CS
rhodin@cs.ubc.ca
I am an Assistant Professor at UBC. Prior to that, I was lecturer at EPFL and postdoctoral researcher in the Computer Vision Lab of Pascal Fua and PhD candidate in the GVV group of Christian Theobalt at the Max-Plack-Institute for Informatics.
Check out [Linkedin/Rhodin] for a timeline.
My research interests range from 3D computer vision, over machine learning, to computer graphics and augmented reality.
With the aim of enabling tight and rich, yet natural and non-intrusive computer-human interaction, I advance 3D vision algorithms to yield high-quality dynamic reconstructions of our everyday environment from plain video input.
The latest VR and AR devices offer incredible display capabilities; my 3D vision projects complement them to aid mutual human-computer interaction in our everyday life.
Open PositionsThanks for your interest!Postdoc positions Please reach out with your resume, transcript of records, and a short motivation statement. At the moment, I can only support self-funded applicants. Graduate student positions If you would like to join my team, please apply via the official [UBC application page]. The deadline is in December 2020 for fall 2021. I will carefully consider all applications naming me as potential supervisor. Undergrad positions Please apply latest in January for summer internships in the same year. Internships are restricted to 14 weeks or more. Due to the COVID-19 situation, I will only accept domestic undergrad students. Please send your CV and transcripts. |
![]() |
Publications
Check out [Google Scholar/Rhodin] for a complete list and statistics.Upcoming
![]() |
AudioViewer: Learning to Visualize Sound
Y Zhang, W Peng, B Wandt, H Rhodin
arXiv 2020 *New* [paper pdf] |
![]() |
PCLs: Geometry-aware Neural Reconstruction of 3D Pose with Perspective Crop Layers
F Yu, M Salzmann, P Fua, H Rhodin
arXiv 2020 *New* [paper pdf] |
![]() |
CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wild
B Wandt, M Rudolph, P Zell, H Rhodin, B Rosenhahn
arXiv 2020 *New* [paper pdf] |
![]() |
Self-supervised Human Detection and Segmentation via Multi-view Consensus
I Katircioglu, H Rhodin, J Spörri, M Salzmann, P Fua
arXiv 2020 *New* [paper pdf] |
![]() |
Unsupervised Learning on Monocular Videos for 3D Human Pose Estimation
S Honari, V Constantin, H Rhodin, M Salzmann, P Fua
arXiv 2020 *New* [paper pdf] |
![]() |
Self-supervised Segmentation via Background Inpainting
Isinsu Katircioglu, Helge Rhodin, Victor Constantin, Jörg Spörri, Mathieu Salzmann, and Pascal Fua
arXiv 2020 [paper pdf] |
2020
![]() |
Deformation-aware Unpaired Image Translation for Pose Estimation on Laboratory Animals
Siyuan Li, Semih Günel, Mirela Ostrek, Pavan Ramdya, Pascal Fua, and Helge Rhodin
CVPR 2020 [paper pdf] |
![]() |
Ellipse Detection and Localization with Applications to Knots in Sawn Lumber Images
S Pan, S Fan, SWK Wong, JV Zidek, H Rhodin
WACV 2020 *New* [paper pdf] |
![]() |
XNect: Real-time Multi-person 3D Human Pose Estimation with a Single RGB Camera
Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Mohamed Elgharib, Pascal Fua, Hans-Peter Seidel, Helge Rhodin, Gerard Pons-Moll, Christian Theobalt
SIGGRAPH 2020 [paper pdf] [Demo@CVPR19] [SelecSLS-Pytorch code] |
![]() |
Front2Back: Single View 3D Shape Reconstruction via Front to Back Prediction
Yuan Yao, Nico Schertler, Enrique Rosales, Helge Rhodin, Leonid Sigal, and Alla Sheffer
CVPR 2020 [paper pdf] |
![]() |
ActiveMoCap: Optimized Viewpoint Selection for Active Human Motion Capture
Sena Kiciroglu, Helge Rhodin, Sudipta Sinha, Mathieu Salzmann, Pascal Fua
CVPR 2020 (oral presentation) [paper pdf] |
2019
![]() |
Gravity as a Reference for Estimating a Person's Height from Video
Didier Bieler, Semih Günel, Pascal Fua, and Helge Rhodin
ICCV 2019 [paper pdf] [video] |
![]() |
Motion Capture from Pan-Tilt Cameras with Unknown Orientation
Roman Bachmann, Jörg Spörri, Pascal Fua, and Helge Rhodin
3DV 2019 (oral presentation) [paper pdf] [2D ski pose dataset] |
![]() |
DeepFly3D, a deep learning-based approach for 3D limb and appendage tracking in tethered, adult Drosophila
Semih Günel, Helge Rhodin, Daniel Morales, João H Campagnolo, Pavan Ramdya, Pascal Fua
eLIFE 2019 [paper pdf] |
![]() |
Neural Scene Decomposition for Multi-Person Motion Capture
Helge Rhodin, Victor Constantin, Isinsu Katircioglu, Mathieu Salzmann, and Pascal Fua
CVPR 2019 [paper pdf] [video] [code] |
![]() |
Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-Mounted Fisheye Camera
Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, and Christian Theobalt TVCG 2019 (IEEE VR) Best Journal Paper Honorable Mention Award [paper pdf] [video and project page] |
![]() |
Are Existing Monocular Computer Vision-Based 3D Motion Capture Approaches Ready for Deployment? A Methodological Study on the Example of Alpine Skiing
Mirela Ostrek, Helge Rhodin, Pascal Fua, Erich Müller, and Jörg Spörri
Sensors 2019 [paper pdf] |
2018
![]() |
NRST: Non-rigid Surface Tracking from Monocular Video
Marc Habermann,
Weipeng Xu,
Helge Rhodin,
Michael Zollhoefer,
Gerard Pons-Moll, and
Christian Theobalt
GCPR 2018 (oral presentation) |
![]() |
Unsupervised Geometry-Aware Representation Learning for 3D Human Pose Estimation
Helge Rhodin, Mathieu Salzmann, and Pascal Fua ECCV 2018 (oral presentation) [paper pdf] [project page] [video] [code] |
![]() |
Learning Monocular 3D Human Pose Estimation from Multi-view Images
Helge Rhodin, Jörg Spörri, Isinsu Katircioglu, Victor Constantin,
Frédéric Meyer, Erich Müller, Mathieu Salzmann, and Pascal Fua CVPR 2018 (spotlight presentation) [paper pdf] [project page] [video] |
![]() |
MonoPerfCap: Human Performance Capture from Monocular Video
Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, and Christian Theobalt TOG 2018 (oral presentation at SIGGRAPH 2018) [paper pdf] [project page] [video] |
![]() |
What Face and Body Shapes Can Tell About Height
Semih Günel, Helge Rhodin, and Pascal Fua arXiv 2018 [paper pdf] |
2017
![]() |
Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision
Dushyant Mehta, Helge Rhodin, Dan Casas, Pascal Fua, Oleksandr Sotnychenko, Weipeng Xu, and Christian Theobalt 3DV 2017 (oral presentation) [paper pdf] [dataset] |
![]() |
VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, and Christian Theobalt
SIGGRAPH 2017 (oral presentation) [project page] [paper pdf] [video] [CVPR 2017 demo project page] |
2016
![]() |
From Motion Capture to Interactive Virtual Worlds
Towards Unconstrained Motion-capture Algorithms for Real-time Performance-driven Character Animation
Helge Rhodin PhD Dissertation, Saarland University, 2016 [thesis pdf] |
![]() |
EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras
Helge Rhodin, Christian Richardt, Dan Casas, Eldar Insafutdinov, Mohammad Shafiei, Hans-Peter Seidel, Bernt Schiele, and Christian Theobalt SIGGRAPH Asia 2016 (oral presentation) [project page] [dataset] [paper pdf] [video] |
![]() |
Model-based Outdoor Performance Capture Nadia Robertini, Dan Casas, Helge Rhodin, Hans-Peter Seidel, and Christian Theobalt 3DV 2016 [project page] [paper pdf] [video] |
![]() |
General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues Helge Rhodin, Nadia Robertini, Dan Casas, Christian Richardt, Hans-Peter Seidel, and Christian Theobalt ECCV 2016 (spotlight presentation) [project page] [paper pdf] [video] |
2015
![]() |
A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation Helge Rhodin, Nadia Robertini, Christian Richardt, Hans-Peter Seidel, and Christian Theobalt ICCV 2015 [project page] [paper pdf] [video] |
![]() |
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, and Christian Theobalt SIGGRAPH Asia 2015 (oral presentation) [project page] [paper pdf] [video] |
2014
![]() |
Real-time Hand Tracking Using a Sum of Anisotropic Gaussians Model Srinath Sridhar, Helge Rhodin, Hans-Peter Seidel, Antti Oulasvirta, and Christian Theobalt 3DV 2014 (oral presentation) [project page] [paper pdf] [video] |
![]() |
Interactive Motion Mapping for Real-time Character Control Helge Rhodin, James Tompkin, Kwang In Kim, Kiran Varanasi, Hans-Peter Seidel, and Christian Theobalt Eurographics 2014 (oral presentation) [project page] [paper pdf] [video] |
2013 and before
![]() |
A Mathematically Justified Algorithm for Shape from Texture
Helge Rhodin and Michael Breuß SSVM 2013 |
![]() |
A PTX Code Generator for LLVM
Helge Rhodin B.Sc. Thesis, Saarland University, 2010. [project page] [thesis pdf] |
![]() |
AnySL
The goal of AnySL is the development of a unified shading system that is independent of source language, target architecture and rendering engine without sacrificing runtime performance. My focus was on the GPU code generation. The AnySL project is joined work of the Compiler Design Lab of Prof. Sebastian Hack and the Computer Graphics Group of Prof. Philipp Slusallek. |
![]() |
Roboking Competition
As Team Hamburg we were able to win twice the international Roboking competition hosted by the Chemnitz University of Technology. The goal was to construct and program an autonomous robot capable of fulfilling the given objectives without human intervention. The team was mentored by Andreas Rhodin and consisted of Julian Bende, Paul Bröker, Daniel Reck, and Helge Rhodin. |
Team
The team composition is constantly evolving. This is a snapshot from Jan. 2021.Lead
|
|
Graduate
|
|
|
|
|||||
|
|
|
|
Undergraduate
|
|
Alumni
Yuchi Zhang (MSc)Farnoosh Javadi (MSc)
Teaching
2020
![]() |
CPSC 533R: Visual AI Deep Learning for computer vision and graphics Lecturer: Helge Rhodin |
![]() |
CPSC 427 Video Game Programming Lecturer: Helge Rhodin |
2019
![]() |
CPSC 532R/533R: Visual AI Deep Learning models for computer graphics and computer vision Lecturer: Helge Rhodin |
2017 & 2018
![]() |
EPFL CS 328 Numerical Methods for Visual Computing Lecturer: Wenzel Jakob and Helge Rhodin |
2015 & 2016
![]() |
MPI / Saarland University Computer Vision for Computer Graphics Lecturer: Christian Theobalt, Christian Richardt and Dan Casas. Assisted by Helge Rhodin. |