Leonid Sigal

Associate Professor, University of British Columbia

 
 
 

Menu

Home | About | Biography | CV Students and Collaborators | Research | Teaching | Publications | by Type | by Year | Code and Data |

Contact

Dep. of Computer Science
University of British Columbia
ICCS 119
2366 Main Mall
Vancouver, B.C. V6T 1Z4
CANADA

Phone: 1-604-822-4368
Email: lsigal at cs.ubc.ca

2023

ICME'23
Optimizing DNN based quality assessment metric for image compression: A novel rate control method, Q. Fang, T. Xu, L. Jiang, S. Li, M. Xu, Y. Chen and L. Sigal, IEEE International Conference on Multimedia and Expo (ICME), 2023. (accepted)

CVPR'23
Make-A-Story: Visual Memory Conditioned Consistent Story Generation, T. Rahman, H.-Y. Lee, J. Ren, S. Tulyakov, S. Mahajan and L. Sigal, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. (accepted)

CVPR'23
Omnimatte360: Associating Objects and their Effects in Unconstrained Monocular Video, M. Suhail, E. Lu, Z. Li, N. Snavely, L. Sigal and F. Cole, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. (accepted)

CVPR'23
DINN360: Deformable Invertible Neural Networks for Latitude-aware 360 Image Rescaling, Y. Guo, M. Xu, L. Jiang, N. Li, L. Sigal and Y. Chen, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. (accepted)

Eurographics'23
Subpixel Deblurring of Anti-Aliased Raster Clip-Art, J. Yang, N. Vining, S. Kheradmand, N. Carr, L. Sigal and A. Sheffer, Eurographics, 2023. (accepted)



2022

WACV'22
VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge, S. Ravi*, A. Chinchure*, L. Sigal, R. Liao and V. Shwartz, IEEE Winter Conference on Applications of Computer Vision (WACV), 2022.
Paper

NeurIPS'22
Iterative Scene Graph Generation, S. Khandelwal and L. Sigal, Neural Information Processing Systems (NeurIPS), 2022.
Paper

ECCV'22 Oral
Generalizable Patch-Based Neural Rendering, M. Suhail, C. Esteves, L. Sigal and A. Makadia, European Conference on Computer Vision (ECCV), 2022.
Project Page Paper Code

ECCV'22 Oral
Layered Controllable Video Generation, J. Huang, Y. Jin, K. Moo Yi and L. Sigal, European Conference on Computer Vision (ECCV), 2022.
Project Page Paper Code Video

CVPR'22 Oral Best Paper Finalist
Light Field Neural Rendering, M. Suhail, C. Esteves, L. Sigal and A. Makadia, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Project Page Paper Code Video

Semi-supervised Grounding Alignment for Multimodal Feature Learning, S.-H. Chou, Z. Fan, J. Little and L. Sigal, Conference on Robots and Vision (CRV), 2022.
Paper Supplementals



2021

NeurIPS'21
TriBERT: Human-centric Audio-visual Representation Learning, T. Rahman, M. Yang and L. Sigal, Neural Information Processing Systems (NeurIPS), 2021.
Paper Code Supplementals

NeurIPS'21
Referring Transformer: A One-step Approach to Multi-task Visual Grounding, M. Li and L. Sigal, Neural Information Processing Systems (NeurIPS), 2021.
Paper Code Supplementals

A Simple Baseline for Weakly-Supervised Human-centric Relation Detection, R. Goyal and L. Sigal, British Machine Vision Conference (BMVC), 2021.
Paper Supplementals

ICCV'21 Oral
Segmentation-grounded Scene Graph Generation, S. Khandelwal*, M. Suhail* and L. Sigal, IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
(Selected as oral presentation)
Paper Code Video

UAI'21
PROVIDE: A Probabilistic Framework for Unsupervised Video Decomposition, P. Zablotskaia, E. Dominici, L. Sigal and A. M. Lehrmann, Conference on Uncertainty in Artificial Intelligence (UAI), 2021.
Paper Supplementals

ICME'21 Oral
Weakly-supervised Audio-visual Sound Source Detection and Separation, T. Rahman and L. Sigal, IEEE International Conference on Multimedia and Expo (ICME), 2021.
Paper

CVPR'21 Best Paper Finalist
Energy-based Learning for Scene Graph Generation, M. Suhail, A. Mittal, B. Siddiquie, C. Broaddus, J. Eledath, G. Medioni and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper Code Supplementals

CVPR'21
UniT: Unified Knowledge Transfer for Any-shot Object Detection and Segmentation, S. Khandelwal, R. Goyal and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper Code Supplementals

CVPR'21
Saliency-Guided Image Translation, L. Jiang, M. Xu, X. Wang and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Paper Supplementals

Pattern Recognition'21
Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment, J. Wang, J. Chen, J. Lin, L. Sigal and C. W. de Silva, Pattern Recognition (PR), 2021.
Paper

IJCV'21
DeepVS2.0: A Saliency-Structured Deep Learning Method for Predicting Dynamic Visual Attention, L. Jiang, M. Xu, Z. Wang and L. Sigal, International Journal of Computer Vision (IJCV), 2021.
Paper

WACV'21 Oral
A Person-in-Context Synthesis With Compositional Structural Space, W. Yin, Z. Liu and L. Sigal, IEEE Winter Conference on Applications of Computer Vision (WACV), 2021.
Paper Video



2020

PolyFit: Perception- Aligned Vectorization of Raster Clip-Art via Intermediate Polygonal Fitting, E. A. Dominici, N. Schertler, J. Griffin, S. Hoshyari, L. Sigal and A. Sheffer, ACM Transactions on Graphics (ACM SIGGRAPH), 2020.
Paper: [pdf]

Attribute-guided Image Generation from Layout, K. Ma, B. Zhao and L. Sigal, British Machine Vision Conference (BMVC), 2020.
Paper: [pdf]
Supplemental: [pdf]

Generating Videos of Zero-Shot Compositions of Actions and Objects, M. Nawhal, M. Zhai, A. Lehrmann, L. Sigal and G. Mori, European Conference on Computer Vision (ECCV), 2020.
Paper: [pdf]
Project page: [html]

Improved Few-Shot Visual Classification, P. Bateni, R. Goyal, V. Masrani, F. Wood and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Paper: [pdf]
Video: [mp4]
Supplemental: [pdf]

Front2Back: Single View 3D Shape Reconstruction via Front to Back Prediction, Y. Yao, N. Schertler, E. Rosales, H. Rhodin, L. Sigal and A. Sheffer, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Paper: [pdf]
Video: [mp4]
Supplemental: [pdf]

DeepCT: A novel deep complex-valued network with learnable transform for video saliency prediction, L. Jiang, M. Xu, S. Zhang and L. Sigal, Pattern Recognition (PR), 2020.
Paper: [pdf]
Layout2image: Image Generation from Layout, B. Zhao, W. Yin, L. Meng and L. Sigal, International Journal of Computer Vision (IJCV), 2020.
Paper: [pdf]


2019

Mixture-Kernel Graph Attention Network for Situation Recognition, M. Suhail and L. Sigal, IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Paper: [pdf]

Watch, Listen and Tell: Multi-modal Weakly Supervised Dense Event Captioning, T. Rahman, B. Xu and L. Sigal, IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Paper: [pdf]

AttentionRNN: A Structured Spatial Attention Mechanism, S. Khandelwal and L. Sigal, IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Paper: [pdf] [supplemental]

GraphGROUND: Graph-based Language Grounding, M. Bajaj, L. Wang and L. Sigal, IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Paper: [pdf]

LayoutVAE: Stochastic Scene Layout Generation From a Label Set, A. A. Jyothi, T. Durand, J. He, L. Sigal and G. Mori, IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
Paper: [pdf] [supplemental]

DwNet: Dense warp-based network for pose-guided human video generation, P. Zablotskaia, A. Siarohin, B. Zhao and L. Sigal, British Machine Vision Conference (BMVC), 2019.
Paper: [pdf] [video]

Spatio-temporal Relational Reasoning for Video Question Answering, G. Singh, L. Sigal and J. Little, British Machine Vision Conference (BMVC), 2019.
(Selected as oral presentation)
Paper: [pdf]

Image Generation From Layout, B. Zhao, L. Meng, W. Yin and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
(Selected as oral presentation)
Paper: [pdf] [demo] [code]

A Variational Auto-Encoder Model for Stochastic Point Processes, N. Mehrasa, A. A. Jyothi, T. Durand, J. He, L. Sigal and G. Mori, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Paper: [pdf]

Neural Sequential Phrase Grounding (SeqGROUND), P. Dogan, L. Sigal and M. Gross, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Paper: [pdf]

Recent advances in zero-shot recognition: Toward data-efficient understanding of visual content, Y. Fu, T. Xiang, Y.G. Jiang, X. Xue, L. Sigal and S. Gong, IEEE Signal Processing Magazine, 2019.
Paper: [pdf]

Multi-level semantic feature augmentation for one-shot learning, Z. Chen, Y. Fu, Y. Zhang, Y.G. Jiang, X. Xue and L. Sigal, IEEE Transactions on Image Processing (TIP), 2019.
Paper: [pdf]

Learning to generate posters of scientific papers by probabilistic graphical models, Y.T. Qiang, Y.W. Fu, X. Yu, Y.W. Guo, Z.H. Zhou and L. Sigal, Journal of Computer Science and Technology, 2019.
Paper: [pdf]

Weakly-Supervised Spatial Context Networks, Z. Wu, L. Davis and L. Sigal, Winter Conference on Applications of Computer Vision (WACV), 2019.
Paper: [pdf]

Joint Event Detection and Description in Continuous Video Streams, H. Xu, B. Li, V. Ramanishka, L. Sigal and K. Saenko, Winter Conference on Applications of Computer Vision (WACV), 2019.
Paper: [pdf]

Multilevel Language and Vision Integration for Text-to-Clip Retrieval, H. Xu, K. He, B. Plummer, L. Sigal, S. Sclaroff and K. Saenko, AAAI Conference on Artificial Intelligence (AAAI), 2019.
Paper: [pdf]



2018

Middle-Out Decoding, S. Mehri and L. Sigal, Neural Information Processing Systems (NeurIPS), 2018.
Paper: [pdf]

Modular Generative Adversarial Networks, B. Zhao, B. Chang, Z. Jie and L. Sigal, European Conference on Computer Vision (ECCV), 2018.
Paper: [pdf]

Probabilistic Video Generation using Holistic Attribute Control, J. He, A. Lehrmann, J. Marino, G. Mori and L. Sigal, European Conference on Computer Vision (ECCV), 2018.
Paper: [pdf]

A Neural Multi-sequence Alignment TeCHnique (NeuMATCH), P. Dogan, B. Li, L. Sigal and M. Gross, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Paper: [pdf]

Show Me a Story: Towards Coherent Neural Story Illustration, H. Ravi, L. Wang, C Muniz, L. Sigal, D. Metaxas and M. Kapadia, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Paper: [pdf]

Predicting Personality from Book Preferences with User-Generated Content Labels, N. Annalyn, M. W. Bos, L. Sigal and B. Li, IEEE Transactions on Affective Computing (TAC), 2018.
Paper: [pdf]

Story Albums: Creating Fictional Stories from Personal Photograph Sets, O. Radiano, Y. Graber, M. Mahler, L. Sigal and A. Shamir, Computer Graphics Forum, Volume 36, 2017. (accepted)
Paper: [pdf]
Video: [mp4]
Supplemental: [pdf]



2017

Non-parametric Structured Outputs Networks, A. Lehrmann and L. Sigal, Neural Information Processing Systems (NIPS), 2017.
Paper: [pdf]

Visual Reference Resolution using Attention Memory for Visual Dialog, P. H. Seo, A. Lehrmann, B. Han and L. Sigal, Neural Information Processing Systems (NIPS), 2017.
Paper: [pdf]

Weakly-supervised Visual Grounding of Phrases with Linguistic Structures, F. Xiao, L. Sigal and Y. J. Lee, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
Paper: [pdf]

Story Albums: Creating Fictional Stories from Personal Photograph Sets, O. Radiano, Y. Graber, M. Mahler, L. Sigal and A. Shamir, Computer Graphics Forum, Volume 36, 2017.
Paper: [pdf]

Learn How to Choose: Independent Detectors versus Composite Visual Phrases, G. Rozenthal, A. Shamir and L. Sigal, Winter Conference on Applications of Computer Vision (WACV), 2017.
Paper: [pdf]



2016

Real-time Physics-based Motion Capture with Sparse Sensors, S. Andrews, I. Huerta, T. Komura, L. Sigal and K. Mitchell, European Conference on Visual Media Production (CVMP), 2016.
(Selected as oral presentation)
Paper: [pdf]
Video: [mp4]

Heterogeneous Knowledge Transfer in Video Emotion Recognition, Attribution and Summarization, B. Xu, Y. Fu, Y.-G. Jiang, B. Li and L. Sigal, IEEE Transactions on Affective Computing (TAC), 2016.
Paper: [pdf]

Learning Language-Visual Embedding for Movie Understanding with Natural-Language, A. Torabi, N. Tandon and L. Sigal, arXiv:1609.081241, 2016.
Paper: [pdf]

Semi-supervised Vocabulary-informed Learning, Y. Fu and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
(Selected as oral presentation)
Paper: [pdf]

Learning Activity Progression in LSTMs for Activity Detection and Early Detection, S. Ma, L. Sigal and S. Sclaroff, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Paper: [pdf]

Harnessing Object and Scene Semantics for Large-Scale Video Understanding, Z. Wu, Y. Fu, Y.-G. Jiang and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Paper: [pdf]

Video Emotion Recognition with Transferred Deep Feature Encodings, B. Xu, Y. Fu, Y.-G. Jiang, B. Li and L. Sigal, ACM International Conference in Multimedia Retrieval (ICMR), 2016.
Paper: [pdf]

Knowledge Transfer with Interactive Learning of Semantics Relationships, J. Choi, S. Hwang, L. Sigal and L. Davis, AAAI Conference on Artificial Intelligence (AAAI), 2016.
(Selected as oral presentation)
Paper: [pdf]

Exploiting View-Specific Appearance Similarities Across Classes for Zero-shot Pose Prediction: A Metric Learning Approach, A. Kuznetsova, S. Hwang, B. Rosenhahn and L. Sigal, AAAI Conference on Artificial Intelligence (AAAI), 2016.
Paper: [pdf]

Learning to Generate Posters of Scientific Papers, Y. Qiang, Y. Fu, Y. Guo, Z.-H. Zhou and L. Sigal, AAAI Conference on Artificial Intelligence (AAAI), 2016.
Paper: [pdf]



2015

Storyline Representation of Egocentric Videos with an Application to Story-based Search, B. Xiong, G. Kim and L. Sigal, IEEE International Conference on Computer Vision (ICCV), 2015.
Paper: [pdf]
Video: [mp4]

Learning from Synthetic Data Using a Stacked Multichannel Autoencoder, X. Zhang, Y. Fu, S. Jiang, L. Sigal and G. Agam, IEEE International Conference on Machine Learning and Applications (ICMLA), 2015.
Paper: [pdf]

Cross-Domain Matching with Squared-Loss Mutual Information, M. Yamada, L. Sigal, M. Raptis, M. Toyoda, Y. Chang and M. Sugiyama, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2015.
Paper: [pdf]

A Perceptual Control Space for Garment Simulation, L. Sigal, M. Mahler, S. Diaz, K. McIntosh, E. Carter, T. Richards and J. Hodgins, ACM Transactions on Graphics (Proc. SIGGRAPH), 2015.
Project: web page
Paper: [pdf]
Videos: [supplementary video (YouTube)]

Discovering Collective Narratives of Theme Parks from Large Collections of Visitors Photo Streams , G. Kim and L. Sigal, KDD 2015 (Practice).
Paper: [pdf]

Hierarchical Maximum-Margin Clustering, G.-T. Zhou, S. Hwang, M. Schmidt, L. Sigal and G. Mori, arXiv:1502.01827, 2015.
Paper: [pdf]

Joint Photo Stream and Blog Post Summarization and Exploration, G. Kim, S. Moon, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]

Ranking and Retrival of Image Sequences from Multiple Paragraph Queries, G. Kim, S. Moon, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]

Space-Time Tree Ensemble for Action Recognition S. Ma, L. Sigal, S. Sclaroff, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
(Selected as oral presentation)
Paper: [pdf]

Expanding Object Detector's Horizon: Incremental Learning Framework for Object Detection in Videos, A. Kuznetsova, S.-J. Hwang, B. Rosenhahn, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]
Supplemental: [pdf]
Video: [pdf]

Learning to Select and Order Vacation Photographs, F. Sadeghi, J. R. Tena, A. Farhadi, L. Sigal, IEEE Winter Conference on Applications of Computer Vision (WACV), 2015.
Download: [pdf]
Supplemental: [pdf]


      Best Paper Award

Family Member Identification from Photo Collections, Q. Dai, P. Carr, L. Sigal, D. Hoiem, IEEE Winter Conference on Applications of Computer Vision (WACV), 2015.
Download: [pdf]
Supplemental: [pdf]



2014

A Unified Semantic Embedding: Relating Taxonomies and Attributes, S.-J. Hwang, L. Sigal, Neural Information Processing Systems (NIPS), 2014.
Download: [pdf]

Parameterizing Object Detectors in the Continuous Pose Space, K. He, L. Sigal, S. Sclaroff, European Conference on Computer Vision (ECCV), 2014.
Download: [pdf]

Nonparametric Clustering with Distance Dependent Hierarchies, S. Ghosh, M. Raptis, L. Sigal, E. Sudderth, Conference on Uncertainty in Artificial Intelligence (UAI), 2014.
Download: [pdf]
Supplemental: [pdf]
Spotlight: [pdf]

Joint Summarization of Large-scale Collections of Web Images and Videos for Storyline Reconstruction, G. Kim, L. Sigal, E. P. Xing, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
Download: [pdf]
Videos: [1 Minute Spotlight Video (QuickTime)]

Domain Adaptation for Structured Regression, M. Yamada, Y. Chang and L. Sigal, International Journal of Computer Vision (IJCV), Special Issue on Domain Adaptation for Vision Applications, 2014. (to appear)
Download: [pdf]

High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso, M. Yamada, W. Jitkrittum, L. Sigal, E. P. Xing and M. Sugiyama, Neural Computation (NC), 26(1):185-207, 2014.
Publisher Web: [link]
Download: [pdf]



2013

Covariate Shift Adaptation for Discriminative 3D Pose Estimation, M. Yamada, L. Sigal and M. Raptis, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013. (to appear)
Publisher Web: [link]
Download: [pdf]

Action is in the Eye of the Beholder: Eye-gaze Driven Model for Spatio-Temporal Action Localization, N. Shapovalova, M. Raptis, L. Sigal, G. Mori, Neural Information Processing Systems (NIPS), 2013.
Download: [pdf]
Videos: [Supplementary Video [low res] (QuickTime, 3mb)]

From Subcategories to Visual Composites: A Multi-Level Framework for Object Detection, T. Lan, M. Raptis, L. Sigal, G. Mori, IEEE International Conference on Computer Vision (ICCV), 2013.
Download: [pdf]

Poselet Key-framing: A Model for Human Activity Recognition, M. Raptis, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 30mb)]

Dynamical Simulation Priors for Human Motion Tracking, M. Vondrak, L. Sigal and O. C. Jenkins, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 35(1):52-65, 2013.
Project: web page
Download: [pdf]
Videos: [supplementary video (YouTube)]
Code: [download]

Canonical Locality Preserving Latent Variable Model for Discriminative Pose Inference, Y. Tian, L. Sigal, F. De la Torre and Y. Jia, Image and Vision Computing (IVC), 31(3):223-230, 2013.
Download: [web link]



2012

Destination Flow for Crowd Simulation, S. Pellegrini, J. Gall, L. Sigal, L. van Gool, Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (ARTEMIS'12), 2012.
Download: [pdf]

No Bias Left Behind: Covariate Shift Adaptation for Discriminative 3D Pose Estimation, M. Yamada, L. Sigal, M. Raptis, European Conference on Computer Vision (ECCV), 2012.
Download: [pdf, supplimental]

Multi-linear Data-Driven Dynamic Hair Model with Efficient Hair-Body Collision Handling, P. Guan, L. Sigal, V. Reznitskaya, J. K. Hodgins, ACM/Eurographics Symposium on Computer Animation (SCA), 2012.
Project: soon
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 140mb)]

Video-based 3D Motion Capture through Biped Control, M. Vondrak, L. Sigal, J. K. Hodgins and Odest Jenkins, ACM Transactions on Graphics (Proc. SIGGRAPH), 2012.
Project: web page
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 81mb)]


      Best Paper Award

Human Context: Modeling human-human interactions for monocular 3D pose estimation, M. Andriluka and L. Sigal, VII Conference on Articulated Motion and Deformable Objects (AMDO), 2012.
Download: [pdf]

Social Roles in Hierarchical Models for Human Activity Recognition, T. Lan, L. Sigal and G. Mori, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
Download: [pdf]

Human attributes from 3D pose tracking, M. Livne, L. Sigal, N. Troje and D. Fleet, Computer Vision and Image Understanding (CVIU), 116:648-660, 2012.
Download: [pdf]

Shared kernel information embedding for discriminative inference, R. Memisevic, L. Sigal and D. Fleet, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 34(4):778-790, 2012.
Download: [pdf]

Loose-limbed People: Estimating Human Pose and Motion using Non-parametric Belief Propagation, L. Sigal, M. Isard, H. Haussecker and M. J. Black, International Journal of Computer Vision (IJCV), 98(1):15-48, 2012.
Download: [web link]

Recognizing Character-directed Utterances in Multi-child Interactions, H. Hajishirzi, J. Lehman, K. Kumatani, L. Sigal, and J. Hodgins, late-breaking report section of Human Robot Interaction (HRI), 2012.



2011

Facial Expression Transfer with Input-Output Temporal Restricted Boltzmann Machines, M. Zeiler, G. Taylor, L. Sigal, I. Matthews and R. Fergus, Neural Information Processing Systems (NIPS), 2011.
Download: [pdf]
Videos: [web page]

Visual Analysis of Humans: Looking at People, T. Moeslund, A. Hilton, V. Krüger and L. Sigal (Eds). ISBN: ISBN 978-0-85729-996-3. To be published by Springer Verlag in October 2011.

Benchmark Datasets for Pose Estimation and Tracking, M. Andriluka, L. Sigal and M. J. Black, Visual Analysis of Humans: Looking at People, T. Moeslund, A. Hilton, V. Krüger and L. Sigal (Eds). ISBN: ISBN 978-0-85729-996-3. To be published by Springer Verlag in October 2011.
Download: [web link]

Human Pose Estimation, L. Sigal, Encyclopedia of Computer Vision, Springer, 2011. (accepted)
Download: [draft pdf]

Motion Capture from Body-Mounted Cameras, T. Shiratori, H. S. Park, L. Sigal, Y. Sheikh and J. K. Hodgins, ACM Transactions on Graphics (Proc. SIGGRAPH), July 2011. (to appear)
Project: web page
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 85mb)]

Inferring 3D Body Pose Using Variational Semi-parametric Regression, Y. Tian, Y. Jia, Y. Shi, Y. Liu, J. Hao and L. Sigal, IEEE International Conference on Image Processing (ICIP), 2011.
Download: [pdf]



2010

Latent Gaussian Mixture Regression for Human Pose Estimation, Y. Tian, L. Sigal, H. Badino, F. De la Torre and Y. Liu, Asian Conference on Computer Vision (ACCV), 2010.
Download: [postscript], [pdf]

Human Attributes from 3D Pose Tracking, L. Sigal, D. Fleet, N. Troje, M. Livne, European Conference on Computer Vision, ECCV 2010.
Download: [postscript], [pdf]
Videos: [Supplementary Video (12mb)].

Stable Spaces for Real-time Clothing, E. de Aguiar, L. Sigal, A. Treuille and J. K. Hodgins, ACM Trans. Graphics (Proc. SIGGRAPH), July 2010.
Project: web page
Download: [pdf]
Videos: [Supplementary Video (64mb)]

Dynamical Binary Latent Variable Models for 3D Human Pose Tracking, G. Taylor, L. Sigal, D. Fleet, G. Hinton, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010.
(Selected as oral presentation)
Download: [postscript], [pdf]
Suplimental Materials: Learning and Additional Experiments
Videos: [Supplementary Video - Multiview (13mb)], [Supplementary Video - Monocular (16mb)].

HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion, L. Sigal, A. Balan and M. J. Black, International Journal of Computer Vision (IJCV), Special Issue on Evaluation of Articulated Human Motion and Pose Estimation, 2010.
Download: [postscript], [pdf]



2009

Estimating Contact Dynamics, M. Brubaker, L. Sigal, D. Fleet, IEEE International Conference on Computer Vision, ICCV 2009.
Download: [postscript], [pdf]
Videos: [Supplementary Video - Video Tracking (6mb)], [Supplementary Video - MoCap (4mb)].

Dynamics and Control of Multibody Systems, M. Vondrak, L. Sigal and O. C. Jenkins, Motion Control, A. Lazinica (Eds), ISBN978-953-7619-X-X, 2009. To be published by IN-TECH, Vienna in September 2009. (accepted)
Download: [postscript], [pdf]

Shared Kernel Information Embedding for Discriminative Inference, L. Sigal, R. Memisevic, D. Fleet, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009.
Download: [postscript], [pdf]

Video-Based People Tracking, M. Brubaker, L. Sigal and D. Fleet, Handbook on Ambient Intelligence and Smart Environments, H. Nakashima, H. Aghajan, and J.C. Augusto (Eds), Springer Verlag, 2009.
Download: [postscript], [pdf]



2008

Physical Simulation for Probabilistic Motion Tracking, M. Vondrak, L. Sigal and O. C. Jenkins, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008.
(Selected as oral presentation)
Download: [postscript], [pdf]
Videos: [Supplementary Video - DIVX (30mb)], [Supplementary Video - WMV (30mb)].
Talk: [pdf].
Talk Videos:
    Standard Controller [wmv, divx],
    Proposed Controller [wmv, divx],
    Multiview Walking [wmv, divx],
    Multiview Walking (vs. PF + smooth prior) [wmv, divx],
    Multiview Walking (vs. APF + smooth prior) [wmv, divx],
    Monocular Walking [wmv, divx],
    Monocular Walking (vs. PF + smooth prior) [wmv, divx],
    Multiview Jog [wmv, divx].

Continuous-state Graphical Models for Object Localization, Pose Estimation and Tracking, L. Sigal, PhD Thesis, May 2008.
Committee: Michael J. Black, William Freeman, John Hughes, David Mumford.
Download: [pdf]



2007

Combined discriminative and generative articulated pose and non-rigid shape estimation, L. Sigal, A. Balan and M. J. Black, Neural Information Processing Systems Conference, NIPS 2007.
Download: [postscript], [pdf]

Shining a Light on Human Pose: On Shadows, Shading and the Estimation of Pose and Shape, A. Balan, M. J. Black, H. Haussecker and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition, ICCV 2007.
Download: [postscript], [pdf]

Detailed Human Shape and Pose from Images, A. Balan, L. Sigal, M. J. Black, J. Davis and H. Haussecker, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007.
Download: [postscript], [pdf]



2006


    Best Paper Award

Predicting 3D People from 2D Pictures, L. Sigal and M. J. Black, IV Conference on Articulated Motion and Deformable Objects, AMDO 2006.
Download: [postscript], [pdf], [talk]
Videos: [2D to 3D Pose Inference (16mb)], [3D Tracking (75mb)].

Measure Locally, Reason Globally: Occlusion-sensitive Articulated Pose Estimation, L. Sigal and M. J. Black, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2006.
Download: [postscript], [pdf]

Hierarchical Approach for Articulated 3D Pose-Estimation and Tracking (extended abstract), L. Sigal and M. J. Black, Learning, Representation and Context for Human Sensing in Video Workshop (in conjunction with CVPR), 2006.
Download: [postscript], [pdf], [poster].

HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion, L. Sigal and M. J. Black, Techniacl Report CS-06-08, Brown University, 2006.
Download: [pdf].



2005

A Quantitative Evaluation of Video-based 3D Person Tracking, A. Balan, L. Sigal and M. J. Black, IEEE Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS 2005.
Download: [postscript], [pdf].



2004

Skin Color-Based Video Segmentation under Time-Varying Illumination, L. Sigal, S. Sclaroff and V. Athitsos, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(7), pp. 862-877, July 2004.
Download: [postscript], [pdf].

Tracking Loose-limbed People, L. Sigal, S. Bhatia, S. Roth, M. J. Black and M. Isard, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2004.
Download: [postscript], [pdf].

Gibbs Likelihoods for Bayesian Tracking, S. Roth, L. Sigal and M. J. Black, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2004.
Download: [postscript], [pdf].

Tracking Complex Objects using Graphical Object Models, L. Sigal, Y. Zhu, D. Comaniciu and M. J. Black, 1st International Workshop on Complex Motion, Springer-Verlag LNCS 3417, pp. 227-238, 2004.
Download: [postscript], [pdf].
(also see related talk given at NIPS 2004 Workshop on Graphical Models and Kernels)

3D Human Limb Detection using Space Carving and Multi-view Eigen Models, S. Bhatia, L. Sigal, M. Isard and M. J. Black, IEEE Workshop on Articulated and Nonrigid Motion, 2004.
Download: [postscript], [pdf].



2003

Attractive people: Assembling loose-limbed models using non-parametric belief propagation, L. Sigal, M. Isard, B. H. Sigelman and M. J. Black, Advances in Neural Information Processing Systems 16, NIPS 2003.
Download: [postscript], [pdf].



2002

Implicit probabilistic models of human motion for synthesis and tracking, H. Sidenbladh, M. J. Black and L. Sigal, European Conference on Computer Vision, ECCV 2002, Springer-Verlag LNCS 2353, Vol. 1, pp. 784-800.
Download: [postscript], [pdf].



2001

3D Hand Pose Reconstruction Using Specialized Mappings, R. Rosales, V. Athitsos, L. Sigal and S. Sclaroff, International Conference on Computer Vision, ICCV 2001.
Download: [postscript], [pdf].



2000

Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination, L. Sigal, S. Sclaroff and V. Athitsos, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2000.
Download: [postscript], [pdf].