Skip to content

billbliss3/awesome-hand-pose-estimation

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

75 Commits
 
 
 
 
 
 

Repository files navigation

Awesome Work on Hand Pose Estimation

Table of Contents

Evaluation codes

See folder evaluation to get more details about performance evaluation for hand pose estimation.

arXiv Papers

[arXiv:1712.03904] Feature Mapping for Learning Fast and Accurate 3D Pose Inference from Synthetic Images. [PDF]

Mahdi Rad, Markus Oberweger, Vincent Lepetit

[arXiv:1712.03917] 3D Hand Pose Estimation: From Current Achievements to Future Goals. [PDF]

Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim

[arXiv:1712.03866] Using a single RGB frame for real time 3D hand pose estimation in the wild. [PDF]

Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros

[arXiv:1712.01057] GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB. [PDF]

Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, Christian Theobalt

[arXiv:1711.10872] Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network. [PDF]

Qi Ye, Tae-Kyun Kim

[arXiv:1711.08996] Dense 3D Regression for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

[arXiv:1711.07399] V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map. [PDF]

Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee

[arXiv:1708.03416] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF]

Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang

[arXiv:1707.07248] Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]

Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang

[arXiv:1707.03742] Large-scale Multiview 3D Hand Pose Dataset. [PDF] [Project Page]

Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla

[arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]

Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez

[arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project Page]

Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang

[arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]

Yu Zhang, Chi Xu, Li Cheng

[arXiv:1610.07214] 3D Hand Pose Tracking and Estimation Using Stereo Matching. [PDF]

Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, Qingxiong Yang

Conference Papers

2017 ICCV

Learning to Estimate 3D Hand Pose from Single RGB Images. [PDF] [Project Page] [Code]

Christian Zimmermann, Thomas Brox

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor. [PDF] [Project Page]

Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt

Robust Hand Pose Estimation during the Interaction with an Unknown Object. [PDF] [Supp] [Project Page]

Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani

Learning Hand Articulations by Hallucinating Heat Distribution. [PDF] [Supp] [Project Page]

Chiho Choi, Sangpil Kim, Karthik Ramani

[2017 ICCV] Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization. [PDF] [Project Page] [Code]

Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly

[Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo. [PDF]

Paschalis Panteleris, Antonis Argyros

[Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger and Vincent Lepetit

[Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo. [PDF]

Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh

2017 CVPR

Hand Keypoint Detection in Single Images using Multiview Bootstrapping. [PDF] [Project Page] [Code]

Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh

Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation. [PDF] [Code]

Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao

Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis. [PDF]

Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim

3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images.[PDF] [Project Page]

Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann

2017 Others

[2017 3DV] Simultaneous Hand Pose and Skeleton Bone-Lengths Estimation from a Single Depth Image. [PDF]

Jameel Malik, Ahmed Elhayek, Didier Stricker

[2017 3DV] How to Refine 3D Hand Pose Estimation from Unlabelled Depth Data? [PDF]

Endri Dibra*, Thomas Wolf*, Cengiz Ă–ztireli, Markus Gross

[2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation. [PDF] [Code]

Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang

[2017 ICIP] A Hand Pose Tracking Benchmark from Stereo Matching. [PDF] [Project Page]

Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang

[2017 SIGGRAPH Asia] Articulated distance fields for ultra-fast tracking of hands interacting. [PDF]

Jonathan Taylor*, Vladimir Tankovich*, Danhang Tang*, Cem Keskin*, David Kim, Philip Davidson, Adarsh Kowdle, Shahram Izadi

[2017 SIGGRAPH Asia] Online Generative Model Personalization for Hand Tracking. [PDF] [Project Page]

Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon

[2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together. [PDF] [Project Page]

Javier Romero*, Dimitrios Tzionas* and Michael J. Black

[2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation. [PDF]

Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu

[2017 BMVC] Generative 3D Hand Tracking with Spatially Constrained Pose Sampling. [PDF] [Project Page]

Konstantinos Roditakis, Alexandros Makris and Antonis Argyros

[2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation. [PDF]

Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu

[2017 FG] Occlusion aware hand pose recovery from sequences of depth images. [PDF] [Slide]

Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez

[2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks. [PDF] [Project Page]

Duncan Goudie, Aphrodite Galata

2016 ECCV

Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation. [PDF] [Project Page]

Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim

Hand Pose Estimation from Local Surface Normals. [PDF]

Chengde Wan, Angela Yao, and Luc Van Gool

Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input. [PDF] [Project Page]

Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt

2016 Others

[2016 ICPR] Depth-based 3D hand pose tracking. [PDF]

Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.

[2016 IJCAI] Model-based Deep Hand Pose Estimation. [PDF] [Project Page] [Code]

Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei

[2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. [PDF]

Jonathan Taylor et al.

[2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking. [PDF] [Project Page] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

2016 CVPR

Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs. [PDF] [Project Page] [Code]

Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann

DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features. [PDF][Project Page]

Ayan Sinha*, Chiho Choi*, Karthik Ramani

Efficiently Creating 3D Training Data for Fine Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit

Fits Like a Glove: Rapid and Reliable Hand Shape Personalization. [PDF] [Project Page]

David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton

2015 ICCV

Training a Feedback Loop for Hand Pose Estimation. [PDF] [Project Page]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. [PDF]

Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton

Depth-based hand pose estimation: data, methods, and challenges. [PDF] [Project Page] [Code]

James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton

3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points. [PDF]

Peiyi Li, Haibin Ling

A collaborative filtering approach to real-time hand pose estimation. [PDF] [Project Page]

Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani

Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions. [PDF]

Sven Bambach, Stefan Lee, David Crandall, Chen Yu

Understanding Everyday Hands in Action from RGB-D Images. [PDF]

Gregory Rogez, James Supancic III, Deva Ramanan

2015 CVPR

Cascaded Hand Pose Regression. [PDF]

Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun

Fast and Robust Hand Tracking Using Detection-Guided Optimization. [PDF] [Project Page]

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt

Learning an Efficient Model of Hand Shape Variation from Depth Images. [PDF]

Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon

2015 Others

[2015 BMVC] Rule of Thumb: Deep Derotation for Improved Fingertip Detection. [PDF] [Project Page]

Aaron Wetzler, Ron Slossberg and Ron Kimmel

[2015 CHI] Accurate, Robust, and Flexible Real-time Hand Tracking. [PDF] [Project Page]

Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi

[2015 CVWW]Hands Deep in Deep Learning for Hand Pose Estimation. [PDF] [Project Page] [Code]

Markus Oberweger, Paul Wohlhart, Vincent Lepetit

[2015 FG]Combining Discriminative and Model Based Approaches for Hand Pose Estimation. [PDF] [Project Page]

Philip Krejov, Andrew Gilbert, Richard Bowden

[2015 SGP] Robust Articulated-ICP for Real-Time Hand Tracking. [PDF] [Project Page] [Code]

Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi

2014 CVPR

Realtime and robust hand tracking from depth. [PDF] [Project Page]

Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun

Latent regression forest: Structured estimation of 3d articulated hand posture. [PDF] [Project Page]

Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim

User-specific hand modeling from monocular depth sequences. [PDF] [Project Page]

Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon

Evolutionary Quasi-random Search for Hand Articulations Tracking. [PDF] [Project Page]

Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros

2014 Others & Before

[2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. [PDF] [Project Page]

Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin

[2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests. [PDF] [Project Page]

Danhang Tang, Tsz Ho Yu and T-K. Kim

[2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data. [PDF] [Project Page]

Srinath Sridhar, Antti Oulasvirta, Christian Theobalt

[2013 ICCV] Efficient Hand Pose Estimation from a Single Depth Image. [PDF] [Project Page]

Chi Xu, Li Cheng

[2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points. [PDF] [Project Page]

Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.

[2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.

Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun

[2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors. [PDF]

Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun

[2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect. [PDF] [Project Page] [Code]

Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros

Journal Papers

[2017 TCYB] Hough Forest with Optimized Leaves for Global Hand Pose Estimation with Arbitrary Postures. [PDF]

Hui Liang, Junsong Yuan, J. Lee, Liuhao Ge and Daniel Thalmann

[2017 TCSVT] Robust RGB-D Hand Tracking Using Deep Learning Priors. [PDF]

Jordi Sanchez-Riera, Kathiravan Srinivasan, Kai-Lung Hua, Wen-Huang Cheng, M. Anwar Hossain, and Mohammed F. Alhamid

[2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning. [PDF]

Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor

[2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression. [PDF]

Damien Foururea, Rémi Emonet, Elisa Fromont, Damien Muselet, Natalia Neverova, Alain Trémeaua, Christian Wolf

[2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation. [PDF] [Project Page]

Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte, Marc Pollefeys, Juergen Gall

[2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. [PDF] [Project Page]

Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng

[2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses. [PDF]

Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim

[2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation. [PDF] [Project Page]

Philip Krejov, Andrew Gilbert, Richard Bowden

[2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations. [PDF]

Hui Liang, Junsong Yuan, Daniel Thalmann

[2015 IJCV] Estimate Hand Poses Efficiently from Single Depth Images. [PDF] [Project Page] [Code]

Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng

[2014 TMM] Parsing the Hand in Depth Images. [PDF] [Project Page] [Code]

Hui Liang, Junsong Yuan, Daniel Thalmann

Theses

[2017 Thesis] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF] [Project Page]

Dimitrios Tzionas, University of Bonn

[2016 Thesis] Tracking Hands in Action for Gesture-based Computer Input. [PDF]

Srinath Sridhar, Max Planck Institute for Informatics

[2016 Thesis] 3D hand pose regression with variants of decision forests. [PDF] [Project Page]

Danhang Tang, Imperial College London

[2016 Thesis] Deep Learning for Human Motion Analysis. [PDF] [Project Page]

Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France

[2016 Thesis] Real time hand pose estimation for human computer interaction. [PDF] [Project Page]

Philip Krejov, University of Surrey

[2015 Thesis] Efficient Tracking of the 3D Articulated Motion of Human Hands. [PDF]

Iason Oikonomidis, University of Crete

[2015 Thesis] Vision-based hand pose estimation and gesture recognition. [PDF]

Hui Liang, Nanyang Technological University

[2015 Thesis] Localization of Humans in Images Using Convolutional Networks. [PDF]

Jonathan Tompson, New York University

Datasets

NYU Hand Pose Dataset
ICVL Dataset
MARA15 Dataset
BigHand2.2M Benchmark
  • Website
  • Related Paper: Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
MARC (FingerPaint) Dataset
UCI-EGO Dataset
Hands in Action Dataset
HandNet Dataset (Fingertip)
MARA14 Dataset
Dexter 1 Dataset
ASTAR Dataset

Credits:

  • [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
  • [2] http://arrummzen.net/#HandData
  • [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF]

Challenges

The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation.

3rd International Workshop on Observing and Understanding Hands in Action ( HANDS 2017), ICCV 2017

Other Related Papers

[arXiv:1801.01615] Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies. [PDF]

Hanbyul Joo, Tomas Simon, Yaser Sheikh

[arXiv:1704.02463] First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF]

Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim

[2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks. [PDF]

Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani

[2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training. [PDF] [Project Page] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand]

Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb

[2016 3DV] Learning to Navigate the Energy Landscape. [PDF] [Project Page]

Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi

[2016 NIPS] DISCO Nets : Dissimilarity Coefficient Networks. [PDF] [Project Page] [Code]

Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin

[2015 ICCV] 3D Object Reconstruction from Hand-Object Interactions. [PDF] [Project Page]

Dimitrios Tzionas and Juergen Gall


* indicates equal contribution

About

Awesome work on hand pose estimation/tracking

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 88.5%
  • Shell 11.5%