news image

Han Liang - 梁瀚
[Download CV]
[Email | GitHub | Scholar]
[Conference Timer]

Publications

Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance

Qingcheng Zhao, Pengyu Long, Qixuan Zhang, Dafei Qin, Han Liang, Longwen Zhang, Yingliang Zhang, Jingyi Yu, Lan Xu

ACM SIGGRAPH, 2024

[Webpage | Paper | Arxiv | Video | Code]

OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers

Han Liang, Jiacheng Bao, Ruichi Zhang, Sihan Ren, Yuecheng Xu, Sibei Yang, Xin Chen, Jingyi Yu, Lan Xu

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

[Webpage | Paper | Arxiv | Video | Code]

InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions

Han Liang, Wenqian Zhang, Wenxuan Li, Jingyi Yu, Lan Xu

International Journal of Computer Vision (IJCV), 2024

[Webpage | Paper | Arxiv | Video | Code]

HybridCap: Inertia-aid monocular capture of challenging human motions

Han Liang, Yannan He, Chengfeng Zhao, Mutian Li, Jingya Wang, Jingyi Yu, Lan Xu

AAAI Conference on Artificial Intelligence (AAAI), 2023 [Oral]

[Webpage | Paper | Arxiv | Video]

LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors

Yiming Ren, Chengfeng Zhao, Yannan He, Peishan Cong, Han Liang, Jingyi Yu, Lan Xu, Yuexin Ma

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023

[Webpage | Paper | Arxiv | Video]

ChallenCap: Monocular 3d capture of challenging human performances using multi-modal references

Yannan He, Anqi Pang, Xin Chen, Han Liang, Minye Wu, Yuexin Ma, Lan Xu

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 [Oral]

[Webpage | Paper | Arxiv | Video]



Projects

RhyCap: Sparse-view real-time full-body motion capture system

We propose a lightweight real-time markerless mocap system. With even only three consumer-grade web cameras, the system achieves close industry-level accuracy. The system has been integrated into the Bilibili live streaming pipeline.

[Demo]

RhyLive: Monocular full-body motion capture for real-time streaming

Achieving fine-grained capture of the upper body, face, and hands using a single camera. The system has been integrated into the Bilibili live streaming pipeline.

[Demo]

Education

Ph.D.

I am now a Ph.D. candidate on digital human research, advised by Prof. Lan Xu and Prof. Jingyi Yu.


UESTC - 电子科技大学

Sep. 2014 - Jul. 2018

B.E.

I obtained my B.E. in computer software engineering from University of Electronic Science and Technology of China.



Experience

Tencent AI Lab

Aug. 2024 -

Reseach scientist intern

I worked as a research intern at Tencent AI Lab, advised by Dr. Shaoli Huang.


DGene Inc.

Jun. 2021 - May. 2022

Reseach scientist intern

I worked as a research intern at DGene Digital Technology Inc.


Dilusense Inc.

Jul. 2018 - Jun. 2020

3D Vision R&D

I joined Dilusense Inc. , where I worked closely with Prof. Juyong Zhang.


USTC - 中国科学技术大学

Oct. 2017 - Jun. 2018

Visiting student

I visited the GCL Lab in University of Science and Technology of China for 9 months, hosted by Prof. Ligang Liu.


Skills

Programming Languages

  • Python (Pytorch, Pyrender, RL games, Issac gym, and so on.)
  • C++ (OpenCV, CUDA and so on. )

Softwares

  • Visual Studio, Pycharm, Jupyter Notebook, Latex
  • Unity, Blender, Maya
  • Adobe Photoshop, Premiere

Others

  • Latex, Markdown