Han Liang - 梁瀚

Ph.D. Candidate

lianghan@shanghaitech.edu.cn

ShanghaiTech University - 上海科技大学 - SIST - VDI

University of Electronic Science and Technology of China - 电子科技大学

Hi, I am currently a Ph.D. student (since 2020) in computer science at VRVC Lab, ShanghaiTech University, advised by Prof. Lan Xu and Prof. Jingyi Yu.
Prior to that, I obtained my B.E. in computer software engineering from UESTC.

My research focuses on the intersection of graphics, vision, and robotics, especially digital humans and embodied AI.
My ultimate aspiration is to realize human-centered embodied intelligent agents that liberate us human beings from tedious and heavy work.

I expect to defend my Ph.D. in 2025, and I'm now working as a research scientist at ByteDance Intelligent Creation Lab.
I'm open to any opportunities for cooperation and discussion.
If you are interested, please don't hesitate to contact me.

My current research interests include:

Digital humans

Embodied agents

Generative AI

News!

[2024.04] one paper is accepted by SIGGRAPH 2024.

[2024.02] one paper is accepted by CVPR 2024. See you in Seattle!

[2024.01] one paper is accepted by IJCV 2024.

[2023.01] one paper is accepted by TVCG 2023.

[2022.11] one paper is accepted by AAAI 2023 (Oral).

[2021.03] one paper is accepted by CVPR 2021 (Oral).

MORE >>

Services

Conference reviewer: AAAI, ICCV, CVPR, SIGGRAPH

Journal reviewer: IJCV, TVCG, TMM

Teaching assistance: CS280 Deep Learning, CS283 Robotics

Publications

Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidance

Qingcheng Zhao, Pengyu Long, Qixuan Zhang, Dafei Qin, Han Liang, Longwen Zhang, Yingliang Zhang, Jingyi Yu, Lan Xu

ACM SIGGRAPH, 2024

[Webpage | Paper | Arxiv | Video | Code]

OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers

Han Liang, Jiacheng Bao, Ruichi Zhang, Sihan Ren, Yuecheng Xu, Sibei Yang, Xin Chen, Jingyi Yu, Lan Xu

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

[Webpage | Paper | Arxiv | Video | Code]

InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions

Han Liang, Wenqian Zhang, Wenxuan Li, Jingyi Yu, Lan Xu

International Journal of Computer Vision (IJCV), 2024

[Webpage | Paper | Arxiv | Video | Code]

HybridCap: Inertia-aid monocular capture of challenging human motions

Han Liang, Yannan He, Chengfeng Zhao, Mutian Li, Jingya Wang, Jingyi Yu, Lan Xu

AAAI Conference on Artificial Intelligence (AAAI), 2023 [Oral]

[Webpage | Paper | Arxiv | Video]

LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors

Yiming Ren, Chengfeng Zhao, Yannan He, Peishan Cong, Han Liang, Jingyi Yu, Lan Xu, Yuexin Ma

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023

[Webpage | Paper | Arxiv | Video]

ChallenCap: Monocular 3d capture of challenging human performances using multi-modal references

Yannan He, Anqi Pang, Xin Chen, Han Liang, Minye Wu, Yuexin Ma, Lan Xu

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 [Oral]

[Webpage | Paper | Arxiv | Video]

Projects

RhyCap: Sparse-view real-time full-body motion capture system

We propose a lightweight real-time markerless mocap system. With even only three consumer-grade web cameras, the system achieves close industry-level accuracy. The system has been integrated into the Bilibili live streaming pipeline.

[Demo]

RhyLive: Monocular full-body motion capture for real-time streaming

Achieving fine-grained capture of the upper body, face, and hands using a single camera. The system has been integrated into the Bilibili live streaming pipeline.

[Demo]