Pinxin Liu

✱ ✦ ✧ ✶

Pinxin Liu

Exploring the convergence of vision, language, and motion

Hi! 👋

I am a PhD student, supervised by Dr. Chenliang Xu, in Computer Science department at University of Rochester. My research interests are Multi-modal Learning and Computer Graphics, including Multi-modal Large Language Models, Digital Human Rendering/Motion Synthesis, and Video Generation.

Previously, I was an undergraduate student who received the highest honor distinction in research Bachelor of Science in Computer Science at the University of Rochester.

RESEARCH INTERESTS

Multi-modal Learning

Vision-language models and multi-modal understanding

Digital Humans

Realistic avatar rendering and animation

Video Generation

Motion synthesis and video creation techniques

Co-Speech Gesture

Generating natural gestures from speech

ACADEMIC JOURNEY

May 2025 - August 2025

Research Scientist Intern, Meta Reality Lab

Jan 2025 - Present

PhD in Computer Science, University of Rochester

May 2024 - Dec 2024

Research Scientist Intern, FlawlessAI

July 2020 - May 2024

BS in Computer Science with Highest Honor, University of Rochester

NEWS

[03/2025] I will join Meta Reality Lab as a Research Scientist Intern.
[11/2024] One first author paper accepted 3DV 2025.
[09/2024] One co-author paper accepted Siggraph Asia 2024.
[07/2024] One first author paper accepted ECCV 2024.
[06/2024] Joined FlawlessAI as a Research Scientist Intern.

SELECTED PUBLICATIONS

Contextual Gesture: Co-Speech Gesture Video Generation through Context-aware Gesture Representation Pinxin Liu, Pengfei Zhang, Hyeongwoo Kim, Pablo Garrido, Ari Sharpio and Kyle Olszewski. Arxiv 2025
[Paper] [Project] [Code]
Generative AI for Cel-Animation: A Survey Yunlong Tang, Junjia Guo, Pinxin Liu, Zhiyuan Wang, Hang Hua, Jia-Xing Zhong, Yunzhong Xiao, Chao Huang, Luchuan Song, Susan Liang and 7 more authors. Arxiv 2025
[Paper] [Project]
Video Understanding with Large Language Models: A Survey Yunlong Tang*, Jing Bi*, Siting Xu*, Luchuan Song, Susan Liang, Teng Wang, ...,Pinxin Liu, Mingqian Feng, Feng Zheng, Jianguo Zhang, Ping Luo, Jiebo Luo, and Chenliang Xu. Arxiv 2025
[Paper] [Project]
GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling Pinxin Liu, Luchuan Song, Junhua Huang, Haiyang Liu and Chenliang Xu. Arxiv 2025
[Paper] [Project] [Code]
KinMo: Kinematic-aware Human Motion Understanding and Generation Pinxin Liu*, Pengfei Zhang*, Hyeongwoo Kim, Pablo Garrido and Bindita Chaudhuri. Arxiv 2025
[Paper] [Project] [Code]

TEACHING

2024 Spring CSC 2/449: Machine Vision
Instructor: Dr. Chengliang Xu
2023 FALL CSC 446: Machine Learning
Instructor: Dr. Daniel Gildea
2023 SPRING CSC 2/447: Nature Language Processing
Instructor: Dr. Hangfeng He
2022 Fall CSC 2/448: Statistical Speech and Language Processing
Instructor: Dr. Daniel Gildea

REVIEWING

CVPR 2024, 2025, EMNLP 2023, KDD 2024, AAAI 2024, ICLR 2025, 3DV 2025

SKILLS

Programming Languages

Python

C++

Java

Machine Learning

PyTorch

TensorFlow

Deep Learning

NLP

Computer Vision

3D Graphics

Tools & Technologies

CUDA

Linux

Git

LaTeX

Soft Skills

Research Methods

Technical Writing