#World Model

Research

PAN: Towards General World Model with Natural Language Actions and Video States
Benhao Huang (co-lead), 
Pandora Team, 
Zhiting Hu, 
Eric P. Xing
#World Model
#Image to Video
#Diffusion

A step towards a General World Model (GWM) that can simulate complex video scenarios with natural language actions.

paper (in progress)
report-v1
code