Since naturalistic behaviors are, in nature, to be long horizon and highly none-linear, none-gaussian with respect to their goals, this sequence modeling problem would be particularly challenging as we want to generate long biomechanically realistic sequences from modeling the progression of these goal sequences that has only partial observables (keypoints). To this end, advised by professor Scott Linderman at Stanford University, I am doing sequence modeling using Mimic-mjx, which provide us with observables that was not available previously, to develop deep state space models.
Fully generated behaviors on the intention space to guide motor controller using only one initial state.