This book constitutes the thoroughly refereed joint post-proceedings of the first two International Workshops on Dynamical Vision, WDV 2005 and WDV 2006 held in Beijing, China in October 2005 within the scope of ICCV 2005 and in Graz, Austria in May 2006 in the course of ECCV 2006. The 24 revised full papers presented were carefully reviewed and selected from numerous submissions. The papers address a wide range of theoretical and application issues in dynamical vision and are organized in topical sections on motion segmentation and estimation, human motion analysis, dynamic textures, motion tracking, rigid and non-rigid motion analysis, as well as motion filtering and vision-based control.