Bring milk, sugar and pumpkin to simmer in medium saucepan on medium heat, stirring to dissolve sugar.
Carefully pour mixture into blender container. Add coffee, vanilla and pumpkin pie spice. With center part of blender cover removed to let steam escape, blend on medium speed until smooth and frothy. Pour into mugs. Serve immediately.