In a small saucepan, combine the milk and pumpkin puree over medium heat, stirring until the mixture is warm and well combined.

Add the brewed chai tea, maple syrup, pumpkin pie spice, and vanilla extract to the saucepan, whisking continuously until the mixture is hot but not boiling.

Remove the saucepan from heat and use a frother or whisk to create foam in the mixture if desired.

Pour the pumpkin chai latte into a mug and top with whipped cream if using.

Sprinkle a pinch of cinnamon on top for garnish and serve immediately.