Preheat your oven to 350°F and spray a muffin tin with non-stick cooking spray and set it aside.
In a medium size mixing bowl mix together all-purpose flour, baking powder, baking soda, salt, and cinnamon. Set aside.
In a large mixing bowl cream together softened butter and granulated sugar (you can use a mixer or a whisk). Add eggs, sour cream, milk, and vanilla extract, whisking constantly in between.
Add dry ingredients into the mixture. Using a spatula, fold it together until smooth. Do not over mix.
Divide this batter between 9 muffin liners. Bake at 350°F for 18-20 minutes or until a toothpick comes out clean. When it is ready, take it out and set aside to cool off for about 10 minutes. Place the muffins on a wire rack.
When the muffins are cooled off, mix the glaze ingredients until the right consistency and drizzle it over the muffins. Enjoy!