Make the cake: Preheat oven to 350F. Lightly grease and flour a 9x5 loaf pan. Set aside.
In a large bowl with a handheld electric mixer, beat butter and sugar together until completely smooth and creamy. Beat in vanilla and eggs one at a time, beating well after each addition. Slowly beat in milk, flour, baking powder, salt, and spices until smooth. Fold in apples.
Scrape batter into prepared pan. Bake pound cake at 350F 55-60 minutes or until toothpick tests done. Let cake cool in pan 20 minutes then invert onto a cooling rack to cool completely.
Make the glaze: In a small bowl, whisk glaze ingredients until smooth and pouring consistency.
Drizzle glaze over cooled pound cake and let set 10 minutes. Slice pound cake and enjoy!