Preheat the oven to 350°F (175°C). Line the cupcake pan with cupcake liners.
In a mixing bowl, cream together the softened butter and granulated sugar until light and fluffy using an electric mixer.
Add the eggs, one at a time, beating well after each addition. Mix in the vanilla extract.
In a separate bowl, combine the all-purpose flour, baking powder, and salt. Gradually add this dry mixture to the wet mixture, alternating with the whole milk. Begin and end with the flour mixture, mixing until just combined.
Divide the batter evenly among the prepared cupcake liners, filling each about two-thirds full.
Bake in the preheated oven for 18-20 minutes or until a toothpick inserted into the center comes out clean. Remove from the oven and transfer the cupcakes to a cooling rack to cool completely.
Once cooled, decorate each cupcake with vanilla frosting using a spatula or piping bag.
Add drops of food coloring to the frosting and swirl to create a marbled effect if desired. Top with assorted Easter-themed sprinkles or edible decorations.