Preheat your oven to 400°F (200°C).
In a large mixing bowl, combine 3 tablespoons of olive oil, minced garlic, dried herbs, salt, and pepper. Stir well.
Add the chicken breasts to the mixture and ensure they are thoroughly coated in the garlic herb oil. Set aside.
In another bowl, toss the halved baby potatoes with the remaining 1 tablespoon of olive oil, a pinch of salt, and black pepper.
Arrange the chicken breasts in the center of a baking dish and place the halved potatoes around them.
Sprinkle the grated Parmesan cheese evenly over the chicken and potatoes.
Bake in the preheated oven for 25 minutes. After 25 minutes, check the chicken for doneness; it should reach an internal temperature of 165°F (75°C). If needed, continue cooking for an additional 5-10 minutes until fully cooked and the cheese is golden.
Once done, remove from the oven and let rest for a few minutes before serving.
Garnish with fresh parsley if desired, and serve the chicken and potatoes warm.