Preheat the oven to 400°F (200°C).

In a mixing bowl, combine the halved baby potatoes, olive oil, oregano, salt, and black pepper. Toss to coat evenly.

Spread the seasoned potatoes in a single layer in a baking dish.

Place the block of feta cheese in the center of the potatoes.

Drizzle the lemon juice and sprinkle the lemon zest over the feta and potatoes.

Bake in the preheated oven for 35-40 minutes, or until the potatoes are tender and the feta is golden.

Remove from the oven and garnish with chopped fresh parsley before serving.