New Gardener, Used Exclusively Compost, Now Garden Stunted?

Hey guys, this is kind of two questions I guess.

So last year I moved into my first house (yay) that has a garden (mega yay!) and was incredibly excited to finally have one as for years I’ve been flat living and making do with a balcony and some pots.

Planned it out, made some beds, planted a few plants, fruit bushes and acers from local spots then went heavy on bulbs and bare roots from Gracy and waited.

Now everything’s growing, but on my daily dog walks I’ve been noticing that my garden is clearly behind every other one in the area in terms of growth and maturity. I’ve been trying to work it out and reasoned it’s because their gardens are more established as a lot of mine are new growth. Or the fact it’s West facing so only gets sun half the day, which means they have less energy… But then I read that planting in compost only is a bad idea and will overwhelm the new plants and I realised that’s exactly what I’ve done. So is that it?

I assume if that’s the case I wait till winter and mix in a load of topsoil to even it out and hope next year it’s fine? Or will it fix itself with time? Or is a complete write off?