Mushrooms randomly growing in herb planter

Hi all,

I am new to gardening. I planted some thyme, parsley and basil into this self watering pot I bought from bunnings. This pot sits inside a drop over green house I bought from ALDI and filled it with Garden Basics Premium Potting mix. Its been going great, but today I noticed random mushrooms growing (circled in cyan blue) in there with these yellow dots as well (circled in red). Can anyone please:

Explain what has happened If they are poison If I should just bin the entire soil/plant and start over.

Gardening Blog