To cut or not to cut?

I had a Rosemary bush growing in my yard that I turned into a Bonsai. Tbh it look’s kinda blah. (I imagined something totally different). So my question is, should I cut off the upright branch or not?