What is causing this damage to my chilies?

(This is located in North QLD) every chilli in my garden as soon as it begins to turns ripe gets this same kind of damage. It’s not birds as they are excluded with netting, i was thinking caterpillars or possibly Queensland fruit fly. The strange thing is i open them up and never find a caterpillar or fruit fly maggots just rot from the being exposed. Any ideas on what could be causing this and how i could remedy the issue?

internal damage

external damage