We get invaded by honey bees every so often. Too much yellow and red on the cart. We haven’t found anything that will deter them. Luckily we are screened in this year. Last year we just gently brushed them away. The honey bees we are dealing with are pretty docile. It sounds like you have what we always called yellow jackets. A bottle of sugar water seem to attract them.
Do a search for “wasp trap” or “wasp trap soda bottle” or “wasp trap recipe” on the internet.