Definitely look into your towns bi-laws around development. I’m on my towns planning commission and here it would definitely be a violation to suddenly turn your property into a concert venu without permits and that review process is open to comments and concerns from neighbors. There are probably more tools at your disposal than you realize.