Oops, just checked the neighborhood message board. Someone must have called the cops because they came by and spoke with them. They showed the police some paperwork and they left them alone.

Still leaning towards light scam, but it would be interesting if someone says they were actually doing work at their house.