Yes, take a look at Llama.cpp (you'll need a programming background to get it working). Even lighter models will likely come out in the future (look up stanford's alpaca, based on Llama). I'm assuming someone will also build more user friendly ways of doing this.