Totally depends on the context really. It could be that he just doesn't see himself as a lady's man and is happy you like him for who he is. Or it could be that he's going to be super controlling and will flip out if you attention goes elsewhere.