The short answer is that people did not knew the details and the scale but knew something really bad was happening to the Jews when they were sent East. German soldiers knew more since they were actors of parts of the holocaust, and knew that the death camps were a thing. As for what the average German felt if varied from person to person and is extremely difficult to tell.

For more specific answers this thread links to a lot of excellent answers.