Tylenol is well recognized to cause upset stomach. Vitamin C and D, iron, and fish oil can all upset your stomach, as well. Your multivitamin prob has C and D, others would have iron too.

Generally, consuming pills with acidic ingredients on an empty stomach means they are not being diluted, and the environment becomes more acidic than your body is happy with.