Viewing a single comment thread. View all comments

elehman839 t1_jcb9vwd wrote

I suspect Microsoft faces a conundrum:

  • They want to use GPT models to convince more people to use Bing in hopes of getting billions in ad revenue.
  • But operating GPT models is insanely compute-intensive. I bet every GPU they can find is already running cook-eggs hot, and they are asking employees to rummage around in toyboxes at home for old solar-powered calculators to get a few more FLOPs.
  • Given this compute situation, as more people use Bing, they will have to increasingly dumb down the underlying GPT model.
2