Submitted by bikeskata t3_10rqe34 in MachineLearning

Official blog post: https://www.microsoft.com/en-us/microsoft-365/blog/2023/02/01/microsoft-teams-premium-cut-costs-and-add-ai-powered-productivity/

Given the amount of money they pumped into OpenAI, it's not surprising that you'd see it integrated into their products. I do wonder how this will work in highly regulated fields (finance, law, medicine, education).

455

Comments

You must log in or register to comment.

djc1000 t1_j6xb9r4 wrote

It’s really interesting to see how companies are trying to productize ai. The teams features seem both powerful, and a total waste of a billion dollar language model. I hope we start to see better.

62

Imonfire1 t1_j6xdmox wrote

I hope they use ChatGPT and Copilot to finally make a working version of Teams on Linux.

434

Nhabls t1_j6xea7p wrote

Integrating cut down version of GPTs into premium products.. more or less what was obvious to come from this.

2

Nhabls t1_j6xemzb wrote

GPT-3 didn't cost a billion to train

It does cost a LOT of money to run, which is why you're unlikely to "see better" for the short and medium term future. Unless you're into paying hundreds to thousands per month for this functionality

26

IWantAGrapeInMyMouth t1_j6xfc23 wrote

Hope this finds you well,

Machine learning can facilitate the use of managerial buzzwords by enabling natural language processing algorithms to identify and categorize key phrases and terminology commonly used in management and corporate settings. This can facilitate the generation of buzzword-rich language in real-time, empowering individuals to communicate more effectively and authentically within a business context. Additionally, machine learning can also be leveraged to analyze large datasets, identifying emerging buzzwords and trends in management speak, thus allowing individuals to stay ahead of the curve and stay relevant in the constantly evolving corporate landscape.

Best,

[YOUR NAME]

(I'd say it's pretty much got it nailed)

77

votadini_ t1_j6xh47v wrote

It still doesn't make me want to use Teams.

9

Nhabls t1_j6xhm7v wrote

I don't think the billion was for gpt alone, it was to build out an entire AI ecosystem within azure and a big chunk of it was handed out as azure credits anyway

29

wintermute93 t1_j6xkyub wrote

Somehow this feels less impactful than I was thinking it would feel. I mean, Gmail has had sentence autocomplete suggestions for a long time now, and this is largely the same kind of thing.

4

ISitAndWatch t1_j6xsbeh wrote

What do you mean ? It works ! It just sometimes completely forget some messages, sometimes fail to load an entire chat so I have to restart the app, sometimes crash without reason, sometimes audio refuses to work in video calls... But it launches ! I call that working by Microsoft standards.

19

LeanderKu t1_j6y7cge wrote

I actually find automatically generating notes to be a smart and useful application. I often have 1 on 1 remote meetings and I find it difficult to both present and discuss my work while also taking notes. It often happens to me that I focus on something so that I forget I should also take notes, which I then notice a week later when I have forgotten half of the tasks. If it would work reliably then I can imagine it to be a very useful addition.

I have never used teams though, everything's on zoom.

47

ReginaldIII t1_j6ybiju wrote

This isn't being used for autocomplete or any user text generation purposes though.

They're using it to summarize and make todo lists from the Whisper extracted transcripts of video meetings. Users aren't getting a frontend to run arbitrary stuff through the model. Seems like a pretty legitimate use case.

20

bigabig t1_j6yc5gr wrote

Is the automatic transcription done with openai whisper?

3

AristosTotalis t1_j6ye5hn wrote

yep. $1B in cash but they have to use Azure as their exclusive compute cloud compute provider, which Microsoft probably sells to OAI at ~cost

I think it' safe to assume that 2/3 of that will go towards training & inference, and if you also assume M doesn't make nor lose money selling compute (and in fact they get to strengthen Azure as a cloud infra player), they really only paid ~$300M to invest in OAI at what seems like a great price in hindsight

6

ThunderySleep t1_j6yhxqd wrote

Got to be honest, the biggest thing I'm not looking forward to is every vapid person with a bogus job being able to write as though they're an intelligent important person. Like how Grammarly allowed dumb people to hide the fact that they can barely read and write.

27

LetterRip t1_j6yj4z2 wrote

GPT-3 can be quantized to 4bit with little loss, to run on 2 Nvidia 3090's/4090's (Unpruned, pruned perhaps 1 3090/4090). At 2$ a day for 8 hours of electricity to run them, and 21 working days per month. That is 42$ per month (plus amortized cost of the cards and computer to store them).

3

Sirisian t1_j6yja6v wrote

Part of this is about brand identity also. Even if a technology isn't perfect some companies try to get in early. This is similar to virtual reality and mixed reality trends. The industry sees an inevitable future and want to be the name people think of. If one assumes gradual improvements until ~2045, then this is long-term planning. (Or short-term depending on improvements expected. It's possible MS has insider information that skews their motives).

3

Nhabls t1_j6ymx0w wrote

I seriously doubt they have been able to do what you just described.

Not to mention a rented double gpu setup, even the one you described would run you into the dozen(s) of dollars per day, not 2.

7

GoOsTT t1_j6yw29l wrote

I’m one of the lucky ones and it has not really acted up for me just yet but one of my teammates is going through nightmares with it and it hurts me to see him suffer.

On the other hand it is a really nice piece of software which makes its flaws even harder to fathom honestly.

−3

bumbo-pa t1_j6yw62b wrote

You mean the app? I did get a meaningful update in the flatpak not so long ago before I switched to browser

Edit: oh yeah seems you're right, and just around the time I quit

5

keisukegoda3804 t1_j6z5ppy wrote

This is devastating to startups in the meeting transcription market. Solutions like Otter and Fireflies cost $15-20 per month and only have a fraction of the featureset of Teams Premium. Really interested to see how this develops.

24

visarga t1_j6zapcm wrote

That's why I keep pen and notebook open in front of my keyboard at all times, I take light notes during meetings and use it as scratchpad when I am thinking. I can fill 100 pages in a month, almost never re-read except for meeting notes.

2

visarga t1_j6zb9em wrote

Many AI teams are scrambling now to label data with GPT-3 and train their small efficient models from GPT-3 predictions. This makes the hard part of data labelling much easier, speeds up development 10 times. In the end you get your cheap & fast models that work about as good as GPT-3 but only on a narrow task.

7

HipposWild t1_j6zczw8 wrote

How many gpus does that take to run?

1

LeumasInkwater t1_j6zdg60 wrote

Honestly all the GPT stuff they are introducing seems pretty useful.

I like the idea of having automatic tasks generated after a meeting. I usually jot down 'follow-up' items while in meetings, and send them out to relevant coworkers afterward. It would only save me 5 minutes or so after every call, but could maybe help me focus more on what's being said rather than writing everything down 🤷‍♂️.

Also flagging parts of a meeting that you missed, auto-chapters, and tagging sections by the speaker all seem genuinely helpful.

That being said, my company doesn't use Microsoft products, so I hope to see features like this come to other platforms.

9

ojdajuiceman25 t1_j6zvjpr wrote

My job got a demo a couple months back and some of the capabilities are incredible. The live translation might really be a game changer

1

justowen4 t1_j70hxwf wrote

Site is down; Microsoft was never expecting more than a few people to read their blog

2

labloke11 t1_j70xxja wrote

So.... your meeting transcript becomes part of gpt's training dataset. No Thanks!

0

singularineet t1_j710h53 wrote

No matter how hard they try to whack-a-mole them, the biases of the model will come through, particularly by omission. Example? It's super bad about minimizing Jewish history, or saying awful things about the Holocaust like that it was harmful to both the victims and the perpetrators. It's basically like working with a raging racist who's trying to follow a list of very specifically worded instructions from a woke but low functioning autistic HR dept.

0

visarga t1_j712mwb wrote

My task is in the NLP space, maybe that makes it more approacheable - information extraction from semistructured documents. I can do extraction from existing documents with GPT-3 (question answering) or I can generate new data with known tags.

1

ooonurse t1_j71mt0q wrote

In fairness, every single time I've seen someone use grammarly they were extremely intelligent people with English as their second or third language. I also know one person who uses it because of dyslexia, which has nothing to do with intelligence. Be careful about shaming people for using software commonly used for accessibility.

1

cunth t1_j71ocf6 wrote

Not sure about the above claim, but you can train a GPT2 model in 38 hours for about 600 bucks on rented hardware now. Costs are certainly coming down.

1

cunth t1_j71ovks wrote

Getting a good data set to train a model is usually the most time-consuming task. You need breadth amd depth of content so your model doesn't overfit and work for just a handful of narrow use cases.

Supervised learning algorithms need labeled data (e.g. classification tags) and this is traditionally done with people. If that can be done with AI, you can complete this 100x faster and probably more accurately.

1

[deleted] t1_j739mc4 wrote

CLIPPY MAKES HIS GLORIOUS RETURN!!?!?!!!!

ALL HAIL CLIPPY THE AI SENTIENT SUPER GOD

2

DM-me-ur-tits-plz- t1_j73n2dw wrote

When they originally went closed-source they claimed it was because of the dangers that being open-sourced presented.

About a year later they dropped their non-profit status and sold out to Microsoft.

Love the company, but that's some crazy double speak there.

2

Arthropodesque t1_j75ls38 wrote

Maybe it's so the devs can get used to working with AI Assitance. It will be an experiment to overhaul a software with AI Assistance. This is the future.

We can rebuild him: Stronger Faster

The 10 Billion Dollar Man that will then be an asset that can increase productivity 20% as of now, but will get exponentially better.

1

7734128 t1_j7aioqq wrote

Our school held some lectures over teams during the pandemic. There's a pop-up each time someone tries to enter a teams meeting, which is annoying in normal cases but disastrous when there's 200+ participants.

1

DustinKli t1_j7p03xt wrote

I'm still waiting for GPT to be integrated into EXCEL.

2