r/Office365
AI on Microsoft 365 mail and OneDrive: how do you judge whether the answers are any good?
- upvotes
- 2
- comments
- 4
Post
A few people on my team tried an AI assistant on their mailbox and OneDrive. The feedback is mixed: sometimes it finds exactly the right thread, sometimes it misses the one email that matters or ignores a file that was there all along. How do you evaluate this in practice? - Do you write a set of real questions and check each answer against the source? - What do you count as a miss? - What would make you stop a pilot after two weeks? I would like to set up something more systematic than "it feels useful". Any method you have used is welcome.
Extracted from these lines
[comment u/TakkataMSF] I use Copilot to trace conversations I've had with folks. It's done a great job every time I've checked.
[comment u/TakkataMSF] To find the last known communication with someone via Teams or Email or in support tickets, I had to ask it to "trace" the conversation.