Microsoft’s New Future of Work Report 2023 is 100% focused on LLMs and contains interesting research and usage-based insights into how they are being used to improve people’s work.
One of our focus areas is how GenAI can and is changing the user experience. What should good conversational experiences look and feel like as we move from keyword search and point-and-click behavior to iterative, natural language dialogues?
3 Things Caught My Attention in the Report
Bing Chat is frequently used for professional and more complex tasks
The data they report indicates that, by contrast with traditional search in Bing, users are taking advantage of the additional capabilities of LLM-powered conversational interfaces in Bing Chat for their knowledge work.
“Fast AI” and “Slow AI”: Different LLM experiences require different latencies
The time it takes for a user to see a response to an input is something anyone working on LLM-powered solutions is wrestling with. However, research on “Slow AI” can improve the LLM-based user experience by helping the user understand what is happening and how hey will benefit from the additional work being done for them.
Digital knowledge is moving from documents to dialogue
Yes, conversations are a form of data that can be looped back into a conversational system. But, the report asks, what exactly constitutes a “great conversation”? The AI Agent platform I’m working on looks at this from two angles: what is “good” for the user and what is “good” for the organization an AI agent represents. And how do intentions get mediated through the agent?