Conversational AI is top of mind for me. In the last two years, I built several bots based on the Microsoft Bot Framework to learn about it's capabilities.
Let me share some of my fun experiences and give you a overview what I've built and which cognitive skills the bots have.
First, lets have a look at the Conversation AI landscape available in Azure:
Meet my virtual helpers, equipped with a variety of cognitive skills:
Rusty v2 / Intelligent News Proposal
Rusty is listening to audio recording in Microsoft Teams and extracts the conversation transcript via video analyzer.
Based on text analytics and intention detection, the bot recommends to create an intranet news in SharePoint based on the voice conversation.
If the message contains sales win or new customer information, then the bot talks interactively to the user in a personal Microsoft Teams conversation.
Interactive rich notifications in Microsoft Teams
Adaptive Cards
Video Analyzer
Person Detection
Natural Language Understanding (LUIS)
Sentiment Analysis
SharePoint REST API
Microsoft Flow
Bot Framework 4
Node.js
Alfred the Butler / User Adoption Driver
Alfred ensures an smooth on- boarding to the corporate intranet for new employees. Thanks to his cognitive skills, he can detect bad mood in photos posted in Microsoft Teams and offer interactive help to the user.
Based on the users intention, a range of online training and resources is suggested.
Interactive rich notifications in Microsoft Teams
Webhooks
Message Cards / Carousel
Natural Language Understanding (LUIS)
Face API
Emotion Detection
Sentiment Analysis
Microsoft Flow
Bot Framework 3
Node.js
"Vesa Juvonen" Bot / Site Creator
Vesa is specialized in creating SharePoint Teamsites and Commsites based on the PnP framework.
Site options can be chosen in rich carousel in Microsoft Teams, options are sent to an Azure Function running PnP Powershell, then the site gets created and Vesa provides a success feedback with the new site url to the user.
Interactive rich notifications in Microsoft Teams
Webhooks
Message Cards / Carousel
Natural Language Understanding (LUIS)
Azure Functions
Azure Queue Storage
PnP Powershell
Microsoft Flow
Bot Framework 3
Node.js
Rusty / The Time Sheet Manager
Rusty is supporting the internal time sheet approval process with interactive reminders and helpful information to process documentation.
Interactive rich notifications in Microsoft Teams
Adaptive Cards
Bot Framework 4
Node.js
EDUCATO / Swiss Army Knife
From kitchen clothing orders to showing timetables or detect chicken breeds based on a custom vision model, this bot covers them all.
Created as demo for a keynote, which I did together with the Microsoft Education Team Switzerland to showcase intelligent capabilities in bots for the education sector.
Interactive rich notifications in Microsoft Teams
Adaptive Cards / Carousel
Custom Vision Integration
Bot Framework 4
C#