Microsoft Cognitive Services provides a wide range of cool tools. They are all available via API. Sitecore continues to evolve. It’s no longer just a content management system. It’s evolving into a content learning system.
The Sitecore Symposium 2017 presenter took an image and uploaded it and had it analyzed. It understood that it was a female about age 24. It unlocks your Media Library. Now you can do a faceted image search. You can search, filter, explore, match content, etc. Content editors should rejoice.
There are a number of use cases:
- Manage User Generated Content
- Automatically filter out violence, nudity, etc.
- Be smart enough to initiate a human review
- Custom Vision Service
- Upload labeled images
- Identify logos
- Help the tool to continually improve on your content
- Language Parsing
- Parsing
- Language detection
- Translation
- Transcription
- Audio to text
- text to audio
- transcribe video
- Bot Framework
- Enhanced search
- Multilingual support
- Accessibility implications, better support those with special needs
- Sitecore now has “Ole” This is like Cortana and Alexa.
- Recommendations Engine
- Recommended Content
- Get better customer engagement
- Do commerce integration with it
- Labs in process
- Location, events,
- Time, distance
- Routing logistics
- Gesture Controls
Demo Time
The presenter did this from Sitecore:
- Start in the Media Library and upload an image.
- On upload, it does analysis
- It capture faces in visual analysis. Includes confidence indicators
- Also will tell you if it’s “adult” or racy content
- Tells you the colors. Imaging now searching for pictures in a color scheme
- Can learn well known and not so well known people and identify them
- Emotional analysis: Is it angry, happy, sad, etc.?
- Facial analysis: show facial hair, etc. (lots of metadata here)
- Textual analysis: Read text out of an image. It knows where and what the text is.
- The image text is now searchable.
- Jump into experience editor, open a rich text field and add an image
- Pop into image search.
- Do a lot of searches. They were really well tagged.
- He then searched by facets:
- Size, gender, glasses, age, emotion, etc.
- The facets are VERY interesting.
- Ole – the new chat tool
- He asked Ole what version he is. (Sitecore v 8.2)
- You can still publish content.
- This is different from command line. It’s a conversation. You can ask the same question multiple ways with slightly different syntax and it will get it right.
- He showed a publish use case. He gave the path, channel, database, etc. and voila, it’s published.
- Also asked about how many locked items were there and then unlocked five items.
- Think about any user just telling the system to do something. That’s a huge change.
What Is Involved?
This is a true framework and not a hack job. Mark Stiles wants to let us know it’s available now on Git Hub:
- GitHub.com/markstiles/SitecoreCognitiveServices
- markstiles.net/blog
- @markstiles
It uses the Helix architecture and he has a repository for each API. In the project layer, he provides code samples to help you get started.
Road Map
- More chat capabilities. It’s his focus right now. Make it more useful
- Marketplace modules
- TBD. Would love some input
- Eventually makes profit from it 😉
The Logo
And yes, Mark even has a logo for this. I’ll let you get the reference to an old Scifi TV show….
