Tom Edwards Amazon Alexa Voice Summit Keynote & Interview

I recently had the privilege to deliver the Evolution of Experience keynote during the 2018 Amazon Alexa Voice Summit in Newark, NJ.

For this event, I tailored the Evolution of Experience, E^3 talk tied to  EmpowerExponential and Enhanced to focus on the voice ecosystem,  the camera as a platform, multi-modal, and how artificial intelligence and the Pixar Theory is the key to understanding the proxy web.

During the event, I also had the opportunity to sit down with the Amazon Alexa Community Evangelist team during their live Twitch stream. We discussed the ever-evolving role of voice-based experiences, war stories, thoughts on finding voice talent, the importance of data, strategy & analytics to enhance longer-term skill engagement and much more.

Also, I have recorded a podcast with the AI Today team that will debut in early August diving deeper into these topics and more. Stay tuned!

Follow Tom Edwards @BlackFin360

CX Future = Voice + Visual

I have written articles and commented quite a bit about Amazon Alexa and voice based conversational experiences in the media over the past 12 months.

To date there are over 10 million Alexa powered devices in consumer homes and that number is about to increase significantly with Alexa Voice Services integrating in everything from cars such as Ford Sync 3 system to mobile handsets.

Here is an example of Alexa integrated into the Ford Sync 3 system rolling out in various Ford models this fall. 

Regarding Alexa skills, skills are to Alexa like apps are to mobile, when I first met with the Amazon Alexa partner team a year ago there were barely 1,000 skills published. As of today there are over 10,000 with that number continuing to increase.

In addition to skills the shift towards voice based experiences has already begun. In 2014, voice search traffic was negligible. Today it exceeds 10% of all search traffic and virtual assistants exceed 50B voice searches per month.

That number is going to continue to accelerate as it’s projected by 2020 to be over 200 billion searches per month will be done with voice. Quickly voice will be a key horizontal channel and central to a converged user experience.

Screenshot 2017-03-15 21.41.59

What most don’t realize though is that while most experiences today are zero UI/voice only experiences, the next evolution of voice based systems will be voice + paired visual experiences.

This will ultimately be driven by new hardware that integrates screens, but initially will be driven by responsive web experiences that are powered by Alexa and hands free.

Soon virtual assistants such as the Sony XPERIA Agent shown here at MWC 2017 will have integrated screens to enhance voice + visual.

Voice based skills will be able to showcase information visually by aligning the voice intents with visual queues to create a voice controlled experience that is seamless and enhances the experience.

From highlighting dynamic content to video content, an Alexa skill can easily answer a query and showcase solutions that highlight complex solutions or highly visual elements such as what a recipe should actually look like vs. having to visualize it in ones mind.

Visual queues on the page can also enhance what a user can do with Alexa such as highlighting other related intents such as repeat, help, next steps etc… via a responsive web experience.

This is one of the challenges with pure voice experiences as the user doesn’t always know what their options are to to further engage different aspects of a given skill.

Voice + Visual can also enhance long term engagement which is currently the biggest barrier of Alexa experiences. By considering visual + voice content it is feasible to extend into more entertainment mediums that can be controlled and enhanced via voice.

Voice + Visual also has an impact on the type of data that can be gleaned from progressive profiling and opens up new ways to deploy existing content assets into a system based/virtual assistant driven journey.

I have literally seen the future through a first of it’s kind example of voice (Alexa) + visual (Responsive web) and it is mind blowing. I can’t show it publicly yet but it will reframe your approach to voice based strategy.

Will update this post once the 1st voice + paired visual experience skill is published shortly with visuals.

Follow Tom Edwards @BlackFin360

Amazon Alexa & Voice User Experiences

Since it first arrived at my home nearly a year ago I have been hooked on the the Amazon Echo and the potential of voice based user experiences. This week I spent time in Seattle at Amazon HQ meeting with the Alexa partner team discussing everything from voice UX best practices, skills development for the Alexa and more.

Photo Jul 19, 9 07 00 AM

To recap, the Echo and it’s cloud supported voice based engine Alexa have been in development for the last 6 years. Since it’s initial launch the devices that comprise the echo ecosystem are regularly sold out and based on the nearly 40,000 stellar customer reviews  (4.5 stars) the experience is resonating with it’s users.

Photo Jul 19, 9 09 42 AM

The core of the experience is a combination of automated speech recognition, natural language processing and a cloud based AI that comprise a voice based user experience. Voice UX is another example of a conversational experience and will become pervasive over the next few years.

Photo Jul 19, 9 11 56 AM

As with most artificial intelligence entities, learning new skills is how personalized and contextual experiences will be created. With Alexa It is possible to “teach” alexa new conversational elements and interactions through developing skills.

Photo Jul 19, 9 26 05 AM

An analogy would be when Neo in the Matrix “learns” kung fu through a knowledge/skill upload. In a similar way Alexa may not be able to learn Kung Fu, at least not yet, but it is possible to build highly engaging voice based experiences.

f22c50f29387e1461274eb73ae3a329e97e3aa09ac8dffee9218e017cd6c8b99

Developing Skills for Alexa is one of the quickest ways for brands to connect with the rapidly growing audience that calls upon Alexa to empower their daily lives. Brands such as Dominos and Capital One have already launched skills to capitalize on being the first to own certain invocation phrases. With the Dominos skill a user can order a pizza and track their order through Alexa.

Screenshot 2016-07-21 15.27.44

Skills are comprised of a Skill Interface and a Skill Service. The Skill Interface is how the Voice User Experience is configured. This includes invocation and utterance phrases from the user as well as the mapping of intent schemas scored and resolved by the Skill Service. This is how Alexa is trained to resolve a users spoken word and connect it with a users intent and resolved into action.

Screenshot 2016-07-19 13.30.29

One of the benefits of Alexa is that the experiences can persist beyond a single session. Even though the experiences may seem ephemeral by nature, the fact is Skills can be created that persist across sessions. This could be hours or days.

Screenshot 2016-07-19 11.43.36

The other benefit is that all invocations and interactions are mapped to cards in the Alexa companion app. This is one way that brands can connect a skill interaction with mobile and digital campaigns.

Screenshot 2016-07-19 13.33.01

Other benefits for brands is that it is possible to deep link to skills within the Alexa companion app for those looking to connect omnichannel communication and messaging to drive discoverability of the skill.

One of the key points for brands to consider is the role being “first” can play when it comes to user invocation terms. Brands that align with non-trademarked terms such as “laundry” will be the first in the order of how skills are discovered. This is key as the Alexa engine expands beyond the Echo with Amazon Voice Services.

Photo Jul 19, 9 33 12 AM

Looking to the near future there will be 45 million connected homes by 2017 and connected car penetration will be over 60 million cars by 2020. The role that Alexa will play in the coming years will go well beyond the Echo, Dot, Tap & the Fire Stick and extend into other form factors through the portable Amazon Alexa Voice Service.

Photo Jul 19, 9 07 41 AM (1)

An example is the connected car partnership between Ford & Amazon to further connect Alexa. This is where the platform will create scale across the ever growing IOT ecosystem.

Ford

Future posts will cover emerging trends tied to Voice Based User Experiences such as the infinitely wide top level UI, definitive choices, automatic learning, proactive explanation as well as user punctuation. For additional questions or assistance with Alexa Skills please follow Tom Edwards @BlackFIn360