Amazon Alexa
https://alexa.amazon.com/
Last updated
https://alexa.amazon.com/
Last updated
Amazon Alexa, also known simply as Alexa,[2] is a virtual assistant AI technology developed by Amazon, first used in the Amazon Echo smart speakers developed by Amazon Lab126. It is capable of voice interaction, music playback, making to-do lists, setting alarms, streaming podcasts, playing audiobooks, and providing weather, traffic, sports, and other real-time information, such as news.[3] Alexa can also control several smart devices using itself as a home automation system. Users are able to extend the Alexa capabilities by installing "skills" (additional functionality developed by third-party vendors, in other settings more commonly called apps such as weather programs and audio features).
Most devices with Alexa allow users to activate the device using a wake-word (such as Alexa or Amazon); other devices (such as the Amazon mobile app on iOS or Android and Amazon Dash Wand) require the user to push a button to activate Alexa's listening mode, although, some phones also allow a user to say a command, such as "Alexa" or "Alexa wake". Currently, interaction and communication with Alexa are available only in English, German, French,[4] Italian, Spanish, Portuguese, Japanese, and Hindi.[5] In Canada, Alexa is available in English and French (with the Quebec accent).[6][7]
As of November 2018, Amazon had more than 10,000 employees working on Alexa and related products.[8] In January 2019, Amazon's devices team announced that they had sold over 100 million Alexa-enabled devices.[9]
In September 2019, Amazon launched many new devices achieving many records while competing with the world's smart home industry. The new Echo Studio became the first smart speaker with 360 sound and Dolby sound. Other new devices included an Echo dot with a clock behind the fabric, a new third-generation Amazon Echo, Echo Show 8, a plug-in Echo device, Echo Flex, Alexa built-in wireless earphones, Echo buds, Alexa built-in spectacles, Echo frames, an Alexa built-in Ring, and Echo Loop.
In November 2014, Amazon announced Alexa alongside the Echo.[10] Alexa was inspired by the computer voice and conversational system on board the Starship Enterprise in science fiction TV series and movies, beginning with Star Trek: The Original Series and Star Trek: The Next Generation.[11]
Amazon developers chose the name Alexa because it has a hard consonant with the X, which helps it be recognized with higher precision. They have said the name is reminiscent of the Library of Alexandria, which is also used by Amazon Alexa Internet for the same reason.[12][13][14] In June 2015, Amazon announced the Alexa Fund, a program that would invest in companies making voice control skills and technologies. The US$200 million fund has invested in companies including Jargon, Ecobee, Orange Chef, Scout Alarm, Garageio, Toymail, MARA, and Mojio.[15] In 2016, the Alexa Prize was announced to further advance the technology.
In January 2017, the first Alexa Conference took place in Nashville, Tennessee, an independent gathering of the worldwide community of Alexa developers and enthusiasts.[16][17][18] The follow-up has been announced with a new name, Project Voice, and will be keynoted on the first day with Amazon's Head of Education for Alexa, Paul Cutsinger.[19]
At the Amazon Web Services Re: Invent conference in Las Vegas, Amazon announced Alexa for Business and the ability for app developers to have paid add-ons to their skills.
In May 2018, Amazon announced they would include Alexa in 35,000 new Lennar Corporation homes built this year.[20]
In November 2018, Amazon opened its first Alexa-themed pop-up shop inside of Toronto's Eaton Centre, showcasing the use of home automation products with Amazon's smart speakers.[21] Amazon also sells Alexa devices at Amazon Books and Whole Foods Market locations, in addition to mall-based pop-ups throughout the United States.
In April 2019, Amazon announced the expansion of Alexa to Brazil, in Portuguese, together with Bose, Intelbras, and LG.[22]
A companion app is available from the Apple Appstore, Google Play, and Amazon Appstore. The app can be used by owners of Alexa-enabled devices to install skills, control music, manage alarms, and view shopping lists.[23] It also allows users to review the recognized text on the app screen and to send feedback to Amazon concerning whether the recognition was good or bad. A web interface is also available to set up compatible devices (e.g., Amazon Echo, Amazon Dot, Amazon Echo Show).
Alexa can perform a number of preset functions out-of-the-box such as set timers, share the current weather, create lists, access Wikipedia articles, and many more things.[24] Users say a designated "wake word" (the default is simply "Alexa") to alert an Alexa-enabled device of an ensuing function command. Alexa listens for the command and performs the appropriate function, or skill, to answer a question or command. Alexa's question answering ability is partly powered by the Wolfram Language.[25] When questions are asked, Alexa converts sound waves into text which allows it to gather information from various sources. Behind the scenes, the data gathered is then parsed by Wolfram's technology to generate suitable and accurate answers.[26] Alexa-supported devices can stream music from the owner's Amazon Music accounts and have built-in support for Pandora and Spotify accounts.[27] Alexa can play music from streaming services such as Apple Music and Google Play Music from a phone or tablet.
In addition to performing pre-set functions, Alexa can also perform additional functions through third-party skills that users can enable.[28] Some of the most popular Alexa skills in 2018 included "Question of the Day" and "National Geographic Geo Quiz" for trivia; "TuneIn Live" to listen to live sporting events and news stations; "Big Sky" for hyper local weather updates; "Sleep and Relaxation Sounds" for listening to calming sounds; "Sesame Street" for children's entertainment; and "Fitbit" for Fitbit users who want to check in on their health stats.[29] In 2019, Apple, Google, Amazon, and Zigbee Alliance announced a partnership to make smart home products work together.[30]
As of April 2019, Amazon had over 90,000 functions ("skills") available for users to download on their Alexa-enabled devices,[31] a massive increase from only 1,000 functions in June 2016.[32] Microsoft's AI Cortana became available to use on Alexa enabled devices as of August 2018.[33] In 2018, Amazon rolled out a new "Brief Mode," wherein Alexa would begin responding with a beep sound rather than saying, "Okay," to confirm receipt of a command.[34] On December 20, 2018, Amazon announced a new integration with the Wolfram Alpha answer engine,[35] which provides enhanced accuracy for users asking questions of Alexa related to math, science, astronomy, engineering, geography, history, and more.
In the home automation space, Alexa can interact with devices from several manufacturers including SNAS, Fibaro, Belkin, ecobee, Geeni, IFTTT,[36] Insteon, LIFX, LightwaveRF, Nest, Philips Hue, SmartThings, Wink,[37][38] and Yonomi.[39] The Home Automation feature was launched on April 8, 2015.[40] Developers are able to create their own smart home skills using the Alexa Skills Kit.
In September 2018, Amazon announced a microwave oven that can be paired and controlled with an Echo device. It is sold under Amazon's AmazonBasics label.[41]
Take-out food can be ordered using Alexa; as of May 2017 food ordering using Alexa is supported by Domino's Pizza, Grubhub, Pizza Hut, Seamless, and Wingstop.[42] Also, users of Alexa in the UK can order meals via Just Eat.[43] In early 2017, Starbucks announced a private beta for placing pick-up orders using Alexa.[44] In addition, users can order meals using Amazon Prime Now via Alexa in 20 major US cities.[45] With the introduction of Amazon Key in November 2017, Alexa also works together with the smart lock and the Alexa Cloud Cam included in the service to allow Amazon couriers to unlock customers' front doors and deliver packages inside.[46]
According to an August 2018 article by The Information, only 2 percent of Alexa owners have used the device to make a purchase during the first seven months of 2018 and of those who made an initial purchase, 90 percent did not make a second purchase.[47]
Alexa supports a multitude of subscription-based and free streaming services on Amazon devices. These streaming services include: Prime Music, Amazon Music, Amazon Music Unlimited, Apple Music, TuneIn, iHeartRadio, Audible, Pandora, and Spotify Premium. However, some of these music services are not available on other Alexa-enabled products that are manufactured by companies external of its services. This unavailability also includes Amazon's own Fire TV devices or tablets.[48]
Alexa is able to stream media and music directly. To do this, Alexa's device should be linked to the Amazon account, which enables access to one's Amazon Music library, in addition to any audiobooks available in one's Audible library. Amazon Prime members have an additional ability to access stations, playlists, and over two million songs free of charge. Amazon Music Unlimited subscribers also have access to a list of millions of songs.
Amazon Music for PC allows one to play personal music from Google Play, iTunes, and others on an Alexa device. This can be done by uploading one's collection to My Music on Amazon from a computer. Up to 250 songs can be uploaded free of charge. Once this is done, Alexa can play this music and control playback through voice command options.
Amazon Alexa allows the user to hear updates on supported sports teams. A way to do this is by adding the sports team to the list created under Alexa's Sports Update app section. [49]
The user is able to hear updates on up to 15 supported teams:[49]
MLS - Major League Soccer
EPL/BPL - English Premier League/Barclays Premier League
NBA - National Basketball Association
NCAA men's basketball - National Collegiate Athletic Association
UEFA Champions League - Union of European Football Association
FA Cup - Football Association Challenge Cup
MLB - Major League Baseball
NHL - National Hockey League
NCAA FBS football - National Collegiate Athletic Association: Football Bowl Subdivision
NFL - National Football League
German Bundesliga 2nd Division
WNBA - Women's National Basketball Association
German Bundesliga 1st Division
There are a number of ways messages can be sent from Alexa's application. Alexa can deliver messages to a recipient's Alexa application, as well as to all supported Echo devices associated with their Amazon account. Alexa can send typed messages only from Alexa's app. If one sends a message from an associated Echo device, it transmits as a voice message. Alexa cannot send attachments such as videos and photos.[50]
For households with more than one member, one's Alexa contacts are pooled across all of the devices that are registered to its associated account. However, within Alexa's app one is only able to start conversations with its Alexa contacts.[51] When accessed and supported by an Alexa app or Echo device, Alexa messaging is available to anyone in one's household. These messages can be heard by anyone with access to the household. This messaging feature does not yet contain a password protection or associated PIN. Anyone who has access to one's cell phone number is able to use this feature to contact them through their supported Alexa app or Echo device. The feature to block alerts for messages and calls is available temporarily by utilizing the Do Not Disturb feature.[52]
Alexa for Business is a paid subscription service allowing companies to use Alexa to join conference calls, schedule meeting rooms, and custom skills designed by 3rd-party vendors.[53] At launch, notable skills are available from SAP, Microsoft, and Salesforce.[54]
This feature was included in February 2020, in which the digital assistant can notify the user when a severe weather warning is issued in that area.[55][56]
This new voice control skill was included in February 2020, through which Alexa can update the users about their commute, traffic conditions or directions.[55] It can also send the information to user's phone.[56]
Amazon allows developers to build and publish skills for Alexa using the Alexa Skills Kit known as Alexa Skills.[57] These third-party-developed skills, once published, are available across Alexa-enabled devices. Users can enable these skills using the Alexa app.
A "Smart Home Skill API"[58] is available, meant to be used by hardware manufacturers to allow users to control smart home devices.[59]
Most skills run code almost entirely in the cloud, using Amazon's AWS Lambda service.[60]
In April 2018, Amazon launched Blueprints, a tool for individuals to build skills for their personal use.[61]
In February 2019, Amazon further expanded the capability of Blueprints by allowing customers to publish skills they've built with the templates to its Alexa Skill Store in the US for use by anyone with an Alexa-enabled device.[62]
Amazon allows device manufacturers to integrate Alexa voice capabilities into their own connected products by using the Alexa Voice Service (AVS), a cloud-based service that provides APIs to interface with Alexa. Products built using AVS have access to Alexa's growing list of capabilities including all of the Alexa Skills. AVS provides cloud-based automatic speech recognition (ASR) and natural language understanding (NLU). There are no fees for companies looking to integrate Alexa into their products by using AVS.[63]
The voice of Amazon Alexa is generated by a long short-term memory artificial neural network.[64][65][66]
On September 25, 2019 Alexa and Google Assistant can help their users apply to jobs at McDonald's using voice recognition services. It is the world's first employment service using voice command service. The service is available in the United States, Canada, Spain, France, Ireland, Germany, Italy and the United Kingdom.[67]
Amazon announced on the September 25, 2019 that Alexa will soon be able to mimic celebrities voices including Samuel L. Jackson, costing $0.99 for each voice.[68]
In 2019, Alexa started replying to Spanish voice commands in Español.[69]
Main article: Amazon Lex
On November 30, 2016 Amazon announced that they will make the speech recognition and natural language processing technology behind Alexa available for developers under the name of Amazon Lex. This new service would allow developers to create their own chatbots that can interact in a conversational manner, similar to Alexa. Along with the connection to various Amazon services, the initial version will provide connectivity to Facebook Messenger, with Slack and Twilio integration to follow.[70][71]
See also: internet privacy, right to information, Katz v. United States, and right to privacy
There are concerns about the access Amazon has to private conversations in the home and other non-verbal indications that can identify who is present in the home with non-stop audio pick-up from Alexa-enabled devices.[72][73] Amazon responds to these concerns by stating that the devices only stream recordings from the user's home when the 'wake word' activates the device.
Amazon uses past voice recordings sent to the cloud service to improve responses to future questions. Users can delete voice recordings that are associated with their account.
Alexa uses an address stored in the companion app when it needs a location.[74] For example, Alexa uses the user's location to respond to requests for nearby restaurants or stores. Similarly, Alexa uses the user's location for mapping-related requests.
Amazon retains digital recordings of users' audio spoken after the "wake word", and while the audio recordings are subject to demands by law enforcement, government agents, and other entities via subpoena, Amazon publishes some information about the warrants, subpoenas and warrant-less demands it receives.[75]
In 2018, Too Many T's, a hip hop group from London, received international media attention by being the first artists to feature Amazon Alexa as rapper and singer.[76]
In 2019, a British woman reported that when she asked Alexa for information about the cardiac cycle, it asked her to stab herself in the heart to stop human overpopulation and save the environment. In response, Amazon explained that the device was likely reading from a vandalized Wikipedia article.[77]
In early 2018, security researchers managed to turn an Echo into a spy device[78] by creating a malicious Alexa Skill that could record unsuspecting users and send the transcription of their conversations to an attacker.[79]
In November 2018, Amazon sent 1700 recordings of an American couple to an unrelated European man. The incident proves that Alexa records people without their knowledge.[80] Although the man who received the recordings reported the anomaly to Amazon, the company did not notify the victim until German magazine c't also contacted them and published a story about the incident. The recipient of the recordings contacted the publication after weeks went by following his report with no response from Amazon (although the company did delete the recordings from its server). When Amazon did finally contact the man whose recordings had been sent to a stranger, they claimed to have discovered the error themselves and offered him a free Prime membership and new Alexa devices by way of apology.[81]
Amazon blamed the incident on "human error" and called it an "isolated single case." However, in May 2018 an Alexa device in Portland, Oregon, recorded a family's conversation and sent it to one of their contacts without their knowledge. The company dismissed the incident as an "extremely rare occurrence" and claimed the device "interpreted background conversation" as a sequence of commands to turn on, record, send the recording, and select a specific recipient.[82]
Alexa has been known to listen in on private conversations[83] and store personal information which was hacked and sent to the hacker. Although Amazon has announced that this was a rare occurrence, Alexa shows the dangers of using technology and sharing private information[84] with robotics.
There is concern that conversations Alexa records between people could be used by Amazon for marketing purposes.[85] Privacy experts have expressed real concern about how marketing is getting involved in every stage of people's lives without users noticing. This has necessitated the creation of regulations that can protect users' private information from technology companies.
A New Hampshire judge ruled in November 2018 that authorities could examine recordings from an Amazon Echo device recovered from the home of murder victim Christine Sullivan for use as evidence against defendant Timothy Verrill. Investigators believe that the device, which belonged to the victim's boyfriend, could have captured audio of the murder and its aftermath.[86]
During the Chris Watts interrogation/interview video[87] at timestamp 16:15:15, Watts was told by the interrogator, "We know that there's an Alexa in your house, and you know those are trained to record distress," indicating Alexa may send recordings to Amazon if certain frequencies and decibels (that can only be heard during intense arguments or screams) are detected.
