Intelligent Personal Assistants

From HCE Wiki - The Human Cognitive Enhancement Wiki
Revision as of 12:03, 9 January 2017 by Zuzana Rybaříková (talk | contribs) (Ethical & Health Issues)
Jump to navigation Jump to search
Cortana running on Windows 10

List of Intelligent Personal Assistants entries:

Intelligent personal assistants, also called virtual assistants, is software or a device that can assist the user with tasks, planning, or retrieving information similarly to a human assistant. This technology usually fully utilizes the sensors present on the device it runs on for contextual awareness. This way it can deliver more accurate and relevant information. Modern intelligent personal assistants are able to learn based on previous input so they can offer better, more personalized results to the user.

Personal assistants that are for the general consumer are, for example, the Apple Siri, Microsoft Cortana, or Amazon Echo. Advanced AIs that can also be utilized as intelligent personal assistants in some applications include for example the IBM Watson.

Main Characteristics

These assistants usually take a form of an app or a device that acts as an interface for the user. Through this interface, the user can issues queries and commands to the assistant software either by voice or by text. The user-end interface is able to understand natural language, retrieve relevant information from it, and pass the now parsed query to a server on which the actual assistant's software runs. The query is processed and appropriate information is retrieved, or action undertaken, and the result is sent back to the user interface where it is displayed by text and, often, read aloud using speech synthesis.

The software is usually found on personal, hand-held devices, mainly smartphones. The assistant then can be available at any time, provided there is connection to the Internet, as no processing is actually done on the device itself. The first widely available personal assistants software was Siri. There are many software personal assistant currently, e.g. Cortana, Google Now or Amazon Alexa.

The software personal assistants are also used in smart home kits, which also represents intelligent personal assistants. These devices process voice commands and controlled the smart home environment. The pathfinder of these devices was Amazon Echo but there is already shipped also Google Home.

Historical overview

Clippit

One of the earliest examples of a electronic personal assistant engine is the Apple's Knowledge Navigator[1] from 1987. John Sculley, then Apple CEO, demonstrated the vision of an artificial intelligence application that helps the user in an academic setting.[2] Sculley wanted something that would accompany his keynote speech and opted for a short "science-fiction" video from human-computer interaction researcher William Buxton. The group created a short video[3] showing their idea about what the interaction between the user and the virtual assistant may look like in the year 2011. The video was originally meant only as a showcase of technologies Sculley would highlight in his keynote but Apple liked the concept and created several sequels for marketing purposes.[4]

During 90' Microsoft introduced two personal assistants, Bob and Clippit.[5] Microsoft presented Microsoft Bob in 1995, as an assistant in their Windows 3.1 software. Microsoft Bob should have provided user friendlier environment, but it was also criticised and therefore it was removed from the later versions of their product.[6] Clippit, was introduced by Microsoft in their product Office 1997. It was intent to be users guide and assistant. Clippit was the default character. Customers could installed some other characters, but Clippit was a prevalent assistant. Although, it should have helped users of Microsoft Office, majority of users find it annoying and not helpful. There were also several parodies on this character.[7] Due to criticism of the customers and Clippit and other assistants were removed from Microsoft Office 2008.[5]

The first genuine intelligent personal assistant, which was publicly available, is Siri. A development of Siri was based on Defense Advanced Research Projects Agency (DARPA),namely the project CALO (Cognitive Assistant that Learns and Organizes). The aim of the program was to develop a software which could help military commanders with organisation. In 2003, they started a cooperation with SRI Inc., a non-profit research institute which was founded by Stanford University. The project was successful. They developed an artificial intelligence, which could process the required tasks. Moreover, these AI could learn in a real time from experience.[8] Their personal assistant was commercialised by Siri Inc. which developed Siri. Siri was acquired by Apple in 2010 and introduced as an app for iPhone 4s in 2011.[9] The introduction of Siri inspired the personal assistant of other companies as Google Now, Microsoft Cortana, and Amazon Alexa.[10]

The development of intelligent personal assistant's devices was based on the intelligent personal assistant's software. The first intelligent personal assistant's device was Amazon Echo, which use Amazon Alexa's speech syntheses. The device was unveiled 6th November 2014. Although it appears rather surprisingly,[11] it achieved a great success.[12] It was followed by the similar projects from other companies namely Google Home, Apple HomeKit or Mycroft.[10]

Purpose

Intelligent personal assistants is a software or a device that can assist the user in his daily activities, navigation, information retrieval and organization.

Important Dates

  • 1987 - Apple Knowledge Navigator was presented[1]
  • 1995 - Microsoft incorporated Bob in their Windows software[6]
  • 1996 - Clippit was introduced as a part of Microsoft Office 1997 software[7]
  • 4th February 2010 - Siri Inc. unveiled Siri[13]
  • 9th July 2012 - Google Now was released for smart devices with Android 4.1[14]
  • August 2014 - Microsoft released the beta version of Cortana[15]
  • 6th November 2014 - Amazon Echo was unveiled[11]
  • 9th May 2016 - Viv was introduced[16]
  • 4th October 2016 - Google Home was unveiled[17]

Enhancement/Therapy/Treatment

Personal assistants can greatly help user to effortlessly organize their activities or use online services as well ass aid in information retrieval. They are developed to solve a complex task and in that way enlarge the capabilities of their users. In addition, intelligent personal assistants learn from interaction with their users and are able to offer a service which suit their users.[18] Intelligent personal assistants also benefits from their use of voice commands. As David Nahamoo from IBM argues that speech is the main human communication tool and it is a very quick way to get the point.[19] Intelligent personal assistants could also provide various kind of information ranging from weather and traffic situation and recipes to factual information and new headlines.[20] However, the amount of information, which each could provide, differs.

There is currently a rising market of smart devices, which is also called Internet of Things (IoT). Both types of personal assistants enable the natural and fast interaction with smart devices.[19] The smart devices, which could be controlled with intelligent personal assistants, include lightbulbs, coffee machines, refrigerators, thermostats or garage doors.[20] In addition, certain smart devices even included Amazon Alexa.[21][22]

The intelligent personal assistants were originally developed in the military environment.[8] They can however solve task in other areas as a medical care,[23] shopping,[18] business, or transportation.[24]

Intelligent personal assistant can be used for a learning a foreign language. The software, which is suitable for this purpose, is Google Now.[25] However, other software and devices could be also helpful which phrases or pronunciation.[26]

There are several customer's reviews which suggested that intelligent personal assistants could be really helpful for elderly and disabled people. It has not, however, been reflected by researchers or developers. Customers argue that intelligent personal assistant could call the help, if an elderly person has an accident.[27] The intelligent personal assistants could make physically disabled people more independent, since it helps them to control their home environment by voice.[28] The voice control is also suitable for visually disabled people.[29] Judith Newman from The New York Times and the mother of an autistic child claims that Siri is a great companion of her communication-impaired son.[30] Nonetheless, studies and research of this phenomenon are needed to any conclusive claim about the benefit of intelligent personal assistants.

Ethical & Health Issues

The rise of intelligent personal assistants is linked with several ethical issues. The one most discussed is the privacy concern. In order to work properly, intelligent personal assistants have to collect a great deal of personal informations about its users, including location, password, email, calendars, address books or preferences. Additionally, the task is not solved in the device, but all the data are processed to a remote data centre.[31]

Ubiquity

Data security

Certain intelligent personal assistant's devices tend to express human-like features, which could badly affected population. This issue was pointed out especially with respect to Gatebox device, which is developed in Japan. It was deemed that it might deepened the birthrate crisis which is currently in Japan.[32] However, since the device has not been shipped yet, the impact on society is unknown.

The considerable issue among intelligent personal assistants is also tech copycats. The term means copying of technologies. It is currently quite widespread. One example of this behaviour could be introduction of Google Now and Microsoft Cortana, soon after the introduction of Apple Siri. In addition, the present rise of intelligent personal assistant's devices was influenced by the introduction of Amazon Echo. Google Home device was already presented and Microsoft Home Hub or Apple HomeKit are estimated to appears soon. Copycats was point out and criticised by David Pogue, who argues that it slow down technological innovations.[10]

http://www.huffingtonpost.com/gregory-roekens/the-rise-of-automated-vir_b_983100.html

https://www.engadget.com/2016/10/05/personal-assistants-google-home-ai/

Public & Media Impact and Presentation

Siri - presentation and media influence.

Amazon Echo - and the rise of smart hubs.

A part of pop-culture

https://paysimple.com/blog/the-best-virtual-assistant-for-your-small-business-siri-vs-google-now-vs-cortana/

http://intelligentpersonalassistants.blogspot.cz/

Public Policy

Due to storage of personal data, the use of intelligent personal assistant is banned in certain company, e.g. IBM.[33]

Related Technologies, Projects or Scientific Research

http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=5284791&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D5284791

http://www.adam.cheyer.com/papers/ontology-overview-semantic-desktop.pdf

http://www.adam.cheyer.com/papers/chi16.pdf

References

  1. 1.0 1.1 DigiBarn Computer Museum. The Knowledge Navigator concept piece by Apple Computer (1987). DigiBarn Computer Museum [online]. Available online at: http://www.digibarn.com/collections/movies/knowledge-navigator.html (Retrieved 5th January, 2017).
  2. SCULLEY, John. EDUCOM '87 : keynote address. WorldCat [online]. 1987. Available online at: http://www.worldcat.org/title/educom-87-keynote-address/oclc/027878535 (Retrieved 5th January, 2017).
  3. knownav. Knowledge Navigator. Youtube [online]. 2008, Apr 29. Available online at: https://www.youtube.com/watch?v=QRH8eimU_20 (Retrieved 5th January, 2017).
  4. DUBBERLY, Hugh. The Making of Knowledge Navigator. DDO [online]. 2007, Mar 30. Available online at: http://www.dubberly.com/articles/the-making-of-knowledge-navigator.html (Retrieved 5th January, 2017).
  5. 5.0 5.1 MCCRACKEN, Harry. The Secret Origins of Clippy: Microsoft’s Bizarre Animated Character Patents. Technologizer [online]. 2009, Jan 2. Available online at: http://www.technologizer.com/2009/01/02/microsoft-clippy-patents/ (Retrieved 5th January, 2017).
  6. 6.0 6.1 CHEN Raymond. Windows Confidential History Taking Up Space. TechNet Magazine Microsoft [online]. 2008, Jul. Available online at: https://technet.microsoft.com/en-us/library/2008.07.windowsconfidential.aspx (Retrieved 5th January, 2017).
  7. 7.0 7.1 Tomberry, Alex Mercer. Clippy. Know Your Meme [online]. 2015, Oct 21. Available online at: http://knowyourmeme.com/memes/clippy#fnr13 (Retrieved 5th January, 2017).
  8. 8.0 8.1 BOSKER, Blance. SIRI RISING: The Inside Story Of Siri’s Origins — And Why She Could Overshadow The iPhone. The Huffington Post [online]. 2013, Jan 24. Available online at: http://www.huffingtonpost.com/2013/01/22/siri-do-engine-apple-iphone_n_2499165.html (Retrieved 15th December, 2016).
  9. SRI Inc. Siri. SRI [online]. Available online at: https://www.sri.com/work/timeline-innovation/timeline.php?timeline=computing-digital#!&innovation=siri (Retrieved 15th December).
  10. 10.0 10.1 10.2 POGUE, David. The Problem with Tech Copycats. Scientific American [online].315(5), p. 23-23. Available online at: http://ve5kj6kj8s.scholar.serialssolutions.com/?sid=google&auinit=D&aulast=Pogue&atitle=The+Problem+with+Tech+Copycats&id=doi:10.1038/scientificamerican1116-23&title=Scientific+American&volume=315&issue=5&date=2016&spage=23&issn=0036-8733 (Retrieved 19th December, 2016).
  11. 11.0 11.1 WELCH, Chris. Amazon just surprised everyone with a crazy speaker that talks to you. The Verge [online]. 2014, Nov 6. Available online at: http://www.theverge.com/2014/11/6/7167793/amazon-echo-speaker-announced (Retrieved 20th December, 2016).
  12. FROMMER, Dan. Amazon Echo is a sleeper hit, and the rest of America is about to find out about it for the first time. Quartz [online]. 2016, Feb 6. Available online at: http://qz.com/611026/amazon-echo-is-a-sleeper-hit-and-the-rest-of-america-is-about-find-out-about-it-for-the-first-time/ (Retrieved 22nd December, 2016).
  13. HARRISON, Natalie and BREWER, Teresa. Apple Launches iPhone 4S, iOS 5 & iCloud. Apple [online]. 2011. Oct 4. Available online at: http://www.apple.com/pr/library/2011/10/04Apple-Launches-iPhone-4S-iOS-5-iCloud.html (Retrieved 16th December, 2016).
  14. NEEDLEMAN, Rafe. Google I/O Day One: Google continues attacks on Apple, Amazon. CNET [online]. 2012, June 27. Available online at: https://www.cnet.com/news/google-io-day-one-google-continues-attacks-on-apple-amazon/ (Retrieved 5th January, 2017).
  15. BAXI, Abhishek. Activate Cortana alpha version in India, Canada, and Australia. Windows Central [online]. 2014, Aug 4. Available online at: http://www.windowscentral.com/activate-cortana-alpha-version-india-canada-and-australia (Retrieved 5th January, 2017).
  16. KASTRENAKES, Jacob. Siri's creators will unveil their new AI bot on Monday. The Verge [online]. 2016, May 4. Available online at: http://www.theverge.com/2016/5/4/11593564/viv-labs-unveiling-monday-new-ai-from-siri-creators (Retrieved 5th January, 2017).
  17. Zacks Investment Research. Google Home Unveiled: Will It Beat Amazon Echo On Price? Investing.com [online]. 2016, Oct 04. Available online at: https://www.investing.com/analysis/google-home-unveiled:-will-it-beat-amazon-echo-on-price-200157310 (Retrieved 5th January, 2017).
  18. 18.0 18.1 WINARSKY, Norman and MARK, William. The Future Of The Virtual Personal Assistant. TechCrunch [online]. Mar 25, 2012 Available online at: https://techcrunch.com/2012/03/25/the-future-of-the-virtual-personal-assistant/ (Retrieved 16th December, 2016).
  19. 19.0 19.1 LALWANI, Mona. Personal assistants are ushering in the age of AI at home. Engadget [online]. 2016, Oct 5. Available online at: https://www.engadget.com/2016/10/05/personal-assistants-google-home-ai/ (Retrieved 5th January, 2017).
  20. 20.0 20.1 CRIST, Ry and CARNOY, David. Amazon Echo review. CNET [online]. 2016, Feb 15. Available online at: https://www.cnet.com/products/amazon-echo-review/2/ (Retrieved 21st December, 2016).
  21. PIERCE, David. This Funky New Lamp Looks Like Tron And Talks Like Alexa. Wired [online]. 2016, Dec 7. Available online at: https://www.wired.com/2016/12/funky-new-lamp-looks-like-tron-talks-like-alexa/ (Retrieved 22nd December, 2016).
  22. BUCKLEY, Sean. Amazon's Alexa assistant is coming to LG refrigerators. Engadget [online]. 2017, Jan 4. Available online at: https://www.engadget.com/2017/01/04/lg-refrigerator-with-amazons-alexia/ (Retrieved 6th January, 2017).
  23. KOMNINOS, Andreas. STAMOU, Sofia. HealthPal: An Intelligent Personal Medical Assistant for Supporting the Self-Monitoring of Healthcare in the Ageing Society. Research Gate [online]. Available online at: https://www.researchgate.net/publication/228643857_HealthPal_an_intelligent_personal_medical_assistant_for_supporting_the_self-monitoring_of_healthcare_in_the_ageing_society (Retrieved 6th January, 2017).
  24. MIT Technology Review Custom, PwC. AI Drives Better Business Decisions. MIT Technology Review [online]. 2016, Jun 20. Available online at: https://www.technologyreview.com/s/601732/ai-drives-better-business-decisions/ (Retrieved 6th January, 2017).
  25. GOKSEL-CANBEK, N., MUTLU, M. E.. On the track of Artificial Intelligence: Learning with Intelligent Personal Assistants. International Journal of Human Sciences, 13(1), 2016, p. 592-601. Doi: 10.14687/ijhs.v13i1.3549 Available online at: https://www.j-humansciences.com/ojs/index.php/IJHS/article/view/3549/1661 (Retrieved 6th January, 2017).
  26. MOLDEN, Martin. Employing Apple's Siri to practice pronunciation: A preliminary study on Arabic speakers. TESOL Working Paper Series 13, p. 2-17. Available online at: http://www.hpu.edu/CHSS/English/TESOL/ProfessionalDevelopment/2015_TWP13/02Molden2015Siri.pdf (Retrieved 19th December, 2016).
  27. Alex S. Already very practical for overcoming disability issues. Amazon [online]. 2015, Jun 19. Available online at: https://www.amazon.com/review/RTRDKUJDZCO4B/ref=cm_cr_dp_title?ie=UTF8&ASIN=B00X4WHP5E&channel=detail-glance&nodeID=9818047011&store=amazon-home&tag (Retrieved 21st December, 2016).
  28. Patrickometry. Alexa is a Revolution for my Disabled Family Member. Amazon [online]. 2015, Sep 6. Available online at: https://www.amazon.com/Amazon-SK705DI-Echo/product-reviews/B00X4WHP5E (Retrieved 21st December, 2016).
  29. KENIN, Sean. A life changing device for a boy who is blind. Amazon [online]. 2015, Jul 29. Available online at: https://www.amazon.com/Amazon-SK705DI-Echo/product-reviews/B00X4WHP5E (Retrieved 21st December, 2016).
  30. NEWMAN, Judith. To Siri, With Love: How One Boy With Autism Became BFF With Apple’s Siri. The New York Times [online]. 2014, Oct 17. Available online at: https://www.nytimes.com/2014/10/19/fashion/how-apples-siri-became-one-autistic-boys-bff.html?_r=0 (Retrieved 19th December, 2016).
  31. KENNY, Gavin. I Know Everything About You! The Rise of the Intelligent Personal Assistant. Security Intelligence [online]. 2015, Aug 12. Available online at: https://securityintelligence.com/i-know-everything-about-you-the-rise-of-the-intelligent-personal-assistant/ (Retrieved 9th January, 2017).
  32. GILBERT, Ben. The $2,500 answer to Amazon's Echo could make Japan's sex crisis even worse. Business Insider [online]. 2016, Dec 21. Available online at: http://www.businessinsider.com/gatebox-ai-the-japanese-amazon-echo-photos-2016-12 (Retrieved 9th January, 2017).
  33. MCMILLAN, Robert. IBM Outlaws Siri, Worried She Has Loose Lips. Wired [online]. 2012, May 22. Available online at: https://www.wired.com/2012/05/ibm-bans-siri/ (Retrieved 16th December, 2016).