Ray Kurzweil reveals plans for ‘linguistically fluent’ Google software

Ray Kuzweil, a director of engineering at Google, reveals plans for a future version of Google’s “Smart Reply” machine-learning email software (and more) in a Wired article by Tom Simonite published Wednesday (Aug. 2, 2017).

Running on mobile Gmail and Google Inbox, Smart Reply suggests up to three replies to an email message, saving typing time or giving you ideas for a better reply.

Smarter autocomplete

Kurzweil’s team is now “experimenting with empowering Smart Reply to elaborate on its initial terse suggestions,” Simonite says.

“Tapping a Continue button [in response to an email] might cause ‘Sure I’d love to come to your party!’ to expand to include, for example, ‘Can I bring something?’ He likes the idea of having AI pitch in anytime you’re typing, a bit like an omnipresent, smarter version of Google’s search autocomplete. ‘You could have similar technology to help you compose documents or emails by giving you suggestions of how to complete your sentence,’ Kurzweil says.”

As Simonite notes, Kurzweil’s software is based on his hierarchical theory of intelligence, articulated in Kurzweil’s latest book, How to Create a Mind and in more detail in an arXiv paper by Kurzweil and key members of his team, published in May.

“Kurzweil’s work outlines a path to create a simulation of the human neocortex (the outer layer of the brain where we do much of our thinking) by building a hierarchy of similarly structured components that encode increasingly abstract ideas as sequences,” according to the paper. “Kurzweil provides evidence that the neocortex is a self-organizing hierarchy of modules, each of which can learn, remember, recognize and/or generate a sequence, in which each sequence consists of a sequential pattern from lower-level modules.”

The paper further explains that Smart Reply previously used a “long short-term memory” (LSTM) network*, “which are much slower than feed-forward networks [used in the new software] for training and inference” because with LSTM, it takes more computation to handle longer sequences of words.

Kurzweil’s team was able to produce email responses of similar quality to LSTM, but using fewer computational resources by training hierarchically connected layers of simulated neurons on clustered numerical representations of text. Essentially, the approach propagates information through a sequence of ever more complex pattern recognizers until the final patterns are matched to optimal responses.

Kona: linguistically fluent software

But underlying Smart Reply is “a system for understanding the meaning of language, according to Kurzweil,” Simonite reports.

“Codenamed Kona, the effort is aiming for nothing less than creating software as linguistically fluent as you or me. ‘I would not say it’s at human levels, but I think we’ll get there,’ Kurzweil says. More applications of Kona are in the works and will surface in future Google products, he promises.”

* The previous sequence-to-sequence (Seq2Seq) framework [described in this paper] uses “recurrent neural networks (RNNs), typically long short-term memory (LSTM) networks, to encode sequences of word embeddings into representations that depend on the order, and uses a decoder RNN to generate output sequences word by word. …While Seq2Seq models provide a generalized solution, it is not obvious that they are maximally efficient, and training these systems can be slow and complicated.”

Facebook Comments

63 Comments

  1. Bob August 7, 2017 Reply
  2. borvest inkral September 5, 2017 Reply
  3. gucci belt September 19, 2017 Reply
  4. adidas ultra boost September 20, 2017 Reply
  5. atlanta falcons jersey September 20, 2017 Reply
  6. adidas ultra boost September 21, 2017 Reply
  7. adidas yeezy September 21, 2017 Reply
  8. pandora jewelry September 21, 2017 Reply
  9. yeezy boost 350 September 22, 2017 Reply
  10. jordan 11 September 22, 2017 Reply
  11. adidas nmd September 23, 2017 Reply
  12. huarache shoes September 23, 2017 Reply
  13. nmd uk September 24, 2017 Reply
  14. adidas outlet online September 24, 2017 Reply
  15. yeezy boost 350 September 25, 2017 Reply
  16. jordan retro September 25, 2017 Reply
  17. adidas yeezy boost September 26, 2017 Reply
  18. chrome hearts September 26, 2017 Reply
  19. nmd uk September 27, 2017 Reply
  20. reebok outlet September 27, 2017 Reply
  21. yeezy September 28, 2017 Reply
  22. air max 2018 September 28, 2017 Reply
  23. yeezy shoes September 28, 2017 Reply
  24. led shoes September 29, 2017 Reply
  25. adidas nmd September 29, 2017 Reply
  26. michael jordan shoes September 29, 2017 Reply
  27. adidas yeezy September 30, 2017 Reply
  28. lebron james shoes September 30, 2017 Reply
  29. yeezy October 1, 2017 Reply
  30. jordan 4 October 1, 2017 Reply
  31. adidas ultra boost October 2, 2017 Reply
  32. longchamp October 2, 2017 Reply
  33. yeezy shoes October 3, 2017 Reply
  34. authentic jordans October 3, 2017 Reply
  35. adidas ultra October 4, 2017 Reply
  36. cheap jordans October 4, 2017 Reply
  37. yeezys October 5, 2017 Reply
  38. ultra boost 3.0 October 6, 2017 Reply
  39. cheap jordans October 6, 2017 Reply
  40. Madden 18 news October 7, 2017 Reply
  41. ultra boost October 7, 2017 Reply
  42. yeezy sneakers October 8, 2017 Reply
  43. jordan 12 October 8, 2017 Reply
  44. yeezys October 9, 2017 Reply
  45. cheap jordans October 9, 2017 Reply
  46. yeezy boost October 10, 2017 Reply
  47. michael kors handbags October 10, 2017 Reply
  48. yeezy boost October 10, 2017 Reply
  49. yeezy boost 350 v2 October 11, 2017 Reply
  50. lebron 13 October 11, 2017 Reply
  51. ultra boost October 13, 2017 Reply
  52. fitflops sale October 13, 2017 Reply
  53. yeezy boost 350 October 13, 2017 Reply
  54. chrome hearts October 14, 2017 Reply
  55. yeezy October 16, 2017 Reply
  56. nike air force 1 high October 16, 2017 Reply

Leave a Reply