Saturday, June 16, 2012

Baby robot learns first words from human teacher

AT FIRST it's just noise: a stream of incoherent sounds, burbling away. But, after a few minutes, a fully formed word suddenly emerges: red. Then another: box. In this way, a babbling robot has learned to speak its first real words, just by chatting with a human.

Seeing this developmental leap in a machine may lead to robots that speak in a more natural, human-like way, and help uncover how children first start to make sense of language. Between the ages of 6 and 14 months children move from babbling strings of syllables to uttering actual words. It is a necessary step en route to acquiring full language. Once a few "anchor" words have been established, they provide clues as to where words may start and finish and so it becomes easier for a child to learn to speak.

Inspired by this process, a team led by computer scientist Caroline Lyon at the University of Hertfordshire, UK, programmed their humanoid robot iCub ? called DeeChee ? with almost all the syllables that exist in English ? around 40,000 in total. This allowed it to babble rather like a baby, by arbitrarily stringing syllables together.

The researchers also enlisted 34 people to act as teachers, who were told to treat DeeChee as if it were a child. DeeChee took part in an 8-minute dialogue with each teacher but, between each session, its memory was saved, and then wiped and reset, so that with each teacher, the experiment started anew. At the outset of the dialogue, each of the syllables in DeeChee's lexicon had an identical score.

Lexicon score

All that started to change once the lesson began. Programmed to take turns listening and then speaking, DeeChee turned the teacher's speech into syllables, totting up the number of instances of each one. It then used this information to update the scores in its own lexicon, giving extra points to syllables the teacher had used.

When it next spoke, it would be more likely to repeat the syllables the teacher had uttered because these now had higher scores.

Lyon says this is reminiscent of human infants. "When they hear frequent sounds, they become sensitive to them," says Lyon. "They prefer what's familiar."

This learning by imitation was then reinforced, as teachers made encouraging comments when DeeChee spoke a recognisable word. DeeChee was programmed to detect these comments and give extra points to the syllables that preceded the teacher's approval. Inevitably some nonsense syllables would get extra points too. But as this process was repeated, only those syllables that made up words would keep showing up in strings that gained approval.

Though the robot was still uttering nonsense streams of syllables, towards the end of the 8 minutes, real words kept popping up more often than if DeeChee were still selecting syllables at random.

That words can emerge from babble using a statistical learning process not specific to language demonstrates that this stage of language acquisition does not require hard-wired grammar faculties, says Lyon.

Paul Vogt, a cognitive scientist at Tilburg University in the Netherlands is impressed: "It's a very interesting first step towards having robots that can help us study language acquisition."

Right now, DeeChee's speech is a far cry from full-blown language, but starting with babbling could be the best way to create robots that speak naturally. "If you want the robot to work with natural speech, then you might need to teach it from the very beginning," says Lyon.

Journal reference:PLoS One, DOI: 10.1371/journal.pone.0038236

Only the ones that matter

Not all words are created equal. When Caroline Lyon's team at the University of Hertfordshire, UK, taught a robot rudimentary speech, it favoured some types of words over others. Shapes and colours ? including red, green, heart, square, box ? appeared much more often than "the" or "and". Lyon says "and" or "the" are uttered very frequently but are sometimes squashed together with another word, making it hard to make them out. Salient words like "red" or "green" tend to be pronounced the same way no matter where in a sentence they appear. It's possible that this difference helps children learn, as these words have higher "information value" at a young age, suggests Lyon's team.

If you would like to reuse any content from New Scientist, either in print or online, please contact the syndication department first for permission. New Scientist does not own rights to photos, but there are a variety of licensing options available for use of articles and graphics we own the copyright to.

Have your say

Only subscribers may leave comments on this article. Please log in.

Only personal subscribers may leave comments on this article

Subscribe now to comment.

All comments should respect the New Scientist House Rules. If you think a particular comment breaks these rules then please use the "Report" link in that comment to report it to us.

If you are having a technical problem posting a comment, please contact technical support.

colcannon dystonia tourettes gonzaga rosie o donnell soda bread recipe vanderbilt

Fitch downgrades Egypt over political uncertainties

[ [ [['Connery is an experienced stuntman', 2]], 'http://yhoo.it/KeQd0p', '[Slideshow: See photos taken on the way down]', ' ', '630', ' ', ' ', ], [ [['Connery is an experienced stuntman', 7]], ' http://yhoo.it/KpUoHO', '[Slideshow: Death-defying daredevils]', ' ', '630', ' ', ' ', ], [ [['know that we have confidence in', 3]], 'http://yhoo.it/LqYjAX ', '[Related: The Secret Service guide to Cartagena]', ' ', '630', ' ', ' ', ], [ [['We picked up this other dog and', 5]], 'http://yhoo.it/JUSxvi', '[Related: 8 common dog fears, how to calm them]', ' ', '630', ' ', ' ', ], [ [['accused of running a fake hepatitis B', 5]], 'http://bit.ly/JnoJYN', '[Related: Did WH share raid details with filmmakers?]', ' ', '630', ' ', ' ', ], [ [['accused of running a fake hepatitis B', 3]], 'http://bit.ly/KoKiqJ', '[Factbox: AQAP, al-Qaeda in Yemen]', ' ', '630', ' ', ' ', ], [ [['have my contacts on or glasses', 3]], 'http://abcn.ws/KTE5AZ', '[Related: Should the murder charge be dropped?]', ' ', '630', ' ', ' ', ], [ [['have made this nation great as Sarah Palin', 5]], 'http://yhoo.it/JD7nlD', '[Related: Bristol Palin reality show debuts June 19]', ' ', '630', ' ', ' ', ], [ [['have made this nation great as Sarah Palin', 1]], 'http://bit.ly/JRPFRO', '[Related: McCain adviser who vetted Palin weighs in on VP race]', ' ', '630', ' ', ' ', ], [ [['A JetBlue flight from New York to Las Vegas', 3]], 'http://yhoo.it/GV9zpj', '[Related: View photos of the JetBlue plane in Amarillo]', ' ', '630', ' ', ' ', ], [ [['the 28-year-old neighborhood watchman who shot and killed', 15]], 'http://news.yahoo.com/photos/white-house-stays-out-of-teen-s-killing-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/cv/ip/ap/default/120411/martinzimmermen.jpg', '630', ' ', 'AP', ], [ [['Titanic', 7]], 'http://news.yahoo.com/titanic-anniversary/', ' ', 'http://l.yimg.com/a/p/us/news/editorial/b/4e/b4e5ad9f00b5dfeeec2226d53e173569.jpeg', '550', ' ', ' ', ], [ [['He was in shock and still strapped to his seat', 6]], 'http://news.yahoo.com/photos/navy-jet-crashes-in-virginia-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/cv/ip/ap/default/120406/jet_ap.jpg', '630', ' ', 'AP', ], [ [['xxxxxxxxxxxx', 11]], 'http://news.yahoo.com/photos/russian-grannies-win-bid-to-sing-at-eurovision-1331223625-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/a/p/us/news/editorial/1/56/156d92f2760dcd3e75bcd649a8b85fcf.jpeg', '500', ' ', 'AP', ] ]

[ [ [['did not go as far his colleague', 8]], '29438204', '0' ], [ [[' the 28-year-old neighborhood watchman who shot and killed', 4]], '28924649', '0' ], [ [['because I know God protects me', 14], ['Brian Snow was at a nearby credit union', 5]], '28811216', '0' ], [ [['The state news agency RIA-Novosti quoted Rosaviatsiya', 6]], '28805461', '0' ], [ [['measure all but certain to fail in the face of bipartisan', 4]], '28771014', '0' ], [ [['matter what you do in this case', 5]], '28759848', '0' ], [ [['presume laws are constitutional', 7]], '28747556', '0' ], [ [['has destroyed 15 to 25 houses', 7]], '28744868', '0' ], [ [['short answer is yes', 7]], '28746030', '0' ], [ [['opportunity to tell the real story', 7]], '28731764', '0' ], [ [['entirely respectable way to put off the searing constitutional controversy', 7]], '28723797', '0' ], [ [['point of my campaign is that big ideas matter', 9]], '28712293', '0' ], [ [['As the standoff dragged into a second day', 7]], '28687424', '0' ], [ [['French police stepped up the search', 17]], '28667224', '0' ], [ [['Seeking to elevate his candidacy back to a general', 8]], '28660934', '0' ], [ [['The tragic story of Trayvon Martin', 4]], '28647343', '0' ], [ [['Karzai will get a chance soon to express', 8]], '28630306', '0' ], [ [['powerful storms stretching', 8]], '28493546', '0' ], [ [['basic norm that death is private', 6]], '28413590', '0' ], [ [['songwriter also saw a surge in sales for her debut album', 6]], '28413590', '1', 'Watch music videos from Whitney Houston ', 'on Yahoo! Music', 'http://music.yahoo.com' ], [ [['keyword', 99999999999999999999999]], 'videoID', '1', 'overwrite-pre-description', 'overwrite-link-string', 'overwrite-link-url' ] ]

joe arpaio cat in the hat green eggs and ham wiz khalifa and amber rose oh the places you ll go blunt amendment justin bieber birthday

FDA urges markets to pull shellfish from SKorea

[ [ [['Connery is an experienced stuntman', 2]], 'http://yhoo.it/KeQd0p', '[Slideshow: See photos taken on the way down]', ' ', '630', ' ', ' ', ], [ [['Connery is an experienced stuntman', 7]], ' http://yhoo.it/KpUoHO', '[Slideshow: Death-defying daredevils]', ' ', '630', ' ', ' ', ], [ [['know that we have confidence in', 3]], 'http://yhoo.it/LqYjAX ', '[Related: The Secret Service guide to Cartagena]', ' ', '630', ' ', ' ', ], [ [['We picked up this other dog and', 5]], 'http://yhoo.it/JUSxvi', '[Related: 8 common dog fears, how to calm them]', ' ', '630', ' ', ' ', ], [ [['accused of running a fake hepatitis B', 5]], 'http://bit.ly/JnoJYN', '[Related: Did WH share raid details with filmmakers?]', ' ', '630', ' ', ' ', ], [ [['accused of running a fake hepatitis B', 3]], 'http://bit.ly/KoKiqJ', '[Factbox: AQAP, al-Qaeda in Yemen]', ' ', '630', ' ', ' ', ], [ [['have my contacts on or glasses', 3]], 'http://abcn.ws/KTE5AZ', '[Related: Should the murder charge be dropped?]', ' ', '630', ' ', ' ', ], [ [['have made this nation great as Sarah Palin', 5]], 'http://yhoo.it/JD7nlD', '[Related: Bristol Palin reality show debuts June 19]', ' ', '630', ' ', ' ', ], [ [['have made this nation great as Sarah Palin', 1]], 'http://bit.ly/JRPFRO', '[Related: McCain adviser who vetted Palin weighs in on VP race]', ' ', '630', ' ', ' ', ], [ [['A JetBlue flight from New York to Las Vegas', 3]], 'http://yhoo.it/GV9zpj', '[Related: View photos of the JetBlue plane in Amarillo]', ' ', '630', ' ', ' ', ], [ [['the 28-year-old neighborhood watchman who shot and killed', 15]], 'http://news.yahoo.com/photos/white-house-stays-out-of-teen-s-killing-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/cv/ip/ap/default/120411/martinzimmermen.jpg', '630', ' ', 'AP', ], [ [['Titanic', 7]], 'http://news.yahoo.com/titanic-anniversary/', ' ', 'http://l.yimg.com/a/p/us/news/editorial/b/4e/b4e5ad9f00b5dfeeec2226d53e173569.jpeg', '550', ' ', ' ', ], [ [['He was in shock and still strapped to his seat', 6]], 'http://news.yahoo.com/photos/navy-jet-crashes-in-virginia-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/cv/ip/ap/default/120406/jet_ap.jpg', '630', ' ', 'AP', ], [ [['xxxxxxxxxxxx', 11]], 'http://news.yahoo.com/photos/russian-grannies-win-bid-to-sing-at-eurovision-1331223625-slideshow/', 'Click image to see more photos', 'http://l.yimg.com/a/p/us/news/editorial/1/56/156d92f2760dcd3e75bcd649a8b85fcf.jpeg', '500', ' ', 'AP', ] ]

[ [ [['did not go as far his colleague', 8]], '29438204', '0' ], [ [[' the 28-year-old neighborhood watchman who shot and killed', 4]], '28924649', '0' ], [ [['because I know God protects me', 14], ['Brian Snow was at a nearby credit union', 5]], '28811216', '0' ], [ [['The state news agency RIA-Novosti quoted Rosaviatsiya', 6]], '28805461', '0' ], [ [['measure all but certain to fail in the face of bipartisan', 4]], '28771014', '0' ], [ [['matter what you do in this case', 5]], '28759848', '0' ], [ [['presume laws are constitutional', 7]], '28747556', '0' ], [ [['has destroyed 15 to 25 houses', 7]], '28744868', '0' ], [ [['short answer is yes', 7]], '28746030', '0' ], [ [['opportunity to tell the real story', 7]], '28731764', '0' ], [ [['entirely respectable way to put off the searing constitutional controversy', 7]], '28723797', '0' ], [ [['point of my campaign is that big ideas matter', 9]], '28712293', '0' ], [ [['As the standoff dragged into a second day', 7]], '28687424', '0' ], [ [['French police stepped up the search', 17]], '28667224', '0' ], [ [['Seeking to elevate his candidacy back to a general', 8]], '28660934', '0' ], [ [['The tragic story of Trayvon Martin', 4]], '28647343', '0' ], [ [['Karzai will get a chance soon to express', 8]], '28630306', '0' ], [ [['powerful storms stretching', 8]], '28493546', '0' ], [ [['basic norm that death is private', 6]], '28413590', '0' ], [ [['songwriter also saw a surge in sales for her debut album', 6]], '28413590', '1', 'Watch music videos from Whitney Houston ', 'on Yahoo! Music', 'http://music.yahoo.com' ], [ [['keyword', 99999999999999999999999]], 'videoID', '1', 'overwrite-pre-description', 'overwrite-link-string', 'overwrite-link-url' ] ]

valentines day ideas the villages florida egoraptor gisele bundchen turbotax the bourne legacy roland martin suspended

Let Them Eat Cake? Yammer?s Price Tag May Be About $1.4 Billion

marie-antoinetteBenchmark Capital general partner Bill Gurley tipped an interesting price point for a potential Yammer deal. He asked on-stage whether it was $1.4 billion to the co-head of Goldman Sachs' global telecommunications, media and technology investment banking unit Anthony Noto tonight at the F.ounders conference in New York. Noto declined to comment.

state of play the national defense authorization act the national defense authorization act bcs rankings miguel cotto vs antonio margarito rockefeller center art basel 2011

Foxconn employee jumps to death in southwest China

(AP) ? A Foxconn Technology Group employee jumped to his death Wednesday from a company-rented apartment building in southwest China's Sichuan province, local police said.

At least a dozen Foxconn employees have jumped to their deaths or tried to do so since 2010, casting spotlight on the world's largest contract maker of electronics. The Taiwan-based company has been besieged with reports of poor working and living conditions for its workers at factories and dorms. The company installed nets in 2010 to prevent such deaths after the spate of suicides.

A public security bureau in Chengdu city announced the death Wednesday on the Sina Weibo microblogging site. The post identifies the employee only by the surname Xie and says the cause remains under investigation.

The official Xinhua News Agency said the man was 23.

In February, Foxconn ? which employs about 1 million workers at its massive plants in China ? said it had raised wages by up to 25 percent and that it was taking measures to limit workers' total work hours.

The plants that turn out iPhones, iPads, Xbox video game consoles, Dell and Hewlett-Packard computers, are run with military-like discipline.

Associated Press

clintonville battlestar galactica blood and chrome my morning jacket roger goodell psychosis dianna agron million hoodie march