{"id":3410,"date":"2022-08-16T10:00:00","date_gmt":"2022-08-16T15:00:00","guid":{"rendered":"https:\/\/singularityumexicosummit.com\/?p=3410"},"modified":"2022-08-16T10:00:00","modified_gmt":"2022-08-16T15:00:00","slug":"deepmind-gave-an-ai-intuition-by-training-it-like-a-baby","status":"publish","type":"post","link":"https:\/\/singularityumexico.com\/en\/deepmind-gave-an-ai-intuition-by-training-it-like-a-baby\/","title":{"rendered":"DeepMind Gave an AI \u2018Intuition\u2019 by Training It Like a Baby"},"content":{"rendered":"<p>Babies are bubbly, cuddly, giggly balls of joy. They\u2019re also enormously powerful learning machines. At three months old, they already have intuition about how things around them behave\u2014without anyone explicitly teaching them the rules of the game.<\/p>\n\n\n\n<p>This ability, dubbed \u201cintuitive physics,\u201d seems extremely trivial on the surface. If I fill a glass with water and set it on the table, I know that the glass is an object\u2014something I can wrap my hands around without it melting into my palms. It won\u2019t sink through the table. And if it started levitating, I\u2019d stare then immediately run out the door.<\/p>\n\n\n\n<p>Babies rapidly develop this ability by soaking up data from their external environments, forming a sort of \u201ccommon sense\u201d about the dynamics of the physical world. When things don\u2019t move as expected\u2014say, in magic tricks where objects disappear\u2014they\u2019ll show surprise.<\/p>\n\n\n\n<p>For AI, it\u2019s a completely different matter. While recent AI models have already trounced humans from game play to solving decades-old&nbsp;<a href=\"https:\/\/singularityhub.com\/2021\/08\/31\/deep-learning-is-tackling-another-core-biology-mystery-rna-structure\/\">scientific conundrums<\/a>, they still struggle at developing intuition about the physical world.<\/p>\n\n\n\n<p>This month, researchers at Google-owned DeepMind took inspiration from developmental psychology and&nbsp;<a href=\"https:\/\/www.nature.com\/articles\/s41562-022-01394-8\">built an AI<\/a>&nbsp;that naturally extracts simple rules about the world through watching videos. Netflix and chill didn\u2019t work on its own; the AI model o<em>nly&nbsp;<\/em>learned the rules of our physical world when given a basic idea of objects, such as what their boundaries are, where they are, and how they move. Similar to babies, the AI expressed \u201csurprise\u201d when shown magical situations that didn\u2019t make sense, like a ball rolling up a ramp.<\/p>\n\n\n\n<p>Dubbed PLATO (for Physics Learning through Auto-encoding and Tracking Objects), the AI was surprisingly flexible. It needed only a relatively small set of examples to develop its \u201cintuition.\u201d Once it learned that, the software could generalize its predictions about how things moved and interacted with other objects, as well as about scenarios never previously encountered.<\/p>\n\n\n\n<p>In a way, PLATO hits the sweet spot between nature and nurture. Developmental psychologists have long argued about whether learning in babies can be achieved from finding patterns in data from experiences alone. PLATO suggests the answer is no, at least not for this particular task. Both built-in knowledge and experience are critical to completing the whole learning story.<\/p>\n\n\n\n<p>To be clear, PLATO isn\u2019t a digital replica of a three-month-old baby\u2014and was never designed to be. However, it does provide a glimpse into how our own minds potentially develop.<\/p>\n\n\n\n<p>\u201cThe work\u2026is pushing the boundaries of what everyday experience can and cannot account for in terms of intelligence,\u201d&nbsp;<a href=\"https:\/\/www.nature.com\/articles\/s41562-022-01395-7\">commented<\/a>&nbsp;Drs. Susan Hespos and Apoorva Shivaram, at Northwestern University and Western Sydney University, respectively, who were not involved in the study. It may \u201ctell us how to build better computer models that simulate the human mind.\u201d<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">The Common Sense Conundrum<\/h3>\n\n\n\n<p>At just three months old, most babies won\u2019t bat an eye if they drop a toy and it falls to the ground; they\u2019ve already picked up the concept of gravity.<\/p>\n\n\n\n<p>How this happens is still baffling, but there are some ideas. At that age, babies still struggle to wriggle, crawl, or otherwise move around. Their input from the outside world is mostly through observation. That\u2019s great news for AI: it means that rather than building robots to physically explore their environment, it\u2019s possible to imbue a sense of physics into AI through videos.<\/p>\n\n\n\n<p>It\u2019s a theory endorsed by Dr. Yann LeCun, a leading AI expert and chief AI scientist at Meta.&nbsp;<a href=\"https:\/\/drive.google.com\/file\/d\/1f0sPHv7ozHafASPwIOfuvF_RvP3FDPY0\/view\">In a talk from 2019<\/a>, he posited that babies likely learn through observation. Their brains build upon these data to form a conceptual idea of reality. In contrast, even the most sophisticated deep learning models still struggle to build a sense of our physical world, which limits how much they can engage with the world\u2014making them almost literally minds in the clouds.<\/p>\n\n\n\n<p>So how do you measure a baby\u2019s understanding of everyday physics? \u201cLuckily for us, developmental psychologists have spent decades studying what infants know about the physical world,\u201d&nbsp;<a href=\"https:\/\/www.deepmind.com\/publications\/learning-intuitive-physics-through-objects\">wrote<\/a>&nbsp;lead scientist Dr. Luis Piloto. One particularly powerful test is the violation-of-expectation (VoE) paradigm. Show a baby a ball rolling up a hill, randomly disappearing, or suddenly going the opposite direction, and the baby will stare at the anomaly for longer than it would when ibserving its normal expectations. Something strange is up.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Space Oddity<\/h3>\n\n\n\n<p>In the new study, the team adapted VoE for testing AI. They tackled five different physical concepts to build PLATO. Among those are solidity\u2014that is, two objects can\u2019t pass through each other; and continuity\u2014the idea that things exist and don\u2019t blink out even when hidden by another object (the \u201cpeek-a-boo\u201d test).<\/p>\n\n\n\n<p>To build PLATO, the team first started with a standard method in AI with a two-pronged approach. One component, the perceptual model, takes in visual data to parse discrete objects in an image. Next is the dynamics predictor, which uses a neural network to consider the history of previous objects and predict the behavior of the next one. In other words, the model builds a \u201cphysics engine\u201d of sorts that maps objects or scenarios and guesses how something would behave in real life. This setup gave PLATO an initial idea of the physical properties of objects, such as their position and how fast they\u2019re moving.<\/p>\n\n\n\n<p>Next came training. The team showed PLATO under 30 hours of synthetic videos from an&nbsp;<a href=\"https:\/\/github.com\/deepmind\/physical_concepts\">open-sourced dataset<\/a>. These aren\u2019t videos from real-life events. Rather, imagine old-school Nintendo-like blocky animations of a ball rolling down a ramp, bouncing into another ball, or suddenly disappearing. PLATO eventually learned to predict how a single object would move in the next video frame, and also updated its memory for that object. With training, its predictions on the next \u201cscene\u201d became more accurate.<\/p>\n\n\n\n<p>The team then threw a wrench into the spokes. They presented PLATO with both a normal scene and an impossible one, such as a ball suddenly disappearing. When measuring the difference between the actual event and PLATO\u2019s predictions, the team could gauge the AI\u2019s level of \u201csurprise\u201d\u2014which went through the roof for magical events.<\/p>\n\n\n\n<p>The learning generalized to other moving objects. Challenged with a&nbsp;<a href=\"http:\/\/physadept.csail.mit.edu\/\">completely different dataset<\/a>&nbsp;developed by MIT, featuring, among other items, rabbits and bowling pins, PLATO expertly discriminated between impossible and realistic events. PLATO had never \u201cseen\u201d a rabbit before, yet without any re-training, it showed surprise when a rabbit defied the laws of physics. Similar to babies, PLATO was able to capture its physical intuition with as little as 28 hours of video training.<\/p>\n\n\n\n<p>To Hespos and Shivaram, \u201cThese findings also parallel characteristics that we see in infant studies.\u201d<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Digital Intuition<\/h3>\n\n\n\n<p>PLATO isn\u2019t meant as an AI model for infant reasoning. But it showcases that tapping into our burgeoning baby brains can inspire computers with a sense of physicality, even when the software \u201cbrain\u201d is literally trapped inside a box. It\u2019s not just about building humanoid robots. From prosthetics to self-driving cars, an intuitive grasp of the physical world bridges the amorphous digital world of 0s and 1s into every day, run-of-the-mill reality.<\/p>\n\n\n\n<p>It\u2019s not the first time AI scientists think to turbo-charge machine minds with a dash of toddler ingenuity.&nbsp;<a href=\"https:\/\/singularityhub.com\/2018\/09\/19\/thinking-like-a-human-what-it-means-to-give-ai-a-theory-of-mind\/\">One idea<\/a>&nbsp;is to give AI a sense of theory of mind\u2014the ability to distinguish itself from others, and being able to picture itself in others\u2019 shoes. It\u2019s an ability that comes naturally for kids around four years old, and if embedded into AI models, could dramatically help it understand social interactions.<\/p>\n\n\n\n<p>The new study builds upon our early months in life as a rich resource for developing AI with common sense. For now, the field is just in its infancy. The authors are releasing their dataset for others to build on and explore an AI model\u2019s ability to interact with more complex physical concepts, including videos from the real world. For now, \u201cthese studies could serve as a synergistic opportunity across AI and developmental science,\u201d said Hespos and Shivaram.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-black-color has-alpha-channel-opacity has-black-background-color has-background is-style-wide\"\/>\n\n\n\n<p><em>Image Credit:\u00a0<a href=\"https:\/\/pixabay.com\/users\/thedanw-1139990\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=818459\" target=\"_blank\" rel=\"noreferrer noopener\">thedanw<\/a>\u00a0from\u00a0<a href=\"https:\/\/pixabay.com\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=818459\" target=\"_blank\" rel=\"noreferrer noopener\">Pixabay<\/a><\/em><\/p>\n\n\n\n<p><strong>Author:<\/strong><br>Shelly Xuelai Fan is a neuroscientist-turned-science writer. She completed her PhD in neuroscience at the University of British Columbia, where she developed novel treatments for neurodegeneration. While studying biological brains, she became fascinated with AI and all things biotech. Following graduation, she moved to UCSF to study blood-based factors that rejuvenate aged brains. She is the &#8230;\u00a0<a href=\"https:\/\/singularityhub.com\/author\/sfan\/\" target=\"_blank\" rel=\"noreferrer noopener\">Learn More<\/a><\/p>\n\n\n\n<p class=\"has-text-align-center\"><a href=\"https:\/\/singularityhub.com\/2022\/07\/19\/deepmind-gave-an-ai-intuition-by-training-it-like-a-baby\/\" target=\"_blank\" rel=\"noreferrer noopener\">Original Article<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>Babies are bubbly, cuddly, giggly balls of joy. They\u2019re also enormously powerful learning machines. At three months old, they already have intuition about how things around them behave\u2014without anyone explicitly teaching them the rules of the game. This ability, dubbed \u201cintuitive physics,\u201d seems extremely trivial on the surface. If I fill a glass with water [&#8230;]\n","protected":false},"author":1,"featured_media":3411,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"episode_type":"audio","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","footnotes":""},"categories":[13],"tags":[26,186,187,188],"series":[],"class_list":["post-3410","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articulos-ingles","tag-artificial-intelligence","tag-google","tag-meta","tag-mit"],"episode_featured_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2022\/07\/DeepMind-AI-PLATO-baby-intuition.jpg","episode_player_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2023\/05\/11711533-1673157178559-89a95be153719-4-scaled.jpg","download_link":"","player_link":"","audio_player":false,"episode_data":{"playerMode":"dark","subscribeUrls":{"apple_podcasts":{"key":"apple_podcasts","url":"","label":"Apple Podcasts","class":"apple_podcasts","icon":"apple-podcasts.png"},"stitcher":{"key":"stitcher","url":"","label":"Stitcher","class":"stitcher","icon":"stitcher.png"},"google_podcasts":{"key":"google_podcasts","url":"","label":"Google Podcasts","class":"google_podcasts","icon":"google-podcasts.png"},"spotify":{"key":"spotify","url":"","label":"Spotify","class":"spotify","icon":"spotify.png"}},"rssFeedUrl":"https:\/\/singularityumexico.com\/en\/feed\/podcast\/the-feedback-loop-by-singularity","embedCode":"<blockquote class=\"wp-embedded-content\" data-secret=\"H1CEV6SRem\"><a href=\"https:\/\/singularityumexico.com\/en\/deepmind-gave-an-ai-intuition-by-training-it-like-a-baby\/\">DeepMind Gave an AI \u2018Intuition\u2019 by Training It Like a Baby<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/singularityumexico.com\/en\/deepmind-gave-an-ai-intuition-by-training-it-like-a-baby\/embed\/#?secret=H1CEV6SRem\" width=\"500\" height=\"350\" title=\"&#8220;DeepMind Gave an AI \u2018Intuition\u2019 by Training It Like a Baby&#8221; &#8212; Singularity Mexico\" data-secret=\"H1CEV6SRem\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/singularityumexico.com\/wp-includes\/js\/wp-embed.min.js\n\/* ]]> *\/\n<\/script>\n"},"_links":{"self":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/3410","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/comments?post=3410"}],"version-history":[{"count":0,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/3410\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media\/3411"}],"wp:attachment":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media?parent=3410"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/categories?post=3410"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/tags?post=3410"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/series?post=3410"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}