{"id":2458,"date":"2022-01-20T16:29:20","date_gmt":"2022-01-20T22:29:20","guid":{"rendered":"https:\/\/singularityumexicosummit.com\/?p=2458"},"modified":"2022-01-20T16:29:20","modified_gmt":"2022-01-20T22:29:20","slug":"ai-savvy-criminals-clone-executives-voice-in-35-million-deepfake-bank-heist","status":"publish","type":"post","link":"https:\/\/singularityumexico.com\/en\/ai-savvy-criminals-clone-executives-voice-in-35-million-deepfake-bank-heist\/","title":{"rendered":"AI-Savvy Criminals Clone Executive\u2019s Voice in $35 Million Deepfake Bank Heist"},"content":{"rendered":"<p>Thanks to the advance of deepfake technology, it\u2019s becoming easier to clone peoples\u2019 voices. Some uses of the tech, like creating voice-overs to fill in gaps in&nbsp;<a href=\"https:\/\/www.youtube.com\/watch?v=ihEEjwRlghQ\"><em>Roadrunner<\/em><\/a>, the documentary about Anthony Bourdain released this past summer, are harmless (though even the ethics of this move were hotly&nbsp;<a href=\"https:\/\/www.npr.org\/2021\/07\/16\/1016838440\/ai-brought-anthony-bourdains-voice-back-to-life-should-it-have\">debated<\/a>when the film came out). In other cases, though, deepfaked voices are being used for ends that are very clearly nefarious\u2014like stealing millions of dollars.<\/p>\n\n\n\n<p>An&nbsp;<a href=\"https:\/\/www.forbes.com\/sites\/thomasbrewster\/2021\/10\/14\/huge-bank-fraud-uses-deep-fake-voice-tech-to-steal-millions\/?sh=23baccca7559\">article<\/a>&nbsp;published last week by&nbsp;<em>Forbes<\/em>&nbsp;revealed that a group of cybercriminals in the United Arab Emirates used deepfake technology as part of a bank heist that transferred a total of $35 million out of the country and into accounts all over the world.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Money Heist, Voice Edition<\/h3>\n\n\n\n<p>All you need to make a fake version of someone\u2019s voice is a recording of that person speaking. As with any machine learning system whose output improves based on the quantity and quality of its input data, a deepfaked voice will sound more like the real thing if there are more recordings for the system to learn from.<\/p>\n\n\n\n<p>In this case, criminals used deepfake software to recreate the voice of an executive at a large company (details around the company, the software used, and the recordings to train said software don\u2019t appear to be available). They then placed phone calls to a bank manager with whom the executive had a pre-existing relationship, meaning the bank manager knew the executive\u2019s voice. The impersonators also sent forged emails to the bank manager confirming details of the requested transactions. Between the emails and the familiar voice, when the executive asked the manager to authorize transfer of millions of dollars between accounts, the manager saw no problem with going ahead and doing so.<\/p>\n\n\n\n<p>The fraud took place in January 2020, but a relevant&nbsp;<a href=\"https:\/\/www.documentcloud.org\/documents\/21085009-hackers-use-deep-voice-tech-in-400k-theft\">court document<\/a>&nbsp;was just filed in the US last week. Officials in the UAE are asking investigators in the US for help tracing $400,000 of the stolen money that went to US bank accounts at Centennial Bank.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Our Voices, Our Selves<\/h3>\n\n\n\n<p>The&nbsp;<a href=\"https:\/\/www.theverge.com\/2013\/9\/17\/4596374\/machine-language-how-siri-found-its-voice\">old-fashioned way<\/a>&nbsp;(\u201cold\u201d in this context meaning before machine learning was as ubiquitous as it is today) to make a fake human voice was to record a real human voice, split that recording into many distinct syllables of speech, then paste those syllables together in countless permutations to form the words you wanted the voice to say. It was tedious and yielded a voice that didn\u2019t sound at all realistic.<\/p>\n\n\n\n<p>It\u2019s easy to differentiate the voices of people close to us, and to recognize famous voices\u2014but we don\u2019t often think through the many components that contribute to&nbsp;<a href=\"https:\/\/www.kennedy-center.org\/education\/resources-for-educators\/classroom-resources\/media-and-interactives\/media\/opera\/understanding-different-voice-types\/\">making a voice<\/a>&nbsp;unique. There\u2019s the timbre and pitch, which refer to where a voice falls on a span of notes from low to high. There\u2019s the cadence, which is the speaker\u2019s rhythm and variations in pitch and emphasis on different words or parts of a sentence. There\u2019s pronunciation, and quirks like regional accents or lisps.<\/p>\n\n\n\n<p>In short, our voices are wholly unique\u2014which makes it all the more creepy that they\u2019re becoming easier to synthetically recreate.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Fake Voices to Come<\/h3>\n\n\n\n<p>Is the UAE bank heist a harbinger of crimes to come? Unfortunately, the answer is very likely yes. It\u2019s not the first such attempt, but it\u2019s the first to succeed at stealing such a large sum of money using a deepfaked voice. In 2019 a group of criminals&nbsp;<a href=\"https:\/\/www.wsj.com\/articles\/fraudsters-use-ai-to-mimic-ceos-voice-in-unusual-cybercrime-case-11567157402\">faked the voice<\/a>&nbsp;of a UK-based energy firm\u2019s CEO to have $243,000 transferred to a Hungarian bank account.<\/p>\n\n\n\n<p>Many different versions of audio deepfake software are already commercially available, including versions from companies like&nbsp;<a href=\"https:\/\/singularityhub.com\/2017\/05\/24\/new-ai-mimics-any-voice-in-a-matter-of-minutes\/\">Lyrebird<\/a>&nbsp;(which needs just a one-minute recording to create a fake voice, albeit slightly halting and robot-like),&nbsp;<a href=\"https:\/\/www.descript.com\/\">Descript<\/a>,&nbsp;<a href=\"https:\/\/www.sonantic.io\/\">Sonantic<\/a>, and&nbsp;<a href=\"https:\/\/www.theverge.com\/2021\/5\/14\/22432180\/voice-clone-deepfake-celebrities-influencers-veritone-ai-platform\">Veritone<\/a>, to name just a few.<\/p>\n\n\n\n<p>These companies intend their products to be used for good, and some positive use cases certainly do exist; people with speech disabilities or paralysis could use the software to communicate with those around them, for example. Veritone is marketing its software for use by famous people who may want to license their voices for things like product endorsements. Sonantic recently created a&nbsp;<a href=\"https:\/\/youtu.be\/OSMue60Gg6s\">voice clone for Val Kilmer<\/a>, whose voice was damaged from his battle with throat cancer. Recording audiobooks or news podcasts could also be a productive application of the technology, as right now a person either has to read aloud for hours or the listener gets a computerized artificial voice that\u2019s not very pleasant to listen to.<\/p>\n\n\n\n<p>Other companies are already using AI to fight back against AI;&nbsp;<a href=\"https:\/\/singularityhub.com\/2020\/09\/04\/microsofts-new-deepfake-detector-puts-reality-to-the-test\/\">Microsoft\u2019s Video Authenticator<\/a>, released a little over a year ago, analyzes videos and images and tells users the percentage chance that they\u2019ve been artificially manipulated. Similarly, the&nbsp;<a href=\"https:\/\/aifoundation.com\/sustainable-ai\/\">AI Foundation\u2019s Reality Defender<\/a>&nbsp;uses synthetic media detection algorithms to identify fake content.&nbsp;<a href=\"https:\/\/about.fb.com\/news\/2020\/01\/enforcing-against-manipulated-media\/\">Facebook<\/a>,&nbsp;<a href=\"https:\/\/blog.twitter.com\/en_us\/topics\/company\/2020\/new-approach-to-synthetic-and-manipulated-media.html\">Twitter<\/a>, and&nbsp;<a href=\"https:\/\/www.marketwatch.com\/story\/youtube-to-remove-deepfakes-and-birther-videos-ahead-of-2020-election-2020-02-04\">YouTube<\/a>&nbsp;have all taken steps to try to ban and remove deepfakes from their sites.<\/p>\n\n\n\n<p>But this technology is only going to become more sophisticated, and across every realm: voice, image, and video. Fighting technology with more or better technology may be one of our best hopes, but it\u2019s also important to raise awareness of deepfakes and instill a wide-ranging sense of skepticism in people around content they see online.<\/p>\n\n\n\n<p>Let\u2019s just hope the UAE bank heist incident instills a similar skepticism in people who work at banks, so that deepfaked voices helping fraudsters steal money doesn\u2019t become a more common occurrence.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-background has-black-background-color has-black-color is-style-wide\"\/>\n\n\n\n<p><em>Image Credit:\u00a0<a href=\"https:\/\/commons.wikimedia.org\/w\/index.php?title=User:John_McGehjee&amp;action=edit&amp;redlink=1\" target=\"_blank\" rel=\"noreferrer noopener\">John McGehjee<\/a>\/<a href=\"https:\/\/commons.wikimedia.org\/wiki\/File:Bank_of_the_West_Los_Altos_branch_vault.jpg\" target=\"_blank\" rel=\"noreferrer noopener\">Wikimedia Commons<\/a><\/em><\/p>\n\n\n\n<p><strong>Author:<\/strong><a rel=\"noreferrer noopener\" href=\"https:\/\/singularityhub.com\/author\/vbatesramirez\/\" target=\"_blank\"><br>VANESSA BATES RAMIREZ<\/a> <\/p>\n\n\n\n<p>Vanessa is senior editor of Singularity Hub. She&#8217;s interested in renewable energy, health and medicine, international development, and countless other topics. When she&#8217;s not reading or writing you can usually find her outdoors, in water, or on a plane. <a rel=\"noreferrer noopener\" href=\"https:\/\/singularityhub.com\/author\/vbatesramirez\/\" target=\"_blank\">Learn More<\/a><\/p>\n\n\n\n<p class=\"has-text-align-center\"><a href=\"https:\/\/singularityhub.com\/2021\/10\/20\/ai-savvy-criminals-pulled-off-a-35-million-deepfake-bank-heist\/\" target=\"_blank\" rel=\"noreferrer noopener\">Original Article<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>Thanks to the advance of deepfake technology, it\u2019s becoming easier to clone peoples\u2019 voices. Some uses of the tech, like creating voice-overs to fill in gaps in&nbsp;Roadrunner, the documentary about Anthony Bourdain released this past summer, are harmless (though even the ethics of this move were hotly&nbsp;debatedwhen the film came out). In other cases, though, [&#8230;]\n","protected":false},"author":1,"featured_media":2459,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","footnotes":""},"categories":[13],"tags":[26,59,60,27],"series":[],"class_list":["post-2458","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articulos-ingles","tag-artificial-intelligence","tag-ciberseguridad","tag-cybersecurity","tag-inteligencia-artificial-2"],"episode_featured_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2022\/01\/2048px-Bank_of_the_West_Los_Altos_branch_vault.jpg","episode_player_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2023\/05\/11711533-1673157178559-89a95be153719-4-scaled.jpg","download_link":"","player_link":"","audio_player":false,"episode_data":{"playerMode":"dark","subscribeUrls":{"apple_podcasts":{"key":"apple_podcasts","url":"","label":"Apple Podcasts","class":"apple_podcasts","icon":"apple-podcasts.png"},"stitcher":{"key":"stitcher","url":"","label":"Stitcher","class":"stitcher","icon":"stitcher.png"},"google_podcasts":{"key":"google_podcasts","url":"","label":"Google Podcasts","class":"google_podcasts","icon":"google-podcasts.png"},"spotify":{"key":"spotify","url":"","label":"Spotify","class":"spotify","icon":"spotify.png"}},"rssFeedUrl":"https:\/\/singularityumexico.com\/en\/feed\/podcast\/the-feedback-loop-by-singularity","embedCode":"<blockquote class=\"wp-embedded-content\" data-secret=\"tcHkb22v5C\"><a href=\"https:\/\/singularityumexico.com\/en\/ai-savvy-criminals-clone-executives-voice-in-35-million-deepfake-bank-heist\/\">AI-Savvy Criminals Clone Executive\u2019s Voice in $35 Million Deepfake Bank Heist<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/singularityumexico.com\/en\/ai-savvy-criminals-clone-executives-voice-in-35-million-deepfake-bank-heist\/embed\/#?secret=tcHkb22v5C\" width=\"500\" height=\"350\" title=\"&#8220;AI-Savvy Criminals Clone Executive\u2019s Voice in $35 Million Deepfake Bank Heist&#8221; &#8212; Singularity Mexico\" data-secret=\"tcHkb22v5C\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/singularityumexico.com\/wp-includes\/js\/wp-embed.min.js\n\/* ]]> *\/\n<\/script>\n"},"_links":{"self":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/2458","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/comments?post=2458"}],"version-history":[{"count":0,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/2458\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media\/2459"}],"wp:attachment":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media?parent=2458"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/categories?post=2458"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/tags?post=2458"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/series?post=2458"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}