{"id":1404,"date":"2021-09-21T17:52:13","date_gmt":"2021-09-21T22:52:13","guid":{"rendered":"https:\/\/singularityumexicosummit.com\/?p=1404"},"modified":"2021-09-21T17:52:13","modified_gmt":"2021-09-21T22:52:13","slug":"openais-codex-translates-everyday-language-into-computer-code","status":"publish","type":"post","link":"https:\/\/singularityumexico.com\/en\/openais-codex-translates-everyday-language-into-computer-code\/","title":{"rendered":"OpenAI\u2019s Codex Translates Everyday Language Into Computer Code"},"content":{"rendered":"<p>In the beginning, computer programmers translated their desires into the language of machines. Now, those machines are becoming conversant in the language of their programmers. OpenAI\u2019s newly released Codex, a machine learning algorithm that can parse everyday language&nbsp;<em>and<\/em>&nbsp;computer code, sits between these worlds.<\/p>\n\n\n\n<p>This week, in a&nbsp;<a href=\"https:\/\/openai.com\/blog\/openai-codex\/\">blog post<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/www.youtube.com\/watch?v=SGUCcjHTmGY\">demo<\/a>, OpenAI showed off Codex\u2019s skills.<\/p>\n\n\n\n<p>The algorithm can turn written prompts into computer code with, at times, impressive results. OpenAI believes Codex will prove a worthy sidekick for coders, accelerating their work.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What Is Codex?<\/strong><\/h3>\n\n\n\n<p>Codex is a descendent of OpenAI\u2019s GPT-3, a sprawling natural-language machine learning algorithm released last year. After digesting and analyzing billions of words, GPT-3 could write (sometimes eerily) passable text with nary but a simple prompt.<\/p>\n\n\n\n<p>But when OpenAI released GPT-3 to developers,&nbsp;<a href=\"https:\/\/www.theverge.com\/21346343\/gpt-3-explainer-openai-examples-errors-agi-potential\">they quickly learned it could do more<\/a>. One fascinating discovery was that GPT-3 could write simple code from prompts. But it wasn\u2019t very good at it, so the team decided to fine-tune the algorithm with coding in mind from the start. They took a version of GPT-3 and trained it on billions of lines of publicly available code, and Codex was born.<\/p>\n\n\n\n<p>According OpenAI, Codex is proficient in over a dozen computer languages, but it\u2019s particularly good at Python and, of course, everyday language. These skills in hand, Codex can digest a prompt like, \u201cAdd this image of a rocket ship,\u201d and spit out the code necessary to embed an image (provided by the programmer) on the screen.<\/p>\n\n\n\n<p>In a demo, the OpenAI team showed how to code a simple video game\u2014from blank screen to playable\u2014using naught but a series of chatty prompts.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe title=\"Creating a Space Game with OpenAI Codex\" width=\"1020\" height=\"574\" src=\"https:\/\/www.youtube.com\/embed\/Zm9B-DvwOgw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>The demos are impressive, but Codex is not about to replace programmers.<\/p>\n\n\n\n<p>OpenAI researchers say Codex currently completes around 37 percent of requests. That\u2019s an improvement on an earlier iteration called Copilot, a kind of autocomplete for coders released as a product on Github, which had a success rate of 27 percent. But it&nbsp;<a href=\"https:\/\/venturebeat.com\/2021\/07\/18\/openai-codex-shows-the-limits-of-large-language-models\/\">took some manual labor<\/a>&nbsp;in the form of supervised learning with labeled data sets to get it there. (GPT-3, by contrast, was trained on unlabeled data.) So, there\u2019s room for improvement.<\/p>\n\n\n\n<p>And like any demo, it\u2019s difficult to predict how useful Codex will be in the real world. OpenAI acknowledges this is just a start, calling it a \u201ctaste of the future.\u201d They expect it will get better over time, but part of their motivation for this week\u2019s release was to get Codex into the hands of developers, a strategy that paid off richly for GPT-3.<\/p>\n\n\n\n<p>Even with improvements, OpenAI doesn\u2019t see tools like this as a replacement for coders. Rather, they hope to speed up programming and remove some of the drudgery. In the live demo, for example, OpenAI CEO Sam Altman&nbsp;<a href=\"https:\/\/www.wired.com\/story\/plaintext-open-ai-codex\/\">casually noted Codex completed a step in seconds<\/a>&nbsp;that would have taken him a half hour back when he was programming.<\/p>\n\n\n\n<p>Further, writing good software isn\u2019t only about the actual coding bit, they suggest. \u201cProgramming is really about having a dream,\u201d OpenAI CTO Greg Brockman&nbsp;<a href=\"https:\/\/www.wired.com\/story\/plaintext-open-ai-codex\/\">told&nbsp;<em>Wired<\/em><\/a>, \u201cIt\u2019s about having this picture of what you want to build, understanding your user, asking yourself, \u2018How ambitious should we make this thing, or should we get it done by the deadline?\u2019i\u201d Codex doesn\u2019t come up with what to design or how to design it. It will need significant direction, oversight, and quality control for the foreseeable future. (Which is true of its sibling GPT-3 as well.)<\/p>\n\n\n\n<p>For now, these kinds of programs will be more like sidekicks as opposed to the story\u2019s hero. They may also be a next step in the long-running evolution of computer languages.<\/p>\n\n\n\n<p>In a&nbsp;<a href=\"https:\/\/techcrunch.com\/2021\/08\/11\/no-code-is-code\/\">companion op-ed<\/a>&nbsp;in&nbsp;<em>TechCrunch,&nbsp;<\/em>Brockman and Hadi Partovi, founder and CEO of Code.org, emphasize how far we\u2019ve come from the days when a select few scientists laboriously programmed computers with punch cards and machine code. In a long progression, computer language has evolved from what suited machines to what suits us.<\/p>\n\n\n\n<p>\u201cWith Al-generated code, one can imagine an evolution in every programming tool, in every programming class, and a Cambrian explosion of new software,\u201d they wrote. \u201cDoes this mean coding is dead? No! It doesn\u2019t replace the need for a programmer to understand code. It means coding just got much easier, higher impact and thus more important, just as when punch cards were replaced by keyboards, or when Grace Hopper invented the compiler.\u201d<\/p>\n\n\n\n<p>Given its potential, it\u2019s likely OpenAI will eventually make Codex a paid product developers can access and build apps on (<a href=\"https:\/\/singularityhub.com\/2021\/04\/04\/openais-gpt-3-algorithm-is-now-producing-billions-of-words-a-day\/\">like GPT-3<\/a>). And it\u2019s possible this proves controversial. After Copilot\u2019s release, some in the developer community cried foul, noting the makers of the algorithm would profit on the work of others without compensating them. OpenAI argues the data is protected under \u201cfair use\u201d laws. Brockman&nbsp;<a href=\"https:\/\/www.theverge.com\/2021\/8\/10\/22618128\/openai-codex-natural-language-into-code-api-beta-access\">told&nbsp;<em>The Verge<\/em><\/a>&nbsp;OpenAI welcomes the debate and is open to adjusting course. Still, he argues the community will benefit overall.<\/p>\n\n\n\n<p>\u201cThe real net effect is a lot of value for the ecosystem,\u201d he said.<\/p>\n\n\n\n<p>In the meantime, if GPT-3 was any indication, it\u2019ll be fascinating to see what the developer community discovers as they get their hands on Codex for the first time. Stay tuned.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-background has-black-background-color has-black-color is-style-wide\"\/>\n\n\n\n<p><em>mage Credit:&nbsp;<a href=\"https:\/\/unsplash.com\/@sigmund?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noreferrer noopener\">Sigmund<\/a>&nbsp;\/&nbsp;<a href=\"https:\/\/unsplash.com\/?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noreferrer noopener\">Unsplash<\/a>&nbsp;&nbsp;<\/em><\/p>\n\n\n\n<p><strong>Author:<\/strong><\/p>\n\n\n\n<p>Jason is managing editor of Singularity Hub. He did research and wrote about finance and economics before moving on to science and technology. He is curious about pretty much everything, and sad he&#8217;ll only ever know a tiny fraction of it all. <a rel=\"noreferrer noopener\" href=\"https:\/\/singularityhub.com\/author\/jdorrier\/\" target=\"_blank\">Learn More<\/a><\/p>\n\n\n\n<p class=\"has-text-align-center\"><a href=\"https:\/\/singularityhub.com\/2021\/08\/15\/openais-codex-translates-everyday-language-into-computer-code\/\" target=\"_blank\" rel=\"noreferrer noopener\">Original Article<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>In the beginning, computer programmers translated their desires into the language of machines. Now, those machines are becoming conversant in the language of their programmers. OpenAI\u2019s newly released Codex, a machine learning algorithm that can parse everyday language&nbsp;and&nbsp;computer code, sits between these worlds. This week, in a&nbsp;blog post&nbsp;and&nbsp;demo, OpenAI showed off Codex\u2019s skills. The algorithm [&#8230;]\n","protected":false},"author":1,"featured_media":1405,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","footnotes":""},"categories":[13],"tags":[18,26,27],"series":[],"class_list":["post-1404","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articulos-ingles","tag-inteligencia-artificial","tag-artificial-intelligence","tag-inteligencia-artificial-2"],"episode_featured_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2021\/09\/letters-stylized-jumbled-lines-green-1068x601-1.jpeg","episode_player_image":"https:\/\/singularityumexico.com\/wp-content\/uploads\/2023\/05\/11711533-1673157178559-89a95be153719-4-scaled.jpg","download_link":"","player_link":"","audio_player":false,"episode_data":{"playerMode":"dark","subscribeUrls":{"apple_podcasts":{"key":"apple_podcasts","url":"","label":"Apple Podcasts","class":"apple_podcasts","icon":"apple-podcasts.png"},"stitcher":{"key":"stitcher","url":"","label":"Stitcher","class":"stitcher","icon":"stitcher.png"},"google_podcasts":{"key":"google_podcasts","url":"","label":"Google Podcasts","class":"google_podcasts","icon":"google-podcasts.png"},"spotify":{"key":"spotify","url":"","label":"Spotify","class":"spotify","icon":"spotify.png"}},"rssFeedUrl":"https:\/\/singularityumexico.com\/en\/feed\/podcast\/the-feedback-loop-by-singularity","embedCode":"<blockquote class=\"wp-embedded-content\" data-secret=\"jtJHmNxehI\"><a href=\"https:\/\/singularityumexico.com\/en\/openais-codex-translates-everyday-language-into-computer-code\/\">OpenAI\u2019s Codex Translates Everyday Language Into Computer Code<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/singularityumexico.com\/en\/openais-codex-translates-everyday-language-into-computer-code\/embed\/#?secret=jtJHmNxehI\" width=\"500\" height=\"350\" title=\"&#8220;OpenAI\u2019s Codex Translates Everyday Language Into Computer Code&#8221; &#8212; Singularity Mexico\" data-secret=\"jtJHmNxehI\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/singularityumexico.com\/wp-includes\/js\/wp-embed.min.js\n\/* ]]> *\/\n<\/script>\n"},"_links":{"self":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/1404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/comments?post=1404"}],"version-history":[{"count":0,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/posts\/1404\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media\/1405"}],"wp:attachment":[{"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/media?parent=1404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/categories?post=1404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/tags?post=1404"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/singularityumexico.com\/en\/wp-json\/wp\/v2\/series?post=1404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}