<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Ken Goldberg on Medium]]></title>
        <description><![CDATA[Stories by Ken Goldberg on Medium]]></description>
        <link>https://medium.com/@ken_goldberg?source=rss-4bfe5d5fb3ca------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*WLEz6OVYnQfZYgHTUImPPQ.jpeg</url>
            <title>Stories by Ken Goldberg on Medium</title>
            <link>https://medium.com/@ken_goldberg?source=rss-4bfe5d5fb3ca------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Mon, 16 Nov 2026 14:35:02 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@ken_goldberg/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[A Century of Art and Technology in the Bay Area]]></title>
            <link>https://medium.com/silicon-valley-robotics/a-century-of-art-and-technology-in-the-bay-area-5d28baf6ecbe?source=rss-4bfe5d5fb3ca------2</link>
            <guid isPermaLink="false">https://medium.com/p/5d28baf6ecbe</guid>
            <category><![CDATA[art]]></category>
            <category><![CDATA[bay-area]]></category>
            <category><![CDATA[san-francisco]]></category>
            <dc:creator><![CDATA[Ken Goldberg]]></dc:creator>
            <pubDate>Sun, 15 Nov 2015 15:32:20 GMT</pubDate>
            <atom:updated>2015-11-29T15:00:49.115Z</atom:updated>
            <content:encoded><![CDATA[<h4>From pirates to prospectors to physicists and from poets to pranksters to programmers, the Bay Area is a magnet for mavericks impatient to reinvent the world.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HQKzY3bvGYlgckViUFCAVw.jpeg" /><figcaption>Leo Villareal, Bay Lights art installation, 2014</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*e56fCmOfDSQnW08jU2jljA.jpeg" /></figure><h4>From Edweard Muybridge’s experimental stop-motion cameras in the 1860s to the 1915 Panama-Pacific Exposition, the Bay Area has a rich history of counterculture at the intersection of Art and Technology: artists and innovators who develop and use new technologies to explore, expand, and critique the role of technology in culture.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/350/1*wf5pI7jDOjFZTP4jTeoBNQ.jpeg" /><figcaption>Philo T. Farnsworth</figcaption></figure><h4>In 1927, in his lab at the bottom of Telegraph Hill, 21-year-old Philo T. Farnsworth’s transmitted the first television image, inspiring generations of video and pirate broadcast artists including San Francisco’s Neighborhood Public Radio collective. Soon after, the brothers Oppenheimer came to UC Berkeley to pursue research in physics by day and explore Bay Area bohemian nightclubs and coffee houses by night. Robert Oppenheimer was then recruited for the Manhattan Project and later became highly critical of US policy on the bomb. Joseph McCarthy strenuously worked to discredit him.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/458/1*U1ckRXOsb7Yk5Edgmesggg.jpeg" /><figcaption>J. Robert Oppenheimer</figcaption></figure><h4>Although McCarthy despised the freedom of inquiry at Cal, the 1960 House UnAmerican Activities Committee (HUAC) attempt to meet in San Francisco sparked Berkeley’s Free Speech Movement, which set the stage for the Anti-War Movement and the Summer of Love. McCarthyism also undermined Robert’s younger brother.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*PhKoEwWqQMdWCw7xEGdpyw.jpeg" /><figcaption>The Exploratorium in the Exhibit Hall of the Palace of Fine Arts, 1969–2014</figcaption></figure><h4>Unable to work as a physicist, Frank created the Exploratorium, which opened in 1969 at the Palace of Fine Arts with the legendary exhibition, “Cybernetic Serendipity,” brought by Jasia Reichardt from the Institute of Contemporary Art in London. The Exploratorium established the model for hands-on discovery that continues to inspire artists and scientists worldwide.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yV4HbSmrE_ujw9xSIUkB6g.jpeg" /><figcaption>City Lights Beat Poets</figcaption></figure><h4>In 1955, the year Alan Ginsberg read “Howl” in San Francisco, a young electrical engineer named Billy Kluver entered the PhD program in EE at Cal. Kluver was later hired by Bell Labs in New York, where his Bay Area bohemian experiences led him to start in 1965 the legendary Experiments in Art and Technology (E.A.T.) with Robert Rauschenberg and John Cage.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kWu32NCQX3BgT8xgBgOSTw.jpeg" /></figure><h4>In 1966, Peter Selz curated “Directions in Kinetic Sculpture” at the Berkeley Art Museum, introducing the art world to sculptures driven by air, magnets, and electric motors. Two years later Doug Michels and Chip Lord founded Ant Farm, a collective that over the next decade explored the emerging technology of porta-pak video, created the video performance Media Burn, and built Cadillac Ranch.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/399/1*CGWXfGzxJ-wP-TxiHYHhHg.jpeg" /></figure><h4>In 1970, Xerox Palo Alto Research Center started its artist-in-residency program and Tom Marioni opened the Museum of Conceptual Art (MOCA); both helped exhibit dozens of local artists, including SFAI’s Paul Kos who exhibited an audio installation “The Sound of Ice Melting” as the Residents moved to San Francisco and formed Ralph Records to germinate an audio technology counterculture including Meyer Sound, Dolby Labs, Naut Humon, Center for New Music and Audio Technologies (CNMAT), Center for Computer Research in Music and Acoustics (CCRMA), Mills Tape Center, and many others.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*z8kWW99fSwaFDzykyMNxTg.jpeg" /><figcaption>Lynn Hershman</figcaption></figure><h4>In 1972, Lynn Hershman Leeson began her fictional persona performances and went on to pioneer a number of media art forms and by 1977 Sonya Rappaport had moved from painting to experimenting with electronic media and Sharon Grace developed a satellite communications system that allowed live interactive dance between NY and SF.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*MdzfKEQ-Q94C2LCIduftdg.jpeg" /><figcaption>Survival Research Labs</figcaption></figure><h4>In 1978, Mark Pauline founded the guerilla tech-art collective Survival Research Labs to create and present machine art performances around the world. SRL introduced welding and machining skills to a network of artists such as Kal Spelletich and Eric Paulos and led to institutions like the Crucible in the East Bay. Scavenging for “obtanium” was an integral action for accessing impossibly priced tech materials. Punk and Performance Art were influences on a movement described in “The Industrial Culture Handbook” published by V. Vale’s Re/Search.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/450/1*4kEGSSnLI2SzgpXN0x2tyQ.jpeg" /><figcaption>Alan Rath</figcaption></figure><h4>In 1981 Trudy Myrrh Reagan founded YLEM, Artists Using Science and Technology, worked with Eleanor Kent, Beverly Reiser, Stephen Wilson on newsletters and projects such as the 1983 exhibition that included Jaron Lanier’s art game for the Commodore 64, Scott Kim’s computer-manipulated calligraphy, and Lucia Grossberger-Morales’ video images manipulated on an Apple II. At the same time the San Francisco artist space New Langton Arts became the ongoing host of exhibitions by such artists as Alan Rath, Bill Bell, Milton Komisar and dozens of others. Antenna Theater introduced Walkman Theater with their piece Highschool in which the audience became an actor.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/450/1*dMBONwaT0FrCtth1XJL4Og.jpeg" /><figcaption>Burning Man in 1986</figcaption></figure><h4>In 1984, Roger Malina, an astronomer at UC Berkeley, brought the Leonardo Foundation to the Bay Area where it’s monthly MIT Press journal was edited by Brian Rogers at SFSU. Two years later the first Burning Man event was launched by Larry Harvey and Jerry James on Baker Beach and a few miles away the Exploratorium exhibited work by multi-media artists Jim Pomeroy and Brian Eno. Pixar debuted “Luxo Junior” a short animation directed by John Lasseter, the first computer graphics film nominated for an Academy Award.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*CZWKlbW8-nNZMqnneLP2_Q.jpeg" /></figure><h4>Also In 1992, Michael Naimark and other leading media artists started working at Interval Research in Palo Alto, George Coates Performance Works mixed live performance with real time computer generated 3D imagery, and Mark Petrakis started his long running series of monthly Anon Salons in San Francisco.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/612/1*t5bSGibC3ENk3xDAVmxn0w.jpeg" /><figcaption>Chico MacMurtrie</figcaption></figure><h4>In 1993, Jane Metcalfe and Louis Rossetto introduced WIRED magazine, building in part on the style of previous Bay Area publications like R.U. Sirius’ MONDO 2000 and Re/Search. WIRED hired Survival Research Labs to perform at their first anniversary party the following year and bOING bOING, then a print zine about technology, art, and high weirdness, had a shared office downstairs. In 1993 Chico MacMurtrie and Amorphic Robot Works presented Trigram: A Robotic Opera at Theater Artaud and in 1995, Will Linn opened the BlastHaus Gallery in SF.</h4><h4>Although the World Wide Web wasn’t invented here, when Jim Clark and Mark Andreeson founded Netscape in Palo Alto in 1995, thousands of artists and designers came to the Bay Area to launch the Internet industry which soon included Google, Yahoo, Facebook, Twitter, and many others. In this midst of this paradigm shift, Stewart Brand and Kevin Kelly created the Long Now Foundation.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*KM5Ckq5Jc9G3G3Y5JNXHkQ.jpeg" /></figure><h4>In 1997, as the Kramlichs ramped up their collection of video art and Tiffany Shlain organized the first Webby Awards, colleagues and I at UC Berkeley launched <a href="http://atc.berkeley.edu/">a monthly public lecture series, “Art, Technology, and Culture” </a>focusing on artists, thinkers, and writers who question assumptions and push the boundaries between these categories. The ATC series, now in its 20th year, has presented over 170 artists, writers, and critical thinkers including: Sophie Calle, Laurie Anderson, Bruno Latour, Maya Lin, Doug Aitken, Pierre Huyghe, Miranda July, David Byrne, Gary Hill, Charles Ray, Hubert Dreyfus, Julia Scher, Leo Villareal, Christopher Alexander, and Billy Kluver.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vOY6fSqHt3eKM5vBXWwpNA.jpeg" /><figcaption>Zero1 Garage in San Jose</figcaption></figure><h4>In 2000, BAM/PFA Matrix Curator Larry Rinder became curator of the Whitney Biennial and included Net Art for the first time. Andy Cunningham and Beau Takahara formed ZERO1: The Art and Technology Network, later led by Steve Dietz and Joel Slayton, who organized four Art and Technology Biennials in San Jose including works from sculptor Michael Joaquin Grey, creator of the ZOOB toys.</h4><h4>As the first Internet wave crested in 2001, Larry Lessig started Creative Commons to empower re-mix artists and SFMOMA opened 010101: Art in Technological Times later followed by a series of exhibits curated by Rudolf Frieling and Tanya Zimbardo. In 2002, Karen Marcelo started the SF Dorkbot monthly lecture series and JoAnne Northrup at the San Jose Museum of Art began curating retrospectives of media artists such as Jennifer Steinkamp and gallerists like Catharine Clark started representing media artists.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*u7_BOKBgfYgGYsDP7_QG3g.jpeg" /><figcaption>Jim Campbell Installation</figcaption></figure><h4>In 2006 the first Maker Faire was held in San Mateo and Josette Melchor and Peter Hirshberg created the Gray Area Art Foundation. In 2008, Piero Scaruffi began organizing the monthly Leonardo Art Science Evenings (LASER) and BAM/PFA curator Rick Rinehart hosted a Funeral for Analog television. Literally hundreds of artists have come to the Bay Area to study art and technology at SFAI, SFSU, Berkeley, Stanford, Mills, CCA and other Bay Area schools.</h4><h4>In 2013, the Bay Area Art and Technology counterculture received international attention for the spectacular Bay Lights project initiated when Ben Davis, Timothy Childs, Amy Critchett, Dorka Keehn and others worked with Leo Villareal and recent advances in LED light technology to create the world’s largest light sculpture on the Bay Bridge.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/770/1*oXu7J5VBa3hwhMYuEmvOXg.jpeg" /></figure><h4>Each wave of art and technology starts with a real or imagined discovery: land, gold, atomic elements, hallucinogens, circuits, algorithms. As Timothy Leary allegedly observed: “California is the end of the genetic runway.” The Northern California / Bay Area Art and Technology counterculture paves that runway with a true love of science and engineering, a deep resistance to authority, and an undaunted belief in Power to the People. The Bay Area is quick to forgive and embrace projects that don’t go the way they were intended. This ecosystem continues to explore and experiment with new ways to express ideas that could not be expressed before.</h4><h4>I wrote a preliminary version of this essay for the <a href="http://neat.thecjm.org/">New Experiments in Art and Technology exhibit</a> at the SF Contemporary Jewish Museum and expanded it for <a href="http://goldberg.berkeley.edu/art/Century-of-Art-and-Tech/">“100 Years of Robot Art and Science in the Bay Area”</a>, a 20 November, 2015 discussion at the de Young Museum in San Francisco including Pieter Abbeel, Catharine Clark, Karen Marcelo, John Markoff, Josette Melchor, David Pescovitz, Zander Rose, Tim Roseborough, Dorothy Santos, Kal Spelletich, and Terry Winograd.</h4><h4>Thanks to Kevin Chen, Renny Pritikin, Natasha Boaz, Catharine Clark, Erik Davis, Rudolf Frieling, Michael Grey, Lynn Hershman, Connie Lewallen, Chip Lord, Tom Marioni, Marina McDougall, Susan Miller, JoAnne Northrup, David Pescovitz, Rick Rinehart, Alexander Rose, Joel Slayton, Tiffany Shlain, R.U. Sirius, V. Vale, and Pam Winfrey for advice, and apologies to all, especially professional historians, for omissions and errors.</h4><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5d28baf6ecbe" width="1" height="1" alt=""><hr><p><a href="https://medium.com/silicon-valley-robotics/a-century-of-art-and-technology-in-the-bay-area-5d28baf6ecbe">A Century of Art and Technology in the Bay Area</a> was originally published in <a href="https://medium.com/silicon-valley-robotics">Silicon Valley Robotics</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Let’s Ditch the Singularity and Focus on Multiplicity]]></title>
            <link>https://medium.com/@ken_goldberg/lets-ditch-the-singularity-and-focus-on-multiplicity-3b397bc62449?source=rss-4bfe5d5fb3ca------2</link>
            <guid isPermaLink="false">https://medium.com/p/3b397bc62449</guid>
            <category><![CDATA[culture]]></category>
            <dc:creator><![CDATA[Ken Goldberg]]></dc:creator>
            <pubDate>Wed, 21 Jan 2015 18:39:25 GMT</pubDate>
            <atom:updated>2015-01-21T18:39:25.386Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/200/1*iUIrYzxrWq4_6K8b8uXwBg.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*eIpgE5GCjnM9f3ty-GEENQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EcXFdZD0xNAME7PR_yF1Yg.jpeg" /><figcaption>Photo by Gjon Mili.</figcaption></figure><p>As Picasso once observed, “Computers are useless, all they can do is answer questions” He was right. We need humans to ask timely and important questions like, “Will machines make better decisions than humans?”</p><p>Lately it seems everyone from Stephen Hawking to Elon Musk is raising concerns about the “Singularity”: the point when machines will surpass us. But it’s not us versus the machines; it’s us and the machines. The best decisions will be made by diverse groups of humans working together with diverse groups of machines. Let’s call it the “Multiplicity”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*OzVmkCaSM5uQA9RgKh9pmA.gif" /></figure><p>This idea has a long history. Three hundred years ago Swiss clockmakers used the latest advances in mechanics to build automata to explore the shifting boundaries between humans and machines. Today we routinely trust machines like auto-pilots and pacemakers to make important decisions that require precision and speed. Multiple modules and voting are often used to reduce errors. The cutting edge of research now is on machines that can learn.</p><p>It was recently proved that a sufficiently diverse group of machines will learn to make better decisions than any single machine. The field of ensemble learning explores mathematical models for the collective behavior of machines, in the same way that political science studies models for the collective behavior of humans.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*z-cVqQY990BRdGvIXyOzbQ.png" /></figure><p>Consider robots, the automata of our generation. There are now over a million robots working in factories around the world, but we still don’t have them in our homes. This is elegantly summarized in a paradox posed by Hans Moravec 30 years ago:</p><blockquote>“Tasks that are hard for humans, like precision spot welding, are easy for robots, while tasks that are easy for humans, like clearing the dinner table, are very hard for robots.”</blockquote><p>This is still true today, despite enormous advances in computing and theory.</p><p>Put yourself in the position of being a robot: your sensors and motors are noisy and inconsistent. Nothing is precise, not even your own body. Outside the factory, the central problem for robots is uncertainty.</p><p>Now consider Google’s robot car. Like an auto-pilot, this robot can make better decisions than a human, especially one who’s sleepy, intoxicated, or checking Instagram. This is because Google discovered that driving is similar to clearing the dishes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*h7eWuiuus5PGkMtmE6QvpQ.gif" /></figure><p>In both cases, robots can cope with uncertainty using spatial probability distributions, convolution, and statistical learning to maximize expected utility and make optimal decisions. Google’s insight is that the processing can be performed remotely in the cloud, and as a side-effect, robots share data so the collective learns to make better decisions over time.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*CiHUbUEw27QVp_WI3Wno2A.jpeg" /><figcaption>photo: Alex Turney</figcaption></figure><p>To study how Cloud Robots can assist surgeons, we are establishing the <a href="http://cal-mr.berkeley.edu/">Center for Automation and Learning for Medical Robotics (Cal-MR)</a> at UC Berkeley. In October, we showed for the first time that surgical robots can learn how to perform repetitive subtasks by analyzing a diverse set of examples provided by human surgeons:</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FbeVWB6NtAaA%3Ffeature%3Doembed&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DbeVWB6NtAaA&amp;image=http%3A%2F%2Fi.ytimg.com%2Fvi%2FbeVWB6NtAaA%2Fhqdefault.jpg&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/a562d2f861470e646ff75b705990c132/href">https://medium.com/media/a562d2f861470e646ff75b705990c132/href</a></iframe><p>A vital ingredient for Google’s robot cars and surgical robots is <em>diversity</em>, learning from a sufficiently diverse set of examples, which requires engaging with a sufficiently diverse group of humans.</p><p>So in the spirit of Picasso, let’s ditch the “Singularity” and focus instead on “Multiplicity”, a much more practical and useful model where diverse groups of humans ask important questions and work together with diverse groups of machines to answer them.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*eIpgE5GCjnM9f3ty-GEENQ.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3b397bc62449" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Robots With Their Heads in the Clouds]]></title>
            <link>https://medium.com/aspen-ideas/robots-with-their-heads-in-the-clouds-e88ac44def8a?source=rss-4bfe5d5fb3ca------2</link>
            <guid isPermaLink="false">https://medium.com/p/e88ac44def8a</guid>
            <category><![CDATA[aspen-ideas-festival-2014]]></category>
            <dc:creator><![CDATA[Ken Goldberg]]></dc:creator>
            <pubDate>Mon, 25 Aug 2014 15:03:30 GMT</pubDate>
            <atom:updated>2015-06-24T15:05:07.070Z</atom:updated>
            <content:encoded><![CDATA[<figure><a href="https://medium.com/aspen-ideas"><img alt="" src="https://cdn-images-1.medium.com/max/305/1*EMIq4GXDXW8zJDa7wfxlsA.png" /></a></figure><h4><em>The five elements of cloud robotics</em></h4><blockquote>Robots haven’t yet lived up to their potential,<strong> </strong>but they’re about to benefit enormously from the Cloud. In this talk I’ll describe how a new generation of robots can use wireless networking, big data, machine learning, open-source, and the Internet of Things to improve how they assist us in tasks from driving to housekeeping to surgery.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/201/1*nsSiVt_yx0ZWa7Cu7rLQVQ.png" /></figure><p><strong>The roots of this trend go back to the early 1990s,</strong> when the World Wide Web was first introduced. I was a young professor at the University of Southern California directing my grad students in a robotics research lab. One afternoon they came to my office and showed me something that blew my mind. On my desktop computer, they launched Mosaic, the first web browser. We explored some of the first web sites, including one where anyone could view a live camera pointed at a coffee pot in a college student lounge. The camera was rigged up by Cambridge University grad students to check when there was a fresh pot available; what you might call “disruptive caffeination.”</p><p>That night, my students and I stayed up late in the lab brainstorming about how we could take that idea further. Instead of passively watching things with webcams, could we use the Web to let remote visitors actively move and change the environment in our lab using our robot?</p><p>Rather than having the robot do something boring like stacking blocks, what if it could tend a garden filled with living plants? We took an industrial robot arm and fitted it with a digital camera, an irrigation system, and a pneumatic nozzle to pick up seeds. We installed it at the center of a custom circular aluminum planter three meters across and filled it a half-meter deep with potting soil and some starter plants. We designed a graphical web interface that anyone could access to view, water, and plant seeds in the garden by moving the robot.</p><figure><a href="http://goldberg.berkeley.edu/garden/Ars/"><img alt="" src="https://cdn-images-1.medium.com/max/638/1*P1ja5XY8hnp2I8mPVfIzUQ.png" /></a><figcaption>The Telegarden. (materials: Robot, Garden, Internet.) 1995–2004, Ars Electronica Museum, Linz Austria. Co-directors: Ken Goldberg and Joseph Santarromana, Project Team: George Bekey, Steven Gentner, Rosemary Morris Carl Sutter, Jeff Wiegley Ars, Electronica team: Erich Berger, Gerold Hofstadler.</figcaption></figure><p>The Telegarden went online in the summer of 1995. Word got around, and within weeks, thousands of people were visiting this community garden. Many came back regularly to water their plants. There was a chat room where people would post requests saying they were going on vacation and asking if someone could water their plants. Thousands of seedlings began to sprout, and tbe Telegarden quickly became overgrown. It turned into a study of the Tragedy of the Commons.</p><p>We were surprised; we’d been concerned that gardening might be the last thing people would want to do online (this was ten years before Farmville ;). After a year we were invited to install the Telegarden in a museum in Austria, where it remained online, 24 hours a day, for nine years.</p><blockquote>To our knowledge, more people operated that robot than any robot in history.</blockquote><p>The Telegarden was the first active device on the web, MIT Press published two books about it, and soon many other devices and systems were connected to the web.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/365/1*3Nix9401MIl8_jaeopYBuw.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/391/1*ZAmeqw7LkMvsGxSiJfBNng.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/201/1*JgWFA755U4A83Xxa9WrtRw.png" /></figure><p><strong>Since then, the field of Robotics</strong> has advanced considerably. There are now hundreds of research labs and over a dozen journals. There are over 5 million service robots like the Roomba vacuuming homes and offices and over 3000 robots assisting surgeons in operating rooms around the world. There have also been major advances in digital cameras, inertial motion sensors, and other sensors. When Microsoft introduced the Kinect 3D camera for gaming, it was a major breakthrough for robotics, providing a low-cost way to obtain 3D point clouds that can help robots navigate and manipulate. In 2012, President Obama announced the U.S. National Robotics Initiative with over $70 million in new funding for research.</p><p>But robots are not yet folding our laundry or loading our dishes into the dishwasher. These mundane chores are fiendishly difficult for robots. The essential problem is uncertainty. Put yourself in the position of being a robot: everything around you is blurry and unsteady, low-resolution and jittery, you can’t really tell what things are, where they are, and how they are moving. You can’t perfectly control your own hands, it’s like you’re wearing huge oven mitts and goggles smeared with Vaseline. I hope you’re having some sympathy now for robots.</p><p>I believe the Cloud is the key to a new generation of robots. Take Google’s robot car. The car uses the network to access Google’s enormous database of maps and satellite and Streetview images and combines it with streaming data from GPS, cameras, and 3D sensors to monitor its own position within centimeters, and with past and current traffic patterns to avoid collisions. This gives Google an enormous advantage over automobile companies like Toyota and General Motors.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ehrLuR5qoF_sxqfmTWZRIQ.jpeg" /><figcaption>Prototype of Google’s self-driving car. Photo courtesy of Google.</figcaption></figure><blockquote>Why is Google interested in Robots? Because Google understands the Internet.</blockquote><p>BTW, I like Brad Templeton’s observation: <em>“A robot will be truly autonomous when you instruct it to go to work and it decides to go to the beach instead.”</em></p><p>Although robots have been on the Internet for 20 years, in 2010 James Kuffner, a brilliant researcher at Google, coined the term <strong>“Cloud Robotics.” </strong>The Cloud isn’t just a new name for the Internet. It’s a new paradigm that uses the Internet in new ways. Think of Google Docs. Anyone can send Microsoft Word documents over the Internet, but Google Docs is different: The document and the software don’t live on your computer. Everything is stored in the Cloud using remote server farms with shared memory and processors. This is helpful because you don’t have to worry about your disk crashing or maintaining and updating your software or hardware. The Cloud also provides economies of scale and makes sharing data across applications and users easier than ever. (Of course, it also raises huge privacy and security concerns.)</p><h3><strong>Here’s what I see as the Five Elements of Cloud Robotics</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/120/1*tnQdlBwlKVsBxlNHxsuF-g.png" /></figure><p><strong>The first element </strong>concerns memory. The 2012 indie film <em>Robot &amp; Frank </em>is a masterpiece that offers a unique and I think quite realistic glimpse into the future (like the 2013 film <em>Her </em>by Spike Jonze). A man is growing older and becoming forgetful. His kids send him a robot to help him around the house. It cleans up for him and reminds him to eat healthy and to water his garden. When I saw this film, I could imagine myself wanting a robot like this to remind me to eat kale, take my meds, and do my situps, but also to keep me company, reminding me of relevant memories, maybe even telling me jokes based on current events and what’s happening in my environment. But such household robots aren’t available yet. One problem is that there are thousands of objects in a typical house.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GZBTmly3k1uvLgOaAeOosw.jpeg" /></figure><p>Consider designing a robot to declutter your house. This is very important for anyone who has kids and especially for those of us who are getting older. When a senior citizen drops something on the floor, they may not notice it because of poor eyesight. Even if they see it, it’s not easy to reach down and pick all these things up. But the consequence of slipping and falling can be catastrophic; if you break your hip, for example, it could lead to being bedridden, which leads to loss of circulation and depression. After a certain age, things left on the floor can be fatal.</p><p>What if a robot could work quietly while you are sleeping or at work, picking things up off the floor and putting them where they belong? The problem is that no matter how well you program the robot, no matter how many objects it stores in its onboard memory, there will always be something that it hasn’t seen before. Like this new remote control I bought to advance my slides. If it fell on the floor, my robot may not know what to do with it. Is it a chocolate bar? Does it belong on my desk? In the fridge? Or in the garbage?</p><p>Fortunately, any robot that’s working in your house will be connected to a wifi network. So it has access to a vast library of information on the Internet, where there’s information on almost every object imaginable. It’s an enormous amount of information, and it’s constantly growing. The problem is that keeping all that memory onboard the robot in your house isn’t feasible. But the Cloud makes that information available on demand. The first element of Cloud Robotics is <strong>Big Data.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/120/1*FHsw2f8k6IiZ3Li86OkXLw.png" /></figure><p><strong>The second element </strong>of Cloud Robotics addresses limitations in onboard computer processing. Robots can carry at most a few computers, and there are many problems that require far more computation than those can provide.</p><blockquote>Robots are starting to use a statistical approach known as Belief Space.</blockquote><p>One exciting approach is to model the environment, sensors, and actions using probability distributions. The mathematical term for this is Belief Space. I know that sounds like something spiritual or from science fiction. But it’s shorthand for Partially Observed Markov Decision Processes (POMDPs). To solve them, to find the optimal action in this context, requires taking the convolution of several distributions. This quickly becomes infeasible as the probability distributions become more complex, multi-modal, and non-parametric.</p><p>Finding solutions requires an enormous amount of computing power. Belief Space was considered intractable until very recently, when we gained access to clusters of computers on demand through the Cloud. Such computing power also facilitates statistical optimization, machine learning, and planning motions in high dimensions with many simultaneously moving robots. The second element of Cloud Robotics is <strong>Cloud Computing.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/120/1*5BayAGytAZtuAcI0j488nQ.png" /></figure><p><strong>The third element </strong>of Cloud Robotics uses the fact that humans are increasingly connected over the web, exchanging information with each other. Here’s an example. I was born in Nigeria, and I went back there a few years ago. I was surprised to find that there was an enormous interest among students in robotics. In Africa, like all countries, when kids they see a robot, it’s very physical, it’s something that they can identify with, and it catches their interest. Robots are a “gateway drug” for getting students interested in Science, Technology, Engineering, and Math (STEM). I met students in different areas of Ghana that were excited about robots, but in many cases they didn’t know about each other.</p><blockquote>Robots are a “gateway drug” for getting students interested in Science, Technology, Engineering, and Math.</blockquote><p>I met a wonderful professor, Ayorkor Korseh, at Ashesi University. We decided to start the African Robotics Network. And the idea was that we wanted to connect all these groups around not only Ghana, but all over Africa, who are interested in robots, and allow them to learn from each other and develop new tools and new ideas.</p><p>Existing educational robots are still relatively expensive. We saw the need for an ultra-affordable robot for education. We created a website and announced a worldwide Design Competition. We set the price target at US $10. We figured that was completely ludicrous but it would get people thinking. After four months we received 28 submissions. Many elegant designs: but the grand prize winner really surprised us.</p><p>It was a robot that was made out of a Sony game controller. A designer named Tom Tilley modified a game controller, which anyone can get surplus for about $3 or $4. There are two motors that are built into it that create vibration as you are playing the game. He took them out and attached two wheels to them. The body of the game controller became the body of a mobile robot. He also added lights, but he wanted something that would detect when it bumped into something.</p><p>He realized that he could use the two thumb switches on the top. The problem was that when he tested it, the thumb switches wouldn’t react; they needed more leverage. So he needed a counterweight for the thumb switches. He thought about what might work that would be available on fairly low cost and came up with a brilliant idea: lollipops.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/629/1*p5KSeQHjcHBNcBrdLJKd3Q.png" /><figcaption>Lollibot prototype<br>designed by Tom Tilley</figcaption></figure><p>What kid could resist a robot with two lollipops on top of it?</p><p>Tom calls it the “Lollibot,” and you can find detailed instructions on how to make your own on the web. The total price for all the parts comes to $8.96 (and that includes the lollipops)!</p><p>Another exciting development is ROS, the Robot Operating System. It’s an open source software library that has changed the field of robotics. It’s the Linux for robots. When someone comes up with a new algorithm, he or she can immediately load it into ROS and make it accessible to other researchers around the world. The third element of Cloud Robotics is <strong>Open-Source</strong>: shared access to human ingenuity: code, data, and designs.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/120/1*KKBiQzaKXBinfTpqQxeRrQ.png" /></figure><p><strong>The fourth element </strong>of Cloud Robotics is based on<strong> </strong>robots communicating directly with each other. Consider Amazon, which has to rapidly fill thousands of orders for books and other products, packing boxes with items that can be located all over huge warehouses. A company called Kiva Systems designed a new type of robots to address this problem. The robots move around storage racks filled with boxes of items. There can be hundreds and thousands of them in a warehouse, and they increase efficiency amazingly. What makes it all work is that these robots are all talking to each other. They are constantly communicating. They work together to coordinate traffic patterns, and if conditions change, like one robot finds a bit of grease on the floor, it instantly alerts the others to avoid it. The fourth element of Cloud Robotics is <strong>Robot-to-Robot Learning</strong>: robots sharing data and code to collectively improve their performance.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/120/1*A-fDJba0NspP0XGdFDPmfw.png" /></figure><p><strong>The fifth element </strong>of cloud robotics concerns error modes, where the robot can’t determine what to do. If you work in robotics, you realize there is always going to be situations where the robot doesn’t know what to do.</p><blockquote>When a robot gets stuck, it could ask a human for help.</blockquote><p>The Cloud could provide access to call-centers with humans standing by to diagnose the robot’s data and video to suggest steps for recovery, when all else fails. I realize this is the opposite of what happens today, where you call technical support and a robot voice answers. One key to making this work is for the robot to monitor its confidence levels, so it can recognize when it is sufficiently uncertain and needs to stop and request help. So the fifth element of Cloud Robotics is <strong>Crowdsourcing.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/212/1*RUWdBLloKqIzUva-mekrPw.png" /></figure><blockquote>Until now, Robots have been viewed<strong> </strong>as self-contained systems with limited computation and memory. Cloud Robotics suggest an exciting alternative where robots access and exchange data and code via wireless networking.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/895/1*XunovDx1CURjYpDtwUOAMA.png" /></figure><p>The Five Elements of Cloud Robotics are:</p><ol><li><strong>Big Data:</strong> indexing a global library of images, maps, and object data,</li><li><strong>Cloud Computing: </strong>grid computing on demand for statistical learning, and motion planning,</li><li><strong>Open-Source:</strong> humans sharing robot code, data, algorithms, and hardware designs,</li><li><strong>Collective Robot Learning:</strong> robots sharing trajectories, control policies, and outcomes that can be analyzed with statistical machine learning methods and</li><li><strong>Crowdsourcing and call centers: </strong>offline and on-demand human guidance for evaluation, learning, and error recovery.</li></ol><p>Cloud Robotics will build on related effort including the “Internet of Things,” “IBM’s Smarter Planet,” General Electric’s vision of the “Industrial Internet,” and Siemens’ concept of “Industry 4.0.” These approaches have enormous potential but also open a Pandora’s Box of issues related to privacy and security. But when robots have their heads in the clouds, the sky’s the limit.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/265/1*nw4k1RdGYkaFnGdKBroh4A.png" /></figure><p><a href="http://j.mp/WhyWeLoveRobots"><strong><em>Why We Love Robots</em></strong></a><em> </em>is a five-minute short documentary film (co-directed with my wife, award-winning filmmaker Tiffany Shlain) that combines cultural references and found footage to explore our human fascination with robots and emerging research in Cloud Robotics. It was nominated for a 2104 Emmy Award and won a “Botscar” (Robot film Oscar) at the 2014 Robot Film Festival.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e88ac44def8a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/aspen-ideas/robots-with-their-heads-in-the-clouds-e88ac44def8a">Robots With Their Heads in the Clouds</a> was originally published in <a href="https://medium.com/aspen-ideas">Aspen Ideas</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>