<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Marcelo Soria-Rodríguez on Medium]]></title>
        <description><![CDATA[Stories by Marcelo Soria-Rodríguez on Medium]]></description>
        <link>https://medium.com/@marcelosoriarodriguez?source=rss-4419097b30b9------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*8oAjiQt5pqzQwsO2dtKxtQ.jpeg</url>
            <title>Stories by Marcelo Soria-Rodríguez on Medium</title>
            <link>https://medium.com/@marcelosoriarodriguez?source=rss-4419097b30b9------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 08:05:08 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@marcelosoriarodriguez/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Total Cognitive Space]]></title>
            <link>https://medium.com/data-science/total-cognitive-space-4a571033af82?source=rss-4419097b30b9------2</link>
            <guid isPermaLink="false">https://medium.com/p/4a571033af82</guid>
            <category><![CDATA[product-strategy]]></category>
            <category><![CDATA[strategy]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[deep-dives]]></category>
            <category><![CDATA[thoughts-and-theory]]></category>
            <dc:creator><![CDATA[Marcelo Soria-Rodríguez]]></dc:creator>
            <pubDate>Thu, 29 Apr 2021 18:40:44 GMT</pubDate>
            <atom:updated>2021-05-04T14:24:42.997Z</atom:updated>
            <content:encoded><![CDATA[<h4><a href="https://towardsdatascience.com/tagged/thoughts-and-theory">Thoughts and Theory</a></h4><h4><em>From AI to </em>organizational changes, how<em> we architect what we do shapes the total space of reachable possibilities.</em></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*mw0J4o-tSkA0vpua.png" /><figcaption>artwork by the author</figcaption></figure><p>It’s been a while now that it grew on me that artificial intelligence systems (AIs in short) wouldn’t have a conscience like ours, no matter the technological advancement, unless they are embodied in physical vessels that are a perfect simulation of our own bodies. And not even then.</p><p>Not that it matters a lot, I guess. But as I have been thinking about this every once in a while, some interesting concepts have been emerging and I feel the need to write about them, as I believe it may help think around organizational models and how they face the challenges we all have to tackle in modern times.</p><p>There is much research, and widespread commercial interest, in getting AIs to predict human behaviour with respect to a given scenario. How will we purchase this spring season, when will we switch telephone companies? What products do we prefer, how can we discover new things that we like? The search for an artificial system that can discern the right clues to our behaviour, and in a broader context systems that can discern the reasons why things work so we can improve our response to them, is an important one and it pays to step back and try to look at the problem from a broad perspective. The thing is, when we try to build systems that can understand a part of something, they need to be able to represent that part of that something inside what their total addressable cognitive space can hold. And we are trying to find solutions to problems with systems with inadequate cognitive spaces for the task at hand.</p><p>What is this cognitive space that I am talking about? Let me explain it with some examples. Take for instance an image of one pixel, where the pixel may be black or white. That image knows no more than two possible realities. One human observer may have a reaction to an image that is just black or white, and start assigning meaning to it, each one according to their own experiences, their emotions, reflections, etc. But the image itself cannot represent anything else other than just black or just white.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*ewTCxd6LKimMU5HT.png" /><figcaption><em>One white pixel, one black pixel. Not much to say. (image by the author)</em></figcaption></figure><p>If we make the image a bit more complex, for example made up of 16 pixels by 16 pixels, and where each pixel can be one of 4 colours, we have an image that can represent more things. If those pixels have the capacity of representing many more colors, they can keep growing their representational space.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*kZskRN2ro8nzzEgM.png" /><figcaption><em>Left: a 16x16 pixel image with 4 possible colours per pixel. Right: same sized image but with more colours per pixel; it can aspire to represent Diego Velázquez now. (image by the author)</em></figcaption></figure><p>This example is as obvious as it gets, but it is the same concept that applies to basically every being, every institution, every activity that you do in life. Everything that exists does so in a context. The relationship to the context greatly explains the success of the thing, entity or being that we consider. The relationship to the context depends on this cognitive space that the thing, entity or being can represent.</p><p>In the case of AIs, most of you know at least the basics of how these systems work. They have a model that they use to process a collection of inputs, and provide a collection of outputs. For example, a model that is designed and trained to assess consumer credit risk contains information about certain variables that the designer / modeller thinks will be useful to explain the risk scenario, such as the person’s salary, if they have accumulated previous debt, if they have a history of repayment, etc. The cognitive space of the model is constrained to the variables it has, to the depth of the data within those variables that it has been fed with and so on. A system with a mission to recommend songs may have information about which other songs you like, your age, who are your friends and what they like, etc. A system that coordinates traffic lights in a city may have a model that takes into account the state of traffic, the flow in each street, past predictions, past results, weather information, etc. It’s not so easy to represent as the case of an image that has only two possible states / two possible representations. But the principle is the same. The traffic system has a total number of variables and combinations within that shapes what I am calling its cognitive space: the number of situations that it can represent. If a giant monster comes from space, lands in the city and disrupts traffic, the model cannot be aware of that circumstance because it does not know that is even possible. It’s not within its cognitive space. It will select the best representation it has for the reality it can see from its inputs, cheerfully ignoring the fact that a beast from outer space is sitting down across three blocks downtown.</p><h3>Our own cognitive space</h3><p>What about us? Our cognitive space is also shaped and bound by a number of factors. We don’t know much still about what conscience is, where it comes from, how does our sense of being arise from our existence and so on. There are many models of mind and theories of consciousness, an exciting field of research that I try to follow. From the various theories that circulate I see some common traits. Apparently, it has to do with the integration of the various sensory inputs. It has to do with trying to make sense of what is going on around us, choosing which inputs are relevant to us and to our goals. It has to do with reconciling what is around us with what is inside us: our past experience, what we know, what we remember, what we learned and what we love. It has to do with how we can connect these things together in our brains. So it has to do with the sensory input and the way we can then process that input. Moreover, some of the processing centres in our brains, when exposed to those inputs, react in certain ways releasing certain neurotransmitters which make us feel something. Emotions are also a byproduct of the processing of everything that is going on around us, or so it might seem from the very basic knowledge we are trying to gather around how our brains work. And emotions are one more variable to take into account when we consider the total amount of situations (external &amp; internal) that we can represent in our cognitive space (oh, and they basically direct our behaviour, but that’s a topic for a different article).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*SGyAh05JDbXIwuMv.png" /><figcaption><em>Long distance connections in our brain. For more amazing visuals of and, better yet, research on how our brains are internally connected, check out the </em><a href="http://www.humanconnectomeproject.org/"><em>Human Connectome Project</em></a><em>; image by Anastasia Yendiki, Ph.D., Viviana Siless, Ph.D., MGH/Harvard, Boston Adolescent Neuroimaging of Depression and Anxiety (BANDA)</em></figcaption></figure><p>Our brains have around 84–100 billion neurons (84.000–100.000 million neurons), and around 100 trillion synapses (connections among neurons). We don’t really know how the different types of neurons work, and besides the mere number of neurons and connections there may be many more variables at play when it comes to understand how many different combinations of activations patterns this yields. The possible combinations of all the variables are the tools we have to represent in our mental model whatever is out there, and whatever is inside of us too. It defines the total addressable cognitive space of humans. So whatever our conscience really is, whatever our feeling of self is, it seems it is somehow shaped by how our brains are built, the connections we have, the neurons, how they interact with the world, etc. The total cognitive space that we can handle has an upper limit. Not exactly an upper limit, but rather a given N-dimensional shape: it covers a space defined by all the dimensions that influence it, and it has boundaries across all those dimensions. It does not necessarily cover <strong><em>all that there is</em></strong>. It covers what it can understand. The things that are not representable within this cognitive space will be experienced in a way that makes sense to the person, but may have nothing to do with reality (like the traffic model that cannot know that some Godzilla from Alpha Centauri is having some intergallactic fun some blocks away from the major’s house).This total cognitive space is what is responsible for our adaptation capabilities. We can react to our context as much as our cognitive space allows us to understand it. Same happens to every other system and activity.</p><h3>Your AIs have a different “mental map”</h3><p>I hope you get the point of what I mean by total cognitive space. Now, why did I go into the trouble of trying to explain this idea? Let’s go back to the beginning of this text: AIs wouldn’t have a conscience like ours, I said. No matter how advanced our AIs will be, they will not be just like us in terms of what they are made of. They don’t have our senses, and if we build artificial sensory inputs for these systems (cameras to see, artificial touch sensors, artificial noses, etc.), they would express reality in terms of different signals than those we process. The most similar being we could come up with would perhaps have a total cognitive space with a large overlap with ours, but that’s all. The most probable thing, though, is that such systems would have a cognitive space that would overlap somewhat with ours but with large areas of existence that we would not be able to understand. All we can hope for is to identify properly the overlap and to try to project into it the things we need to deal with that other entity. It brings to my mind the fable of Plato’s cave. We cannot see the reality, but rather the projections of whatever is the absolute reality into what our cognitive space can hold. Those AIs would experience a different projection.</p><p>This opens up several avenues for discussion and reflection.</p><p>First of all, it should remind us of what to expect from the systems we build. Or rather, what not to expect. Can those systems understand us? Most probably not, because they exist in a different cognitive space and therefore their “understanding” of the situations is different. On a more practical note, if you’re building, e.g., recommender systems for humans, don’t forget that your model cannot encode emotion, for example. And therefore it will be very incomplete. You can find workarounds for that which may enhance the cognitive space of the model, but it is inherently impossible for the model to “understand” an emotion, hence it cannot work with it properly. It should also serve to understand from a broad perspective the fact that modelling a situation requires diverse data sources. The more data sources you can have (that is, the more ways you can have to look at a situation), the broader the cognitive space of the model, the better its representational capabilities will be. Not only more points of view: designing and architecting systems with meaningful interconnections between all the sensory input (which includes internal states), with the possibility of interplay between its different parts, is essential. Every new connection between two different elements is a new dimension that expands the cognitive space.</p><h3>It happens in the best families</h3><p>It is obvious that this doesn’t happen only between humans and AIs. It happens across different human cultures, for example. It happens when someone has a neurological problem that alters the total compound of neurons, connections, emotions, experience, etc. and this yields a possible comprehension of the world that is different to that of any “healthy” brain. If we understand that this total cognitive space is not just bound or shaped by the raw ingredients, but how they are cooked at a given point in time (in the case of our minds, for example, it includes what we already know, how we feel about that, our beliefs, etc.) then we can see that the difference between cognitive spaces and their state is also at the root of endless human conflicts. To me, it is very important to take all of this into account when we consider interactions between entities. The possible interaction takes place in the overlap of the cognitive spaces. What is beyond that intersection, that overlap, is something that won’t be recognizable to each of the entities at play. And thus it is hopeless and illusory to try to obtain proper interaction results out of that non-overlapping space.</p><p>It also means that other entities that have a different cognitive space than ours are overly precious. They have a view of things that we cannot see. Anyone seeking to explore and understand whatever is out there, the changes we experience and how to better act should have an interest in finding their proper overlap with those other cognitive spaces. This is where I see the greatest potential in, say, artificial intelligences of the future. Having AIs that have an overlap with us to try to explain what they see, but having capabilities that are different that those of our own and therefore able to create a shared existence that goes beyond what our biological nature allows for. Trying to build systems that mimic our own functioning, hoping to create synthetic creatures that can pass as humans seems to me a bit boring. There’s lots of people to get to know and learn from, why would I want to replicate that? Better to build things that bring something new.</p><h3>Considering broader implications</h3><p>This very simple idea has, from my point of view, lots of implications into how we organize our activities. Since the cognitive space is what allows entities to adapt to their context, why don’t we consider reshaping it in, for example, the companies we build. Too many companies try to push forward not just with their current products and services, but rather with their existing internal organizations (interconnections, politics, governance, dynamics, etc.). As the context changes, they would do well in trying to reshape their cognitive space. The current interest in having a more diverse workforce, for example, is an excellent practice towards this end. Promoting diversity in the workforce brings different experiences, backgrounds, emotions into the company and effectively expands the cognitive space. There are more things to do, however. Diversity in work dynamics, diversity in processes. It may be counterproductive towards optimization, but I think it’s way past the time to only think about optimizing and work instead on building adaptive capacity. That is a topic for a different article, though. The thing is, it will help the company scale in its impact and its understanding of its context.</p><p>It applies also to society, to governments, to education. It’s a simple idea with universal applicability. In future articles I’d like to expand this idea more deeply into how organizations are designed and its implications. Why the decentralized economy is a good idea for humanity. How arts expand their cognitive space and how this, in turn, expands humanity’s.</p><p>Anyway, that was just this simple idea. I’ll be glad to know what you think about it, feel free to reach out to me with your feedback. Thanks for reading this far.</p><p><em>(originally published in </em><a href="https://www.iillucid.com/"><em>https://www.iillucid.com</em></a><em>, the author’s website for opinion, art and random inspirations)</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4a571033af82" width="1" height="1" alt=""><hr><p><a href="https://medium.com/data-science/total-cognitive-space-4a571033af82">Total Cognitive Space</a> was originally published in <a href="https://medium.com/data-science">TDS Archive</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A pledge to end the days of “capturing value”]]></title>
            <link>https://marcelosoriarodriguez.medium.com/a-pledge-to-end-the-days-of-capturing-value-426cd61fbbb3?source=rss-4419097b30b9------2</link>
            <guid isPermaLink="false">https://medium.com/p/426cd61fbbb3</guid>
            <category><![CDATA[art]]></category>
            <category><![CDATA[product]]></category>
            <category><![CDATA[strategy]]></category>
            <dc:creator><![CDATA[Marcelo Soria-Rodríguez]]></dc:creator>
            <pubDate>Wed, 24 Feb 2021 10:50:24 GMT</pubDate>
            <atom:updated>2021-02-24T10:50:24.663Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*pWZv1jiLXkCxv-QkNUlzIg.jpeg" /><figcaption><em>a “capturing value” thing to the left, as opposed to entities trying to create and share opportunities; note the reach of each black dot, and the interesting interactions that arise when sharing entities get close</em></figcaption></figure><p>An often overheard concept when you happen to be near a group of people discussing over startups and/or innovation in general, and corporate innovation in particular, is that of <em>capturing value</em>. Does the new project capture value in customer segment X? Is this startup capturing value in the area of Z?</p><p>All of a sudden, a rather obvious thought came to my mind but it somehow felt like something I should dedicate a couple of minutes to. It’s as simple as this: can we stop capturing value, and start sharing it?</p><p>All the talk about how digital economies are about an endless creation of value due to the non-physical nature of bits / data, yet we use “capturing value” all too often to discuss what human ingenuity comes up with when thinking about certain challenges.</p><p>I came to think about this when trying to paint a semi-clear picture in my mind of what crypto art is bringing to us all. Digital is/was all about sharing and multiplying opportunities. Then at some point I heard something about crypto art allowing creators to capture value… but wait there for a second. The value in art is mostly in the subjective experience. The emotions. You can’t <em>capture</em> that. I am all for the artist having a pretty decent living, but let’s avoid the capturing value thing. Art, and cryptoart as a part of it, is all about opening doors, not closing to capture anything. It’s about opening minds.</p><p>The same applies to the latest, fanciest startup. Let’s start measuring what we do not by how much value it captures, but rather how much it helps someone, how many doors it opens, how much it touches people’s minds, hearts, souls. Making money is also there, sure. But <em>creating</em> must be priority, not <em>capturing</em>, if we are to keep evolving at all.</p><p><em>(originally posted in </em><a href="http://www.iillucid.com,/"><em>http://www.iillucid.com,</em></a><em> if you like what you read give it a look since I post everything there and only seldom here)</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=426cd61fbbb3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[On artificial neurological illnesses]]></title>
            <link>https://medium.com/data-science/on-artificial-neurological-illnesses-1c932bf91192?source=rss-4419097b30b9------2</link>
            <guid isPermaLink="false">https://medium.com/p/1c932bf91192</guid>
            <category><![CDATA[neural-networks]]></category>
            <category><![CDATA[neurological-conditions]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[strategy]]></category>
            <category><![CDATA[product-design]]></category>
            <dc:creator><![CDATA[Marcelo Soria-Rodríguez]]></dc:creator>
            <pubDate>Sat, 20 Oct 2018 22:00:09 GMT</pubDate>
            <atom:updated>2018-10-29T18:16:19.478Z</atom:updated>
            <content:encoded><![CDATA[<p>Frontiers are host to the most interesting combinations of life.</p><p>Where are the frontiers for normal human behaviour? What is personality, what is illness? What makes us go beyond those frontiers?</p><p>In his book “the man who mistook his wife for a hat”, a compilation of several neurological case histories recounted with exquisite style, wit and compassion, Oliver Sacks told the story of a Dr. P who suffered from visual agnosia (the inability to make sense of what you see). Dr. P was a music professor and renowned musician who understood the world around him through music and visual input. He resorted to a sort of rhythm in his activities (getting dressed, eating lunch) or in his context (the way someone walks) to recognize those activities and to know what he had to do. As Dr. Sacks writes in his book: “He sings all the time — eating songs, dressing songs, bathing songs, everything. He can’t do anything unless he makes it a song”. Dr. P could not recognize a flower, instead producing a rich, detailed description of what he had in front of him (“About six inches in length, a convoluted red form with a linear green attachment.”). Until he smelled it (“Beautiful! An early rose. What a heavenly smell!”). He could not make sense of what was on his left field of view, but had no trouble in living life in this way: he was not aware that there was anything <em>wrong</em> in the way he perceived the world around him. Although he would halt to a complete stop when his “inner music” didn’t flow, he wouldn’t think of that as something out of the ordinary, as something that needed attention. That is, he was quite unconscious of what was going on.</p><p>Human cognition is still largely a mystery, but it seems from what we know that our capacity to understand our context and adapt to it has to do with the tight and intimate integration of several complex systems. In the case of vision, following from the previous story, millions of stimuli travel from the retina to the cortical areas related to vision; they are processed in several layers at different depths in the visual cortex, and the output of each layer is then connected to many other areas of the brain which are related to several functions: areas dealing with semantics, memory, emotions, planning, motricity, etc. The same holds true for auditory stimuli, olfactory and so on. Memories too. The brain interconnects and processes all these stimuli in real-time. Emotions, behaviour and a sense of being emerge out of all that.</p><p>But what happens if a number of connections fail? When a bunch of neurons act different than normal? When a neurotransmitter can’t be produced? Or when one of your senses works suddenly different, that is, when the stimuli are unexpected? Oliver Sacks presents brilliantly in his entire writing production many such cases. Perceptions of reality where something is missing. Perceptions that are hard to describe in words and hard to imagine from a first-person standpoint for someone without those conditions. Neurological illnesses emerge, much as consciousness itself, from the interplay of several systems performing relatively simple tasks and where one or more elements are slightly off. And it’s not just altered perceptions of reality. It’s a very wide spectrum of modes of functioning, some of which we identify as illness, some we identify as “types of personality”, some as mere anecdotes in a person’s life. Distinguishing among illness, odd behaviour and strong personalities is beyond the scope of this article and deserves a paused reflection.</p><p>Just as there is a wide array of perceptions of reality and behaviours in us living entities, products and services today start to exhibit their own wide array of behaviours, thanks to artificial intelligence (AI) systems that we humans bake into them. For the sake of simplicity, let me use AI as a broad term going from simple machine learning techniques to complex collections of algorithms operating in unison.</p><p>Almost every respectable digital product and industry has some sort of it. What to listen to next? Spotify, Pandora will make a pretty nice guess at something you might like and that’s, well, a simple form of AI (a machine learning recommendation system, in this case). Where to eat today? There’s a bunch of apps squeezing their algorithms for a suggestion that you’ll like. How to coordinate the ground staff at an airport to serve as many planes as possible in today’s modern, busy airports? There’s an AI for that, and for medical services, energy distribution systems and almost everything you can think about. And it’s great, since AI enables new products, greater efficiencies, scaling services to the world population and so on. That is, when they are healthy.</p><p>We are at the early stages of a long history of the evolution of AI systems. Their behaviours are simplistic, their contextual interaction scopes are limited. The consequences of <em>ill</em> or <em>bad</em> behaviour are also limited. But as systems get more complex, so do their interaction scopes and their behaviours, and in turn the potential implications of these becoming strange or unexpected. How do these future systems look like? As nervous systems increase in complexity, we go from simple amoeba all the way to us humans. As AI systems increase in complexity, we get… what do we get?</p><p>Self-driving cars. Self-flying and self-operating cameras that intelligently follow you and pick the point of view to create unique memories of your life. Machines that can phone a restaurant to book a table. Systems that aid doctors in real time highlighting the tumours with AR during surgery and providing feedback. These are what we already have. Where will we go from here? Hybrid human-AI systems that help us “see” the connections of what lies in front of us. Machines that run companies autonomously. Air travel 100% controlled by AIs. Intelligent teapots. A sofa that warms you up when you are alone feeling a bit blue. Whatever you can imagine.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oS4mIQqP5OF0m10NFNtxpw.jpeg" /><figcaption>a self-driven car possessed by the spirit of a mentally ill artificial intelligence (sort of)</figcaption></figure><p>Much like neurological illnesses emerged as a consequence of the increasing complexity in our nervous systems, artificial neurological illnesses will emerge in the increasingly complex AI systems we build. And they will for the same reason: unexpected connections with unexpected consequences in systems of growing complexity.</p><p>Artificial neurological illnesses are not a classical bug per se. They may be triggered by a classical bug, some may be triggered by unexpected sensory inputs. Some by the history of live data / context they need to adapt to. Some by unexpected interactions among the different systems that make up the AI in question. These are what fascinate me. We will witness unexpected behaviours, emerging behaviours which we didn’t code and we didn’t train those systems for. Behaviours which seem unreasonable for the task that those AIs were created for. Odd behaviours. Perhaps something like these:</p><p>Artificial autism? Autistic brains display tightly interconnected local areas, and poor connection patterns between areas that are apart in the brain. How could it happen? An AI composed of several models working together, where the learning rates are not properly tuned, may end up exhibiting a similar pattern. The model that connects the different models together may assign few dependencies among them, low values to their coupling variables. Some of the individual models may start to overfit. An autistic self-driven car may end up paying attention only to traffic lights and nothing else, and drive in some certain area and refuse to go anywhere else. Was Uber’s self-driving car accident an early sign for this? Failure to consider all the inputs it had, focusing instead on just part of the information available? (we know that was not the case, but it could be soon).</p><p>Artificial paranoia? Some dirt in the camera that feeds images to a vision and reasoning engine may trigger unexpected results from the vision system that propel the reasoning system to a wild understanding of what’s around it. And if this system is connected to some other system that is doing some kind of unsupervised learning, the effects become long-lasting in the system. The self-flying camera starts seeing obstacles where they are not and chooses to fly into a tree.</p><p>Artificial hallucinations? A weather prediction algorithm managing a renewable energy plant that encounters a period of strangely low wind activity and its feedback loops are not trained for that. It starts hallucinating predictions that make no sense, causing an incorrect balance in the energy network. We’ve seen the flash crash in the financial markets, was that an early symptom?</p><p>Artificial depression? A Google Duplex that picks up reservation calls in a restaurant asking people why do they want to go out for dinner when life sucks.</p><p>The current evolution of AI does not point at a near future full of flourishing general artificial intelligence. We probably will not see natural language algorithms embedded in Alexa or Google Now or any other such service developing Tourette syndrome and exhibiting vocal tics or even coprolalia (becoming mouth-fouled, “there’s heavy traffic in your area, you’ll suffer a 10 minute delay, f**k you”). In the short term, however, we may find a growing number of cases where we can’t really explain why your autonomous car has a tendency to scratch other cars bumpers when parking, when it never did so when you started your mutual relationship. We’ve already witnessed how chatbots may drift completely outside of what they were meant to be doing: <a href="https://en.wikipedia.org/wiki/Tay_(bot)">Microsoft´s Tay infamous incident</a> is the beginning of a journey into teenage AIs which have a personality disorder. It may develop Tourette’s at some point.</p><p>How these artificial neurological illnesses play out in the real world is difficult to predict. The wide range of AI skills and capability level makes it basically a one-by-one review case. When our machines develop these ailments, can we teach our AIs to stop and wonder what is going on? To stop execution if they don’t know what they are doing? If they develop the same condition as Dr. P in Oliver Sack’s story, perhaps they can’t.</p><p>This calls for a new perspective on these matters. Humans developed the sciences of psychology, psychiatry, neurology, etc. Maybe we need to train a branch of our current crop of data scientists in the science of machine psychology, machine neurology and machine psychiatry. Artificial neurologists, artificial psychologists, artificial psychiatrists. With Machine Learning we have now… machines that are learning. Maybe soon it will be the time to learn about those learning machines. Because at some point they do evolve somehow out of our control.</p><p>What can we do today? Some ideas:</p><p>1) Improve education, raise awareness. There’s already plenty of (necessary) talk about caring about the biases that we inject into our algorithms, the ethical dimension of how we apply these algorithms, which problems we apply them to, which are the changes in behaviour that we instill in society because of how the algorithm is trained, etc. This list could add this concept of caring for the mental sanity of our AIs. Mental health checks. Perhaps something like the “empathy test” that was applied to replicants in Blade Runner, but designed not to test for “replicant-ness” but rather to test for proper algorithm health (there are some notable proposals that check for bias, for example the<a href="https://turingbox.mit.edu/about.html"> Turing Box</a>; also there are organizations such as<a href="https://algorithmwatch.org/en/"> Algorithm Watch</a>, but these are all focused on ethics / bias / etc., not yet on proper algorithmic health).</p><p>2) Establish best practices where algorithms are published / released always hand in hand with the set of assumptions made, the training set of data used, the test set of data used, the learning metrics, the cost functions, etc. so an artificial neuropsychiatrist or artificial neurologist can have a better understanding of the potential underlying pathology. And how the different systems are interconnected (since we are talking about products / services with several interwoven AIs working together). Which scenarios they are prepared to deal with. By the way, it would be great to have these for humans! So we would know what to expect from ourselves.</p><p>2) Design systems that minimize these effects, perhaps by rejecting non-interpretable approaches. But they are so appealing with their current performance… Or design systems in a way that is easy to perform some sort of artificial magnetic functional resonance, for example: some procedure that lets us “see” into how the algorithm is working right now.</p><p>3) Employ a holistic approach to your digital product design: use people who know people and machines to understand where are the new relationships, the implications, everything. This can prepare us to design better for potential algorithmic <em>mental health</em> problems.</p><p>4) Avoid digital! Ask your friends what to listen to and where to eat, drive your own car. Love the people you love, instead of spending too much time with your machines.</p><p>This will all happen some time from now. Or not. On the meantime, going back to the opening question, where are the frontiers for normal behaviour? It ends where love begins. But how that applies to AIs is a topic for a different article.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1c932bf91192" width="1" height="1" alt=""><hr><p><a href="https://medium.com/data-science/on-artificial-neurological-illnesses-1c932bf91192">On artificial neurological illnesses</a> was originally published in <a href="https://medium.com/data-science">TDS Archive</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>