<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Machine Opinings - Medium]]></title>
        <description><![CDATA[Thoughts on machine learning, human philosophy, and what we do with them - Medium]]></description>
        <link>https://medium.com/machine-opinings?source=rss----92be70e8b391---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Machine Opinings - Medium</title>
            <link>https://medium.com/machine-opinings?source=rss----92be70e8b391---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Thu, 19 Nov 2026 20:27:44 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/machine-opinings" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Quantity Can Have a Quality of its Own for Language Models]]></title>
            <link>https://medium.com/machine-opinings/quantity-can-have-a-quality-of-its-own-for-language-models-fe5e665869a3?source=rss----92be70e8b391---4</link>
            <guid isPermaLink="false">https://medium.com/p/fe5e665869a3</guid>
            <category><![CDATA[philosophy]]></category>
            <category><![CDATA[language]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Vlad Eidelman]]></dc:creator>
            <pubDate>Sun, 09 Aug 2020 12:40:57 GMT</pubDate>
            <atom:updated>2020-08-09T12:55:47.208Z</atom:updated>
            <content:encoded><![CDATA[<p>The recent advances in language modeling with <a href="https://www.skynettoday.com/briefs/gpt3">GPT-3</a> got me thinking: at what point does a quantitative change in a machines language generation ability cross a boundary into a qualitative change in our assessment of its intelligence or creativity?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*kLFldXabqzz5cCcfi5tUJw.jpeg" /><figcaption>A Sunday Afternoon on the Island of La Grande Jatte by Georges Seurat. Many distinct points come together to form a recognizable image.</figcaption></figure><h3>When a sand heap met Eubulides</h3><p>How many grains of sand can you take from a sand heap until it’s not a heap? Or more personally, how many hairs on your head can you afford to lose before you’re bald, or pounds before you’re thin? Maybe it’s fun to annoy someone by asking one of these <a href="https://plato.stanford.edu/entries/sorites-paradox/">Sorites Paradoxes,</a> attributed to the Greek philosopher <a href="https://en.wikipedia.org/wiki/Eubulides">Eubulides,</a> precisely because they arise when language is imprecise. They expose that words we commonly use without hesitation, like heap, bald, thin, or even intelligent and creative, where we think we know exactly what we mean, actually have boundaries that can be quite vague when you really start to dig into them.</p><p>You can think about what’s going on here as a <em>quantitative</em> change: in grains of sand, hair, or weight, leading to a <em>qualitative</em> change that ascribes a property to something, like being a heap, bald, or thin.</p><p><a href="https://www.youtube.com/watch?v=H5JGE3lhuNo">Hegel</a> developed an explicit relation between quality and quantity in <a href="https://en.wikipedia.org/wiki/Science_of_Logic">Science of Logic</a>:</p><p><em>[W]e have seen that the alterations of being in general are not only the transition of one magnitude into another, but a transition from quality into quantity and vice versa, a becoming-other which is an interruption of gradualness and the production of something qualitatively different from the reality which preceded it — Hegel</em></p><p>The idea was then taken further by <a href="https://en.wikipedia.org/wiki/Dialectical_materialism">Marx and Engels</a> into the law of passage of quantitative changes into qualitative changes, and finally arrived in the most familiar and widely misattributed form you’ve likely heard:</p><p><em>Quantity has a quality of its own -Various</em></p><p>While it’s not what any of them had in mind, at what point does a quantitative change in a machines language generation ability cross a boundary into a qualitative change in our assessment of its intelligence or creativity?</p><h3>Language Models and GPT-3</h3><p>The release of <a href="https://arxiv.org/pdf/2005.14165.pdf">GPT-3</a> from <a href="https://openai.com/blog/openai-api/">OpenAI</a> has shown that an <a href="https://www.technologyreview.com/2020/07/20/1005454/openai-machine-learning-language-generator-gpt-3-nlp/">incredibly wide variety</a> of language generation applications — from writing <a href="https://www.gwern.net/GPT-3">fiction </a>to <a href="https://twitter.com/arram/status/1283427352010096640">poems</a> to computer code — can be performed by a fairly typical <a href="https://en.wikipedia.org/wiki/Language_model"><em>language mode</em></a><em>l</em> scaled up and trained on the largest amount of data yet.</p><p>Language models have been used in the NLP community for decades, becoming increasingly more complicated, and relying on more and more data. A language model is a technical term for a <a href="https://machineopinings.com/artificial-intelligence/demystifying-machine-learning-with-your-dog/">mathematical model of language</a> that is produced by an algorithm that uses existing written text to calculate the probabilities of words appearing next to each other, specifically how likely the next word or sequence of words is from a previous sequence of words. After training the language model by computing these probabilities, the model can be used to generate new text: start with a word or phrase as a prompt, and continue calculating the most probable next word for as long as you want.</p><p>When built well, they generate syntactically fluent language, although it used to be fairly easy to tell when text was generated from a model — it was clunky, repetitive, and lost coherence within at most a few sentences.</p><p>The algorithm used to build GPT-3 is still only trained by predicting the next sequence of words, but it is doing so for a model with 175 billion parameters — several orders of magnitude more than most previous language models — and on a huge amount of data taken directly from the internet (i.e. produced by us); a very impressive engineering feat.</p><h3>Fluency, fool me once</h3><p>The most striking aspect of the language produced by GPT-3 is how fluent it is across a variety of genres, how well it stylistically adapts to the given prompt, and how long the coherence of the generated text lasts.</p><p>It’s natural to associate the fluency of language with how intelligent the process that generated the language must be. In other words, it’s hard to separate thinking up something to say from being able to say it well. What to say from how to say it. It’s a human bias that helps explain why we’re taken in by a smooth talker before realizing there’s little substance, or vice versa, assume a lack of cognitive capabilities when someone can’t express themselves.</p><p><em>What to say </em>starts by purposefully selecting some concept to represent in language. Whether the concept is an abstract idea in your mind or a spreadsheet table, it is a form of data, and you want to transform it into language as correctly and faithfully as possible. If you express your idea in language well enough to allow the reader to interpret what you’re saying correctly, your language has sufficient <em>adequacy </em>or<em> accuracy.</em></p><p><em>How to say it </em>comes back to the <em>fluency</em>, whether the language used is understandable, regardless of whatever it is you’re saying. You can write an exceptionally fluent essay on bees, but if you were trying to give someone a quinoa recipe, it’s completely inadequate. A process, whether human or machine, can generate fluent language describing Mars or Elon Musk, and it doesn’t have to have any connection to reality or truth to be comprehensible.</p><p>Fluency without adequacy, that’s easy to imagine. Fluency is on the surface, it’s visible. It can be untethered from trying to represent anything specific and still come off fine.</p><p>What’s harder to imagine is adequacy without fluency. For me to assess the adequacy of what you’re saying, I need to know that you’re trying to give me a recipe, and not talk about bees. Or I need to trust that whoever (or whatever) wrote the facts about Mars I’m reading knew what they (or it) was talking about. In either case, I need to be able to create an interpretation of the concept and data you’re relaying through language. But in order for me to create an interpretation, you need to first be coherent enough.</p><p>Adequacy requires selecting something specific to represent, and being able to compare how well it’s represented. I think that’s why fluency is both easier to artificially manufacture and gives the impression of adequacy. Our cognitive bias is to <a href="https://www.washingtonpost.com/outlook/why-do-we-assume-people-are-telling-us-the-truth/2019/09/06/c51641fc-bf59-11e9-a5c6-1e74f7ec4a93_story.html">default to truth</a>. If language is fluent, we understand it; if we understand it, we create an interpretation of what is being said; if we create an interpretation, we assume it’s accurately representing the concept and data it set out to represent. Why else would someone take the time to write it, right? :)</p><h3>Maybe I’m a language model too</h3><p>When we write or speak, words usually come out of our mouth or our hands without any conscious effort of how they got there. We have an unconscious process for generating the next word, are we similar to a language model in finding the most probable next word from our prior experience with language? Is our ability to write not only fluently but adequately a matter of having several orders of magnitude more parameters in our brains than the current language models, and having seen lots and lots of text?</p><p>Certainly the things we say are not always correct, i.e. what we say is not adequate to what we mean. Whether we think it is or not; people make mistakes. I misremember and make things up, how is that different from the language model is doing?</p><h3>Adaptability is where it’s at</h3><p>Going one step further, the most impressive part of GPT-3 is likely not the fluency of the language it generates, but the ease with which it can perform different tasks with only a few prompting examples. Most machine learning models are trained to perform a specific, discrete task, like predicting the sentiment of a restaurant review, or answering trivia questions, but GPT-3 has shown an impressive ability to perform many different kinds of language generation without being specifically trained to do so.</p><p>Adaptability is a core human trait. We all build models of the world in our minds — of your house, your friends, yourself. You use the model of the world you’ve built from all your prior experience to go into novel situations and make reasonable decisions. Not only do you not forget how to brush your teeth just because the color, size, or shape of the toothbrush changed, but if you have the intent to brush your teeth and there’s no toothbrush around, you can create something that will act like a toothbrush from completely different materials.</p><p>Adaptability is closely tied to creativity, the ability to create something new and worthwhile. Adequacy is critical in a legal memo or biography, and it’s relatively easy to judge the adequacy by comparing these fact-based writings to some reality, but what about fiction, poetry, and other forms of creative writing? How useful or measurable is adequacy there? Is fluency sufficient for creativity?</p><p>The language produced by even the simplest language models from decades ago can be said to create something new, maybe that’s sufficient to say any such process is being creative, but that doesn’t seem like a satisfactory answer.</p><p>If you didn’t know a word of French, but randomly picked words from a French dictionary until you filled 100 pages, and happened to produce a coherent work of fiction, were you being creative? Taken a bit further, if you have a <a href="https://en.wikipedia.org/wiki/Infinite_monkey_theorem">monkey, a typewriter, and infinite time</a>, eventually it will type out any book you can think of, but it’s unlikely you’d call that creative.</p><p>Where do we draw the line? It seems like we need to look at the worthwhile aspect of creativity, but how do we measure whether a work of fiction is worthwhile? (that sounds awfully close to asking what the purpose of art is…)</p><h3>Intent to the rescue?</h3><p>It seems like the adequacy and creativity questions of language models, including GPT-3, come down to <em>introspection and intent. </em>A typical flow in human conversation can be seen as four steps. First, you intentionally choose what to say (let’s leave free will out of this for now). You start with an intent: a concept or idea of what you want to say. Second, you choose words to transform that intent or concept into language. Third, the listener hears or reader reads the words. Fourth, they interpret the words into a concept in their mind.</p><p>You use language for a reason: to transform something conceptual from one form into words. That concept can take the form of a sales report, where your words reference customers, transactions, dollars, profits and losses; or it can be a creative idea for a novel, where you imagine a character, and the words describe a person, their hair color, how they walk, their own thoughts and concepts (I know, meta).</p><p>The point is, when you think of words, they represent something in the real world, they refer to objects, whether real or imagined. Words are connected to your other perceptions of the world, and the actions you can take.</p><p>When GPT-3 produces sequences of characters, that’s all they are, even though we see them as meaning-carrying words. For GPT-3, the words it produces do not refer to any concept, intent it is trying to represent, or action it is trying to take. There is no concept behind the words. When it produces a poem about Elon Musk on Mars, it has no concept of who Elon Musk is or what Mars or a poem are; no connection to any objects.</p><p>Instead of the four steps above, when you read text produced by a language model like GPT-3 it’s different in a very important way. The language model doesn’t have its own intent. It’s not an agent acting in the world. A human has to start by prompting GPT-3 with the seed text. The language model is taking your concept, that you transformed into words, so you’re still doing the first two steps, and continues the second step by generating words that are the most probable to occur next in the sequence.</p><p>The human prompter seems more analogous to a teacher prompting an essay topic that the student (GPT-3) needs to write. We as humans are still reading and interpreting a meaning, because for us words actually have meaning and refer to objects, but those references were not intended by the model. The fact we can interpret them is a result of the fluency, not adequacy.</p><p>Even for creative writing, there’s a reason why someone wrote a poem or a novel, and one or more concepts they were trying to express. Maybe we need to separate out creativity into the process of introspection, the effort that goes into the proper translation of a concept into language, and the final linguistic expression.</p><p>GPT-3 has certainly produced writing that is funny, sarcastic, or makes you think, so it would qualify for the third form of creativity. Since it has no understanding of the words, through no intent of it’s own is it trying to be funny, sarcastic, or make you think. Those are your interpretations, and could even be a result of GPT-3 using large sequence of words it has previously been given directly from people’s writings on the internet.</p><p>Many of the examples of its writing are also cherry picked by humans. Maybe it would be unfair to do otherwise, after all, many human attempts at writing fail, but are we then using our human standards and judging, or are we choosing a biased sample produced by a small percentage of monkeys?</p><p>The lack of intent to be funny or make you think can similarly be said for writing produced by people, so perhaps the effect on the reader is what matters. If some future language model can produce thousands of novels a day whose storylines and characters resonate with readers and sell, despite the model not having any intent to do so, maybe it will be quaint that I think something critical is missing on the side of the writer.</p><h3>Intelligence is as intelligence does</h3><p>It’s clear that with GPT-3’s size and training data it has been able to achieve language generation capabilities that necessitate sharpening some of the questions we need to understand about machine intelligence. It’s taken fluency, adaptability, and perhaps even a form of creativity, to a level we have not seen before in language models. While some qualitative transitions in our interpretations of its writing seem to be justified, it should not be seen as having qualitatively crossed the boundary for the general type of intelligence we associate with people. Without the ability to connect the words it produces to concepts in the world beyond other words, how can it be said to understand, and without understanding what it’s saying, how can something be intelligent?</p><p>If in the future this mathematical model of language is coupled with other types of models for vision, action, and other perceptions, we may have something that does have concepts that imbue adequacy to its language. We may also need to be more exact in our definition or what “intelligent” or “intelligence” means, and define different kinds of intelligence. There has certainly been continuous progress in the biological sciences to understand our own and other animal cognitive behaviors, abilities, and limitations. But if the problems of defining precisely what AI is for the last 70 years, and other far simpler seeming terms, like heap, are any indication, precision in our definition may be a moving target. Maybe there’s a range of behavior where it’s truly indeterminate if something is exhibiting intelligence or creativity or not. Or maybe the meaning comes down to how we use the words, and what function they serve in our everyday language. If we think of something as intelligent or creative, then it is.</p><p><em>Originally published at </em><a href="https://wp.me/pawOsu-zI"><em>machineopinings.com</em></a><em> on August 8, 2020.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fe5e665869a3" width="1" height="1" alt=""><hr><p><a href="https://medium.com/machine-opinings/quantity-can-have-a-quality-of-its-own-for-language-models-fe5e665869a3">Quantity Can Have a Quality of its Own for Language Models</a> was originally published in <a href="https://medium.com/machine-opinings">Machine Opinings</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Demystifying machine learning with your dog]]></title>
            <link>https://medium.com/machine-opinings/demystifying-machine-learning-with-your-dog-5deffecfb3cd?source=rss----92be70e8b391---4</link>
            <guid isPermaLink="false">https://medium.com/p/5deffecfb3cd</guid>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[philosophy]]></category>
            <dc:creator><![CDATA[Vlad Eidelman]]></dc:creator>
            <pubDate>Sun, 13 Jan 2019 23:01:01 GMT</pubDate>
            <atom:updated>2019-01-13T23:01:01.024Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*2lUv_zW_HZnvpFo01MwmLA.jpeg" /></figure><p>When someone learns what I do I often find myself explaining why despite what they may have heard, AI is not becoming conscious and taking over the world. I usually try demystifying machine learning by making an analogy to something familiar that would never be considered capable of that kind of domination. So when a fellow dog owner and I had this conversation recently at the dog park, I used our dogs as the example, and although it’s an imperfect analogy, it seems to do the trick.</p><h4>How a dog learns</h4><p>If you want your dog to do something on command, you start by getting her to do it, and then saying something or showing her something at the same time and giving her a treat. After seeing this over and over, your dog starts picking up a pattern, and forming an association between the auditory signal (e.g. vocal command) or visual signal (e.g. hand gesture) and the desired action.</p><p>So if you’re successful, when you say <em>sit</em>, she realizes it’s not just random noise, but that there’s a significant correlation of getting a reward if she takes your word as input, and outputs her butt on the ground.</p><p>Ask any dog owner however, and they’ll tell you it’s not over yet. She may have mastered <em>sitting</em> in your living room when you say the word just so, but has no idea what to do with when you try the same thing in the kitchen, or on the field outside, or when someone else says it.</p><p>She memorized a behavior under one very specific set of circumstances, but hasn’t learned she needs to apply it in others that aren’t exactly the same. To her sitting in the living room isn’t the same as in the field, and she only knows to do it in places where it’s been taught. The input to her isn’t just the word, but the conditions under which it was said too. That’s why you need to repeat the same training under different conditions — places, times of day, emotional states, people, and ways of saying it. The more <em>inputs</em> (conditions under which you ask her to sit) you give her, the better she will learn to sit when the input isn’t exactly the same as what you’ve taught her before. She learns to generalize.</p><p>So boiling this down, we have a <em>learner</em> (the dog), a desired output (sitting), and a set of inputs (conditions where you ask her to sit). The bigger the number of inputs, the more general her understanding of sitting will be.</p><p>But here’s the thing — there’s a limit to how general she gets. Even if you travel the world, training her to sit everywhere, she doesn’t really know what <a href="https://en.wikipedia.org/wiki/Sitting"><em>sitting</em></a> is. She doesn’t know there are different kinds of sitting, or that she does it by bending her knees (she doesn’t know she has knees), or that other animals can sit too, or that it’s related to standing but the opposite. In other words, she doesn’t have the same semantic mapping of that concept that you and I have. Her brain isn’t capable of understanding all those relations. All she knows is that when she hears that sound she should park it.</p><h4>From a dog to machine</h4><p>Now replace the dog learner above with an algorithm that solves a math equation, and that is machine learning. We provide a large number of inputs and outputs (images with faces, documents with topics, financial transactions with fraud) and expect our algorithm to find enough correlations in the different inputs with the output so that it can set the right values for variables in an equation that we can then use to predict the correct output for an input that isn’t exactly like any of the ones we’ve seen before.</p><p>Successfully building a machine learning model assumes that we know what <em>conditions</em> (called features in machine learning) are important to include in the input, so we’re not overfitting to some very specific circumstances without realizing it, and that we have enough input examples to sufficiently represent those conditions.</p><p>Crucially however, the <em>learning</em> we’re talking about is taking the input, and counting which conditions have a significant association with predicting what’s explicitly given as the output. In the dog’s case, it should learn that none of the conditions (time of day, weather outside, room in the house, etc.) except one are important, because each occurs infrequently with the expectation of sitting, all except hearing the sound <em>sit</em>.</p><p>In the case of predicting which topics a document is talking about, the input conditions that we use to represent it are typically the words in the document, and the algorithm will associate the presence of words like <em>health</em> and <em>hospital </em>with the Health topic output. Not because it <em>knows</em> what <em>health</em> or <em>hospitals</em> are, it doesn’t, but because it will count how often those particular character sequences (that we call words) occur, and assuming things are working properly, find that they more often than not occur in documents that a human has previously labeled as Health. The algorithm will use any character sequence occurring disproportionately in Health related documents as long as it’s useful for predicting the output — even if it’s garbage and when you look at them as a human they aren’t Health related at all.</p><p>In the case of predicting whether there’s a face in a photo, the conditions representing the image are typically the pixels composing it. The only place where one set of pixels is called a face and the other isn’t is in your head. To the math equation both are just sets of pixels, just a combination of color settings, and the output label <em>face</em> is just a set of characters that you as the human have applied to one set of pixels but not the other.</p><p>But the algorithm doesn’t <em>know </em>what a face is, or what health is, any more than a dog knows what sit is.</p><h4>Learning matters</h4><p>A large part of the misinterpretation of machine learning is that we use the word — <em>learning</em> — as shorthand to represent what the algorithm is doing. <em>Learning </em>comes with all sorts of baggage that presupposes certain things. It’s easier if we replace it with <em>computing,</em> or <em>counting, </em>or something else that explicitly denotes that what’s happening is a math operation.</p><p>So let’s rewrite what machine learning is doing. Let’s go from:</p><blockquote><em>It learned how to recognize faces</em></blockquote><blockquote><em>It learned how to classify documents into topics</em></blockquote><p>to</p><blockquote><em>It solved for variables in a math equation based on the cooccurrence of pixels and an arbitrary human provided label.</em></blockquote><blockquote><em>It solved for variables in a math equation based on the cooccurrence of character sequences and an arbitrary human provided label.</em></blockquote><p>Doesn’t sound quite as impressive or scary does it?</p><p>Rodney Brooks has a nice explanation of how we confuse <a href="https://rodneybrooks.com/the-seven-deadly-sins-of-predicting-the-future-of-ai/">performance with competence</a>. When a person can recognize faces in photos well, we assume they could recognize a stop sign, or know if the face is that of an adult or child, or know if the face is that of a friend. These are all tightly coupled competencies for us. But we then assume that a machine learning model that can label faces has the same competence of a person who can. It doesn’t. It has no idea it’s labeling faces, and thus none of those other tightly coupled competencies come along. So maybe we can build a machine learning model to recognize stop signs. It’s likely we can if we know we can differentiate one set of pixels from another. But it’s going to take the same amount of work it took to build a machine learning model to recognize faces.</p><h4>A little validation goes a long way</h4><p>Say your dog can now sit fantastically. Kudos. She doesn’t think “it’d be great to know more!”, and she won’t just start assuming jumping up is a good thing and do it, or start rolling over, laying down, swimming or anything else. You could probably train her to do those things, but each one will require starting from scratch and repeating the process all over again.</p><p>The first time we trained a dog to perform <em>some</em> action based on a vocal command, we discovered something. We didn’t know it could be done. After that though, each new vocal command is just validating that dogs can be trained to respond to vocal commands. Some commands may take more work to train, more repetitions, we may not be sure how well a dog can do it, but when she does it’s not really that surprising, nor does it advance our knowledge of dog training or dogs that much.</p><p>So when news comes out that there’s an AI model that can assign sentiment to tweets, and then another AI model can predict how a Supreme Court justice is going to vote, and then another one can predict stock market movement from press releases, it naturally feels like we’re advancing our knowledge of AI. In reality, though, we’re just teaching the same dog new tricks. We’re most often using the same math equation and algorithm to find correlations; the only difference is the data that goes into them. So go us for validating that AI works on different data, but it’s not surprising, nor is it a sign AI is getting more powerful.</p><h4>Self-motivation</h4><p>So what about the cases where it seems the algorithm discovers something unintentionally, like inventing a new language? Well, what if when you said sit your dog did five circles and then barked? Did she invent a new way of sitting? No, you’d get annoyed she isn’t doing what you asked her to. She failed to learn what you wanted, she learned some noise instead.</p><p>If, on the other hand, you explicitly train a dog to discover cadavers or drugs, she will discover them in all sorts of new situations, but she’s still only doing exactly what you trained her to do. And if she bring back a packet of thyme, she didn’t add thyme discovery to her repertoire, she failed to discover drugs.</p><p>Every machine learning algorithm we have is explicitly executing a known set of operations on the data we give it. By definition, it has no capacity for anything beyond what’s explicitly encoded in the input, nor predict anything other than what is given as the output.</p><p>So it doesn’t make any sense to talk about a model <em>wanting</em> to learn anything beyond the task we trained it for. It’s an equation, equation’s don’t want things. Only humans want things, and in this case they want the equations to do things.</p><p><em>Originally published at </em><a href="https://machineopinings.com/2019/01/05/demystifying-machine-learning-with-your-dog/"><em>machineopinings.com</em></a><em> on January 5, 2019.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5deffecfb3cd" width="1" height="1" alt=""><hr><p><a href="https://medium.com/machine-opinings/demystifying-machine-learning-with-your-dog-5deffecfb3cd">Demystifying machine learning with your dog</a> was originally published in <a href="https://medium.com/machine-opinings">Machine Opinings</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Machine Learning and Philosophy]]></title>
            <link>https://medium.com/machine-opinings/machine-learning-and-philosophy-def472f2726d?source=rss----92be70e8b391---4</link>
            <guid isPermaLink="false">https://medium.com/p/def472f2726d</guid>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[science]]></category>
            <category><![CDATA[philosophy]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Vlad Eidelman]]></dc:creator>
            <pubDate>Fri, 11 Jan 2019 04:45:00 GMT</pubDate>
            <atom:updated>2019-01-11T04:45:00.030Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*z_mpii0_UVfE5z0axQ0z0g.jpeg" /><figcaption>JAKARIN2521 / ISTOCK</figcaption></figure><p>For as long as I can remember I’ve been interested in how we (as humans) know things. But more than that, I wanted to <em>create </em>things that know things, to build something that could learn, understand and interact naturally with us. Of course at first I didn’t know that what I was interested in was philosophy, specifically a branch called <a href="https://en.wikipedia.org/wiki/Epistemology">epistemology</a>, and that creating intelligent machines was the aim of <a href="https://en.wikipedia.org/wiki/Artificial_intelligence">artificial intelligence</a> (AI).</p><p>I remember as an undergraduate a philosophy professor said something that stuck with me — great philosophers aren’t those that have the answers, but those that ask important questions. Philosophy aims to understand the world around us, why we do what we do, how we know what we know; it’s not about having the right answer as much as to keep asking questions.</p><p>Historically most sciences start off as part of philosophy, and then once they become better understood split off into distinct subjects. The hard, scientific part, where hypotheses are conjectured and empirically evaluated, usually becomes associated with the science, and the squishier aspects remain in philosophy.</p><p>Computer Science and its AI subfield are no different. At first computer scientists like <a href="https://en.wikipedia.org/wiki/Alan_Turing">Turing</a> and <a href="https://en.wikipedia.org/wiki/John_von_Neumann">Von Neumann</a> engaged both philosophical and technical aspects of AI. But today with the increasingly successful practical applications of machine learning, most AI practitioners, more accurately machine learning practitioners, focus on how to apply it to solve specific problems. This has led to considerable advancements in our scientific understanding, but without much consideration in the machine learning community for the societal understanding of the implications, or their relation to the vast heritage of philosophical ideas.</p><p>However, many topics being discussed today in relation to AI have been mulled over in some form for millennia. For instance, data is one of the foundations for any AI, and what philosophy isn’t about data ? Data represents information. Questions of how we acquire information, how we can trust it, how we know if it’s true, and so on are the cornerstone of philosophy.</p><p>As machine learning has delivered tangible benefits, in the last decade it has gained recognition beyond the research community and sparked renewed public interest, becoming the subject of popular discussion. Unfortunately, instead of bridging the technical and popular understanding, most of this discourse has increased the misunderstanding and hype around machine learning and AI.</p><p>This is both frustrating and expected. Machine learning related scientific publications usually focus on a rather small technical improvement to already existing methods on a narrowly defined problem. And while there’s a tremendous amount of content discussing challenges and providing advice on how to perform machine learning, there are unfortunately still few places where those discussions and ideas get translated to a wider audience in a meaningful way.</p><p>When making the transition to popular news most of the caveats are lost. It’s much more captivating to the imagination to lead with bots inventing a new language, or taking over yet another job. Coupled with the incentive, especially for companies, but one well-meaning researchers fall into as well, to promote and market their advancements, it becomes impossible for most people to distinguish actual achievements — advancements in knowledge — from applying or slightly tweaking what we already know. This makes it seem like new advancements are constantly made, whereas in reality we slowly expand our small set of capabilities and apply them to different data.</p><p>This misrepresentation has a perceptible negative effect, leading to unrealistic expectations, followed by skepticism and ultimately rejection by those in society who could benefit. I’ve experienced this first hand in dozens of introductory presentations on machine learning to lay audiences and countless meetings with consumers of the machine learning enabled features I work on. The most gratifying moments are when a 70-year old lawyer comes up afterwards and says “I get what that news service is doing, they’re just clustering the text vectors of documents similar to what I’ve read before.” Yes! Or when someone realizes that machine learning is just learning the importance of some data by counting patterns, and it’s not magic. Yes!</p><p>In <a href="https://machineopinings.com/">Machine Opinings</a> I hope to connect the machine learning community with those who couldn’t care less about the details but are increasingly surrounded by it. I’ll specifically endeavor to take philosophical ideas and make somewhat tenuous connections between machine learning and philosophy in an effort to relate and examine machine learning concepts, how we use them, and how we engage with AI in the real world. In other words, hopefully to raise lots of questions, and maybe a few answers 🙂</p><p><em>Originally published at </em><a href="https://machineopinings.com/2018/12/04/machine-learning-and-philosophy/"><em>machineopinings.com</em></a><em> on December 5, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=def472f2726d" width="1" height="1" alt=""><hr><p><a href="https://medium.com/machine-opinings/machine-learning-and-philosophy-def472f2726d">Machine Learning and Philosophy</a> was originally published in <a href="https://medium.com/machine-opinings">Machine Opinings</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>