<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Jason Bailey on Medium]]></title>
        <description><![CDATA[Stories by Jason Bailey on Medium]]></description>
        <link>https://medium.com/@jasonrbailey?source=rss-571d3849c90------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*W9WSkf3rc11xJceJ.</url>
            <title>Stories by Jason Bailey on Medium</title>
            <link>https://medium.com/@jasonrbailey?source=rss-571d3849c90------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 12:11:53 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@jasonrbailey/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[DeepDream Creator Unveils Very First Images After Three Years]]></title>
            <link>https://medium.com/@jasonrbailey/deepdream-creator-unveils-very-first-images-after-three-years-1f60390c5fba?source=rss-571d3849c90------2</link>
            <guid isPermaLink="false">https://medium.com/p/1f60390c5fba</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[digital-art]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[art]]></category>
            <dc:creator><![CDATA[Jason Bailey]]></dc:creator>
            <pubDate>Wed, 02 Jan 2019 00:00:00 GMT</pubDate>
            <atom:updated>2019-01-07T20:49:33.412Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*KuzF4VY3fd5PVRF31Psi_w.jpeg" /><figcaption><em>Cats</em>, one of the first DeepDream images produced by its inventor, Alex Mordvintsev</figcaption></figure><p>In May of 2015, Alex Mordvintsev’s algorithm for Google DeepDream was waaay ahead of its time. In fact, it was/is so radical that its “time” may still never come.</p><p>DeepDream produced a range of hallucinogenic imagery that would make Salvador Dali blush. And for a month or so, it infiltrated all of our social media channels, all of the major media outlets, and even became accessible to anyone who wanted to make their own DeepDream imagery via a variety of apps and APIs. With the click of a button, I turned a photo of my wife into a bizarre gremlin with architectural eyes and livestock elbows.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*4NRvyLvr6ckCB5qe.png" /><figcaption>Image I made using a DeepDream app in August, just three months after it was invented by Alex Mordvintsev</figcaption></figure><p>And then — “poof” — DeepDream just kind of disappeared. It is the nature of art created with algorithms that when the algorithms are shared with the public, the effect quickly hits a saturation point and becomes kitsch.</p><p>I personally think DeepDream deserves a longer shelf life, as well as a lot of the credit for our current fascination with machine learning and art. So when <a href="https://artme.ch/">Art Me Association</a>, a non-profit organization based in Switzerland, recently asked if I wanted to interview <a href="https://twitter.com/zzznah">Alex Mordvintsev</a>, developer behind the DeepDream algorithm, I said “yes” without hesitation.</p><p>And when Alex shared that he recently found the very first images DeepDream had ever produced and then told me that he had never shared them with anyone, I could hardly contain myself. I immediately asked if I could share them via Artnome. Well, to be honest, I first asked if I could buy them for the Artnome digital art collection (collector’s instincts), but it turns out Google owns them and has let Mordvintsev share them through a Creative Commons (CC) license. Something tells me that Google probably doesn’t need my money.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*eLlayYrtn7j5O6fC.jpeg" /><figcaption><em>Father Cat</em>, May 26, 2015, by Alexander Mordvintsev</figcaption></figure><p>For me, Mordvintsev’s earliest images from May, 2015, are as important as any other image in the history of computer graphics and digital art. I think they belong in a museum alongside Georg Nee’s <a href="https://collections.vam.ac.uk/item/O221321/schotter-print-nees-georg/"><em>Schotter</em></a> and the <a href="http://nautil.us/blog/the-most-important-object-in-computer-graphics-history-is-this-teapot"><em>Newell Teapot</em></a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*9iILYjtb06HY8uGe.jpeg" /><figcaption><em>Custard Apple</em>, May 16, 2015, by Alexander Mordvintsev</figcaption></figure><p>Why do I hold so much reverence for the early DeepDream works? DeepDream is a tipping point where machines assisted in creating images that abstracted reality in ways that humans would not have arrived at on their own. A new way of seeing. And what could be more reflective of today’s internet-driven culture than a near-endless supply of snapshots from everyday life with a bunch of cat and dog heads sprouting out of them?</p><p>I believe DeepDream and AI art in general are an aesthetic breakthrough in the tradition of Georges Seurat’s Pointillism. And to be fair, describing Mordvintsev’s earliest DeepDream images as “just a bunch of cat and dog heads emerging from photos” is as about as reductive as calling <em>A Sunday on La Grande Jatte</em> “a bunch of dots.”</p><p>That Mordvintsev did not consider himself an artist at the time and saw these images as a byproduct of his research is not problematic for me. Suerat himself once shared: “Some say they see poetry in my paintings; I see only science.” Indeed, to fully appreciate Mordvintsev’s images, it is also best to understand the science.</p><p>I asked Mordvintsev about the origins of DeepDream:</p><blockquote><em>The story behind how I invented DeepDream is true. I remember that night really well. I woke up from a nightmare and decided to try some experiment I had in mind for quite a while at 2:00 AM. That experiment was to try an make a network to add details to some real image to do image super resolution. It turns out it added some details, but not the ones I expected. I describe the process like this: neural networks are systems designed for classifying images. I’m trying to make it do things it is not designed for, like detect some traces of patterns that it is trained to recognize and then trying to amplify them to maximize the signal of the input image. It all started as research for me.</em></blockquote><p>I asked Alex what it was like to see his algorithm spread so quickly to so many people. I thought he might have regretted it getting “used up” by so many others, but he was far less shallow than me in this respect and took a broad-minded view of his impact:</p><blockquote><em>I should probably have been involved in talking about it at that moment, but I was more interested in going deeper with my research and wanted to gain a deeper understanding of how things were working. But I can’t say that after three years of research that I understand it. So maybe I was over-excited in research at the moment.</em></blockquote><blockquote><em>I think it is important that everyone can participate in it. The idea that Iana, my wife, tries to convey is that this process of developing artificial intelligence is quite important for all the people and everyone can participate in it. In science, it isn’t about finding the answer, it is more about asking the right question. And the right question can be brought up by anybody.</em></blockquote><blockquote><em>The way I impacted society [with DeepDream] is that a lot of people have told me that they got into machine learning and computer vision as a result of seeing DeepDream. Some people even sent me emails saying they decided to do their Ph.D.s based on DeepDream, and I felt very nice about that. Even the well-known artist Mario Klingemann mentioned that he was influenced by DeepDream in an interview.</em></blockquote><p>Indeed, I reached out to artist Mario Klingemann to ask him the significance of DeepDream for him and other prominent AI artists. He had this to say:</p><blockquote><em>The advent of DeepDream was an important moment for me. I still remember the image of this strange creature that was leaked on reddit before anyone even knew how it was made and knew that something very different was coming our way. When the DeepDream notebook and code was finally released by Google a few weeks later, it forced me to learn a lot of new things; most importantly, how to compile and set up Caffe (which was a very painful hurdle to climb over), and also to throw my prejudices against Python overboard.</em></blockquote><blockquote><em>After I had understood how DeepDream worked, I tried to find ways to break out of the PuppySlug territory. Training my own models was one of them. One model I trained on album covers which, among others, had a “skull” category. That one worked quite nicely with DeepDream since it had the tendency to turn any face into a </em><a href="https://www.flickr.com/photos/quasimondo/sets/72157661320184201"><em>deadhead</em></a><em>. Another technique I found was “neural lobotomy,” in which I selectively turned off the activations. This gave me some very interesting </em><a href="https://www.flickr.com/photos/quasim"><em>textures</em></a><em>.</em></blockquote><p>Where I had seen sharing the code to DeepDream as a mistake, as it quickly over-exposed the aesthetic, Mordvintsev saw a broad and positive impact on the world which would not have been possible without it being shared. Mordvintsev also took some issue with my implication that DeepDream was getting “old” or had been “used up.” It turns out that my opinion was more a reflection of my lack of technical abilities (beyond using the prepackaged apps) than a reflection of DeepDream’s limitations as a neural net. He politely corrected me, saying:</p><blockquote><em>Maybe you played with this and assumed it got boring. But lately, I started with the same neural network, and I found a beautiful universe of patterns it can synthesize if you are more selective.</em></blockquote><p>I was curious why so many of the images had dog faces. Alex explained to me that he was using a pretrained network called ImageNet, a standard benchmark for image classification that was established around 2010. ImageNet includes 120 categories of dog breeds to showcase “fine-grained classification.” Because ImageNet dedicates a lot of its capacity to dog breeds, it triggers a strong bias in the data. Alex points out that others have applied the same algorithm to <a href="http://places.csail.mit.edu/">MIT’s Places Image Database</a>. Images from the MIT database tend to highlight architecture and landscapes rather than the dogs and birds favored in the ImageNet database.</p><p>I asked Mordvintsev if he now considers himself an artist.</p><blockquote><em>Yes, yes, yes, I do! Well, actually, we are considering my wife and I as a duo. Recently, she wanted to make a pattern for textiles and wanted a pattern that tiled well, and I sat down and wrote a program that tiled. And most generative art is static images on screen or videos, and we are trying to get a bit beyond that to something physical. We recently got a 2.5D printer that makes images layer by layer. I enjoy that a lot. But our artistic research lays mostly in this direction: moving away from prints into new mediums. Recently, we had our first exhibition with Art Me at Art Fair Zurich and we had sponsorship from Google. We are interested in showing our art to the world and trying to explain it to a wide audience.</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*irNKG4DFMPYDwrfj.png" /><figcaption>Alex and Iana Mordvintsev Prepping to show their latest work at Art Fair Zurich</figcaption></figure><p>While I appreciated DeepDream from the beginning, I felt it became kitsch too quickly as a result of being shared so broadly. Speaking with Alex makes me second guess that. It’s now clear to me that Alex did the world a service by making his discovery so broadly available and that he still sees far more potential for the DeepDream neural net (and he would know). There are some critics who just don’t “get” AI art, but as Seurat said: “The inability of some critics to connect the dots doesn’t make Pointillism pointless.”</p><p>As always thanks for reading! If you have questions, suggestions, or ideas you can always reach me on twitter @artnome or via email at jason@artnome.com. And if you haven’t already, I recommend you sign up for the Artnome newsletter to stay up to date with all the latest news.</p><p><em>Originally published at </em><a href="https://www.artnome.com/news/2018/12/30/deepdream-creator-unveils-very-first-images-after-three-years"><em>www.artnome.com</em></a><em> on January 2, 2019.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1f60390c5fba" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[New Data Shows Why Van Gogh Changed His Color Palette]]></title>
            <link>https://medium.com/@jasonrbailey/new-data-shows-why-van-gogh-changed-his-color-palette-e6a41f067aac?source=rss-571d3849c90------2</link>
            <guid isPermaLink="false">https://medium.com/p/e6a41f067aac</guid>
            <category><![CDATA[painting]]></category>
            <category><![CDATA[van-gogh]]></category>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[art]]></category>
            <category><![CDATA[art-history]]></category>
            <dc:creator><![CDATA[Jason Bailey]]></dc:creator>
            <pubDate>Mon, 24 Dec 2018 00:00:00 GMT</pubDate>
            <atom:updated>2019-01-04T18:02:02.833Z</atom:updated>
            <content:encoded><![CDATA[<p>When most people think of Van Gogh, the first color that comes to mind is a warm, radiant, golden yellow. Yellow sunflowers, yellow fields of grain, even the yellow moon in <em>Starry Night</em>.</p><p>But Van Gogh’s paintings did not start out that way. As late as 1885, roughly halfway through the short decade Van Gogh spent painting, he was still in his Dutch period, painting works like <em>The Potato Eaters</em>, which feature dark, muddled, grays, browns, and greens.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*Mp7qx_9WcMvaiQ5X.jpg" /></figure><p>Vincent Van Gogh, <em>The Potato Eaters</em>, 1885</p><p>Curious about this shift from dark to light, we decided to use data visualization techniques to better isolate the moment of transition to a bright yellow color palette.</p><p>As a first step, we sorted every Van Gogh painting by year and then calculated the simple arithmetic average by dividing out the sum of pixels by the total number of paintings. In layman’s terms, we created the “average” Van Gogh painting for each year he was active. We were hopeful that this could pick up some of the subtleties in his shifting color palette over time. There were too few works to get a solid average in the first two years, so we shortened the range to 1882–1890.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*gM8rkTzc_yWEeZzJ.png" /><figcaption>1882</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*yKFOq7XR7TuAZMbn.png" /><figcaption>1883</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*VFIjrTGFwgdPJX13.png" /><figcaption>1885</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*IoC-j1lKtOqyJwR6.png" /><figcaption>1886</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*vZSzwYpZSvrwerfM.png" /><figcaption>1887</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*JSuJPn4LqctzVRu7.png" /><figcaption>1888</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*t9mI6fnfszUr_OTf.png" /><figcaption>1889</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*ALY-fmznhKaquJZH.png" /><figcaption>1890</figcaption></figure><p>In looking at the series of images, there is an unmistakable shift towards a lighter yellow palette starting in 1888.</p><p>We are not first to notice this. There are two popular theories around why Van Gogh shifted his color palette.</p><p>We will briefly look at both theories below and then offer up our own.</p><h3>Did Van Gogh Suffer From “Yellow Vision”?</h3><p>One popular theory behind the shift in Van Gogh’s color choices is that he might have suffered from <a href="https://en.wikipedia.org/wiki/Xanthopsia">xanthopsia</a>, or “yellow vision.” Xanthopsia is a “color vision deficiency in which there is a predominance of yellow in vision due to a yellowing of the optical media of the eye.” When caused by <a href="https://www.aaopt.org/detail/knowledge-base-article/xanthopsia">glaucoma</a>, this can also include halos and flickering, which many think explains why Van Gogh depicts light as radiating outward, as in <em>The Night Cafe</em> (1888) and <em>The Starry Night</em> (1889).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*6VqpkHAhmm9pQ9hK.jpg" /><figcaption>Vincent Van Gogh, <strong><em>The Night Café, </em>1888</strong></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*NPO7DDoRYCu35dOu.jpg" /><figcaption>Vincent Van Gogh, <strong><em>The Starry Night, </em>1889</strong></figcaption></figure><p>Others believe that Dr. Gachet, the physician who treated Van Gogh in his final months at Auvers-sur-Oise, may have treated Van Gogh’s seizure’s with digitalis extracted from the plant fox glove, which is also <a href="https://www.theguardian.com/science/blog/2017/aug/10/it-was-all-yellow-did-digitalis-affect-the-way-van-gogh-saw-the-world">known to cause yellow-blue vision</a> and halos as a side effect.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/770/0*_ZUff33-CB8p-lRk.jpg" /><figcaption>Vincent Van Gogh, <em>Portrait of Dr. Gachet</em>, 1890 (note the fox glove plant shown in the portrait)</figcaption></figure><p>Another frequently cited reason for the shift in Van Gogh’s color palette was his move to Paris in 1886. It is generally assumed that he was inspired by the bold use of color by the French Impressionists.</p><p>We were not convinced by the medical reasoning behind the shift in Van Gogh’s color palette and we could not think of any French Impressionists that painted with colors nearly as bold as Van Gogh, so we decided to take a look at some other possibilities.</p><h3>Did Van Gogh Use More Yellow Because He Moved to a Sunnier Climate?</h3><p>Van Gogh was a restless soul and moved around quite a bit. He also spent a lot of time painting outdoors, especially in his later years. As someone who famously struggled with mood swings, we thought location, and more importantly, weather patterns may have impacted his use of color.</p><p>To test this, we created composite images averaging every painting Van Gogh created from each of the major locations he worked from and compared them to weather patterns from those regions. We think the results are quite remarkable.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*4717NAmwuippezhF.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*0OuKi_T2_bFhh51e.png" /><figcaption>The Hague</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*4J-bYeOpQdrDHJfv.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*EEeytsdGMO2Qx_T4.png" /><figcaption>Neunen</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*07-ObiOQKyaAYthl.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*ZOmQCgehvuPKMw0t.png" /><figcaption>Paris</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*bLd3x6YLlenEbaYk.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*FkkPg3N5mtFehVgo.png" /><figcaption>Arles</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*VTWGa_aue9DzOCER.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*ug42XYf2dR6Uh8wr.png" /><figcaption>SAINT-REMY</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/400/0*F1NsyWi7iuxS_w_m.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*KF-JKCsvtilwRwiH.png" /><figcaption>Auvers-sur-Oise</figcaption></figure><p>Look at the spike in sunshine in Arles as compared to all previous locations! We feel pretty confident that it was the warm weather and bright colors of southern France that influenced Van Gogh’s shift towards bolder colors, not “yellow vision” or exposure to the French Impressionists as previously thought.</p><p>Not only did Van Gogh literally see the world bathed in yellow sun while in Arles and Saint Remy, he was also able to get outside more often as there were literally more sunny days. I don’t think it is unreasonable to assume exposure to the sun and outdoors may also have lifted his mood, causing him to brighten his palette in response, as well.</p><p>Charting the average painting by location also brought some interesting things related to timing to our attention. To make these timing issues even clearer, we created the chart below. Each bar is colored using the average color for paintings created in that specific region. The chart then shows the order in which Van Gogh lived in each region and the total number of paintings produced there.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/0*eCqGtfLoN6Q0fwe_.png" /></figure><p>Note that from this chart we can very clearly see that Van Gogh’s palette shifted <strong>after</strong>, not during, his time spent with the French Impressionists. Let’s call that myth busted.</p><p>It is also clear from the chart that Van Gogh’s palette turned yellow years <strong>before</strong> he became a patient of Dr. Gachet at Auvers-sur-Oise. Second myth… also busted.</p><p>This leaves our theory of increased exposure to sunlight, which the data has shown to support. Of course correlation doesn’t necessarily imply causation, and we can’t say for sure that the weather caused Van Gogh’s palette to switch. But we feel it is a stronger hypothesis than the ones currently out there and Van Gogh certainly left us plenty of clues to support our belief that increased sun was his inspiration for using more yellow. Our favorite:</p><p>Vincent Van Gogh, <em>Vase with 15 Sun Flowers</em>. 1888</p><p>At Artnome, we are big believers that data and new analytical tools can and should be used to provide new context for important art and artists. In this case, we feel relatively confident that by using data visualization, we have ruled out the two most popular explanations for Van Gogh’s shift in color palette: first, illness/medication; and second, Impressionism. We have also used weather data and geo-data to propose a more reasonable theory behind the switch to a bright yellow palette: When Van Gogh moved to the south of France, he experienced a significant increase in sunny days. His world became dramatically brighter and more yellow; he simply painted what he saw (while adding his own artistic license).</p><p>This article would not be possible without the hard work and analysis of <a href="https://www.artnome.com/">Artnome</a> data scientist Kyle Waters. He has made an enormous contribution to <a href="https://www.artnome.com/">Artnome</a> in a short amount of time, and we are excited to continue working with him. In an upcoming article, he will go into more detail around how he calculated the average images for Van Gogh in detail.</p><p>Also, if you like this article, you may also enjoy our other nerdy art articles on:</p><ul><li><a href="https://www.artnome.com/news/2018/11/8/inventing-the-future-of-art-analytics">Inventing the Future of Art Analytics</a></li><li><a href="https://www.artnome.com/news/2018/4/11/quantifying-modrian-journey-to-abstraction">Quantifying Abstraction</a></li><li><a href="https://www.artnome.com/news/2017/10/7/search-all-1800-of-munchs-paintings-using-machine-learning">Searching All 1800+ Of Munch’s Paintings With Machine Learning</a></li></ul><p>Jason Bailey is the founder of <a href="https://www.artnome.com/news/2018/11/26/new-data-shows-why-van-gogh-changed-his-color-palette-to-bright-yellow">Artnome.com</a>, a leading blog focused on exploring art history through data and promoting artists working with cutting edge technology including machine learning and blockchain. You can find him on <a href="https://twitter.com/">Twitter</a> at @artnome and read more at <a href="https://www.artnome.com/">Artnome.com</a></p><p><em>Originally published at </em><a href="https://www.artnome.com/news/2018/11/26/new-data-shows-why-van-gogh-changed-his-color-palette-to-bright-yellow"><em>www.artnome.com</em></a><em> on December 24, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e6a41f067aac" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>