<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Adobe Machine Intelligence Design - Medium]]></title>
        <description><![CDATA[We believe advancements in machine learning and artificial intelligence are shifting the way people interact and create with digital tools, and that a user-centered approach to machine intelligence includes considerations of ethics, learning, language and more. - Medium]]></description>
        <link>https://medium.com/adobe-machine-intelligence-design?source=rss----8328e3348dd1---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Adobe Machine Intelligence Design - Medium</title>
            <link>https://medium.com/adobe-machine-intelligence-design?source=rss----8328e3348dd1---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 08:11:00 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/adobe-machine-intelligence-design" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Imagining Doubtful Creative Tools]]></title>
            <link>https://medium.com/adobe-machine-intelligence-design/imagining-doubtful-creative-tools-a83ca83b462d?source=rss----8328e3348dd1---4</link>
            <guid isPermaLink="false">https://medium.com/p/a83ca83b462d</guid>
            <category><![CDATA[design]]></category>
            <category><![CDATA[creativity]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[doubt]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <dc:creator><![CDATA[Madeline Hsia]]></dc:creator>
            <pubDate>Mon, 21 Oct 2019 19:23:04 GMT</pubDate>
            <atom:updated>2019-10-15T16:36:16.004Z</atom:updated>
            <content:encoded><![CDATA[<h4>Thoughts on the intersection between doubt and Machine Learning</h4><h4><strong>Creativity is fuzzy and wobbly, why aren’t creative tools?</strong></h4><p>Creatives constantly seek new inspirations and tools to push the boundaries of what can be made with their digital tools. Machine learning features can further this boundary-pushing by leveraging the role of doubt and uncertainty in the creative process.</p><p>Machine learning uses <a href="https://en.wikipedia.org/wiki/Fuzzy_logic">fuzzy logic</a> that’s similar to human logic and involves confidence scores, numbers that qualify the machine’s confidence of its output based on its probability. While a high confidence score is important in many circumstances — you wouldn’t ship an auto-transcription feature that gets 50 percent of the words wrong — when it comes to the creative process, the concept of what is “right” and “wrong” is subjective.</p><p>Limitations, experimentation and stream-of-consciousness thinking are all valuable parts of the creative process. It might be the inexplicable loose connection, cultural relevance, or some obscure failure of a machine learning feature that inspires the user. We don’t need to strive for an unachievable perfect accuracy before introducing machine learning features into everyday creative tools.</p><p>After all, neural networks were inspired by neural connections in the human brain, first conceived in Alan Turing’s 1948 report of the concept he called “<a href="http://people.csail.mit.edu/brooks/idocs/IntelligentMachinery.pdf">Unorganized Machine</a>.”</p><p>Below are images generated by DeepMind’s BigGAN. The first image is the algorithm’s neutral state without being assigned any category, and each image afterward is assigned an increased understanding of goldfish (0.0–1.0). The image in the middle is poetically represented as a glowing, underwater bubble. We do not know why this is, but the results are stimulating.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ev8sRV3q9iOrcPyj.png" /></figure><p>What if creative tools leaned into the fuzzy and often unexplainable nature of our creativity and intents?</p><p>What would it be like if creative tools were more similar to our brains, and considered our doubts, emotions and fluidity?</p><h4><strong>Bugs and Failure as Inspiration</strong></h4><figure><img alt="Nam June Paik’s Magnet TV: a TV with a large magnet on top and distorted signals on the TV screen." src="https://cdn-images-1.medium.com/max/1024/0*_OX97m1ZbeGdxmzf.jpg" /><figcaption><a href="https://whitney.org/collection/works/6139">https://whitney.org/collection/works/6139</a></figcaption></figure><p>Using limitations to create process-oriented art has a long history before computers (e.g. <a href="https://www.sfmoma.org/watch/jackson-pollocks-drip-painting-process/">Jackson Pollock</a> and <a href="https://www.theguardian.com/artanddesign/2010/jul/10/john-cage-composer-drawings-exhibition">John Cage</a>). Since computers and televisions were invented, entire genres like <a href="https://en.wikipedia.org/wiki/Glitch_art">glitch art</a> and <a href="https://en.wikipedia.org/wiki/Pixel_art">pixel art</a> have emerged that turned technological limitations into aesthetic playgrounds.</p><p>In Magnet TV (1965), artist Nam June Paik used magnetic interference to create an abstract pixel sculpture inside a TV by altering its reception. Computational artists have been inspired by failures of computer programs and made art with them for decades. Like Paik, they do so by observing the technology with its limitations, often divorced from its intended purpose — they play with computation as a direct medium.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*q7UEUEd0cQWGnhtB.jpg" /><figcaption><a href="https://hisashi-oguchi.com/criticism/241/attachment/rhizomatics-x-elevenplay-discrete-figures">https://hisashi-oguchi.com/criticism/241/attachment/rhizomatics-x-elevenplay-discrete-figures</a></figcaption></figure><p>In the live performance discrete figures (2018) by Rhizomatiks Research and dance company ELEVENPLAY, artist Kyle McDonald used a <a href="https://google.github.io/seq2seq/">seq2seq model</a> with dance pose data to train a generative dancer but chose to cut the learning short and keep the generated dance glitchy and <a href="https://en.wikipedia.org/wiki/Uncanny_valley">uncanny</a>. In a powerful moment in the middle of the performance, the human dancer starts to imitate the half-learned dancer projected in an AR dance duet. The artists describe <a href="https://newyorklivearts.org/event/discrete-figures/">the project</a> as a “quest for a new palette of movement to foster undiscovered modes of expressive dance that transcend the limits of conventional human subjectivity and emotional expression.” By leaning into an imperfectly trained model, they did so quite successfully.</p><p>As creative machine learning is democratized, users can probe at the algorithms and analyze their opaqueness and inaccuracy, interacting with the algorithm on a deeper level and opening up new channels of experimentation and creativity.</p><h4><strong>Doubt and User Experience</strong></h4><p>So, how do we begin to design doubt in machine learning into creative tools?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/500/0*o0h3LGwMXGkmhm0R.png" /><figcaption>A random bitmap <a href="https://www.random.org/bitmaps/">https://www.random.org/bitmaps/</a></figcaption></figure><p>Today, users often come to their computers with uncertainty, and user experiences have evolved to accommodate it. We use Google’s “I’m Feeling Lucky” to learn about something we might have never searched, random name generators to help us come up with unique usernames, and smarter font matching or color palette generators to quickly explore design options. There is a lack of certainty, but because we expect a potentially unexpected or random outcome, the experience is pleasant and rewarding.</p><p>We can design for creative machine learning features by setting the right expectations and building robust tools that express doubt and value exploration and fun.</p><p>We should consider how the interface affects user expectations and directs actions. For example, the size of the search bar affects the type of search terms entered, the fixed size and rectangular shape of the window frames might convey that the tool is a static and contained piece of software, and a standard “confirm” button on a learned, context-dependent feature might make users expect a robust, personalized result.</p><p>Rather than expecting both the tool and user to be certain about their abilities and intents before taking an action, what if we communicate doubt via language and interface aesthetics to build an enriching and mutual creative environment?</p><ol><li><strong>Express doubt through language</strong></li></ol><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*6SX3kTNhlBqgU9GU" /><figcaption>Somewhere near the Charles Kuonen Suspension Bridge, Switzerland</figcaption></figure><p>Imagine a feature that generates semantic brushes based on what is in a photograph. The feature uses a semantic understanding of the image to see that it includes autumn trees and suggests a photorealistic tree brush to paint with. The brush could have a refinement slider that allows the user to move between unrelated brushes (e.g. skyscrapers and jet planes) and perfectly related brushes (e.g. more autumn trees). This feature would use a 0–100 percent confidence score to indicate its confidence that the suggested output is related to the existing image, but using the technical term “confidence” assumes that the user wants realistic suggestions. Using more open-ended, neutral language like “related” and “unrelated” or even visual representations of the recommendations expands the space for exploration.</p><p>Aside from receiving uncertainty <em>from</em> the machine, we might also consider how users can communicate doubt <em>to</em> the machine. Allowing users to communicate their own doubts in the creative process in general can make a tool more accessible. Imagine if a user could program a tool to understand that when they say “bleh,” it means they are uncertain about the current results, prompting the machine to make broader or more surprising suggestions. They might also be able to dictate how precise they need the outputs to be for a particular goal.</p><p>A more mutual and communicative relationship can be fostered by leveraging ML alongside machine and user doubt.</p><p><strong>2. Express doubt through interface</strong></p><figure><img alt="Screenshots of various Kai’s Power Tools showing its colorful, playful, and textural UIs" src="https://cdn-images-1.medium.com/max/1024/0*UlzFjLtMqiyuajxb.png" /><figcaption><a href="http://macintoshgarden.org/author/kai-krause">http://macintoshgarden.org/author/kai-krause</a></figcaption></figure><p>Kai’s Power Tools from 1992 had unconventional looks and names (Explorer, Goo, Photo Soap, Power Show) that brought users into a surreal world of image editing. It provided an experimental and playful space where your mind could be messy and your digital creative workspace is littered with colors and textures.</p><p>The style of a user interface helps users build a mental model of the tool and grasp the tool’s purpose. Our mental models have evolved as interface styles developed throughout the years, from skeuomorphic buttons and shadows to today’s flat, geometric, hyper-productive UI. Not suggesting that it’s time to bring back skeuomorphic interfaces, but the visual aesthetics of an interface must be thoroughly considered when it comes to building intelligent functionality into creative tools.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*wOiSuOr8w2J_NyATeuQ1tA.png" /><figcaption>What shape is the internet? by Noah Veltman <a href="https://noahveltman.com/internet-shape/">https://noahveltman.com/internet-shape/</a></figcaption></figure><p>Imagine a wobbly button that indicates uncertainty, or a window that isn’t rectangular. What if users could specify the shapes of their tools the same way they can choose dark mode and different color schemes?</p><p>Instead of confirming or canceling an action, what if users were unsure about their intent during the exploration phase of a project? Instead of using workarounds like manually pasting variations, going through undo-redo cycles, or saving each iteration individually, an intelligent creative tool could be designed from the start to embrace both machine and user uncertainty, expanding the boundaries of the digital creative tool.</p><p><strong>3. Express doubt by default</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*VXPq4v7ZFLnq8zMF.jpg" /><figcaption>Learning To See (2017) by Memo Akten <a href="http://www.memo.tv/portfolio/learning-to-see/">http://www.memo.tv/portfolio/learning-to-see/</a></figcaption></figure><p>AI Pioneer Stuart Russell is working on redefining what he calls “<a href="https://humancompatible.ai/">human-compatible AI</a>,” or AI that embraces human uncertainty. He works specifically with robots, but his ideas translate to machine learned creative algorithms.</p><blockquote>His human-compatible AI follow three rules:</blockquote><blockquote>1. The robot’s objective is to maximize realization of human values.<br>2. The robot does not know what those values are.<br>3. Human behavior provides information about human values.</blockquote><p>Russell suggests that human-compatible AI should be uncertain because humans are uncertain. Its values are defined as the human and machine seek to understand each other better. Imagine a creative tool that did the same.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/500/0*5yKtiVetnwQDgZGg.jpg" /></figure><p>The recent uptick in creative machine learning gives toolmakers many opportunities to explore and innovate. Recognizing the tool as an extension of the user, the “unorganized machine” provides a provoking companion to the fuzzy, intuitive thinking that is a natural part of the creative process. As intelligent creative tools develop, their designers should lean into the uncertainty, rather than shy away from it.</p><p>Thanks to <a href="https://medium.com/u/e3c00fc60ccd">Lisa Jamhoury</a>, <a href="https://medium.com/u/1ef720d5fe5d">Patrick Hebron</a>, <a href="https://medium.com/u/41ed975a8efb">Archie Bagnall</a>.</p><p><em>Machine Intelligence Design is a team at </em><a href="https://adobe.design/"><em>Adobe Design</em></a><em> promoting a user-centered approach to machine learning and artificial intelligence in creative tools, while simultaneously working to establish deep understanding of how these technologies are changing the ways we interact and create.</em></p><p><em>We are </em><a href="https://adobe.design/jobs/jobpost-80087/"><em>hiring</em></a><em>!</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a83ca83b462d" width="1" height="1" alt=""><hr><p><a href="https://medium.com/adobe-machine-intelligence-design/imagining-doubtful-creative-tools-a83ca83b462d">Imagining Doubtful Creative Tools</a> was originally published in <a href="https://medium.com/adobe-machine-intelligence-design">Adobe Machine Intelligence Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Summer reflection on imagining the future of AI/ML for creative tools]]></title>
            <link>https://medium.com/adobe-machine-intelligence-design/summer-reflection-on-imagining-the-future-of-ai-ml-for-creative-tools-513d6544fd3a?source=rss----8328e3348dd1---4</link>
            <guid isPermaLink="false">https://medium.com/p/513d6544fd3a</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[design-process]]></category>
            <category><![CDATA[design]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[design-tools]]></category>
            <dc:creator><![CDATA[Adobe Machine Intelligence Design]]></dc:creator>
            <pubDate>Mon, 30 Sep 2019 14:57:49 GMT</pubDate>
            <atom:updated>2019-10-02T16:39:36.192Z</atom:updated>
            <content:encoded><![CDATA[<p>by Sisi xi Yu<br>Adobe Machine Intelligence Design Intern, Summer 2019</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*L_n852XsXpwDgtdP1dsr_g.gif" /><figcaption>Democratization or Homogenization of Creation?</figcaption></figure><p>Last week passed in a blur, presenting my summer project to the Adobe Design team, then flying to San Jose for the intern summit, I can’t believe it is already my last week. Before I leave, I wanted a way to remember what I learned over the summer. So here is my short, illustrated reflection documenting some of my thoughts in the past three months. This is not meant to serve as a didactic piece on how designers should approach designing for Artificial Intelligence/Machine Learning(AI/ML)nor does this refer to any specific design framework or process.</p><p><strong>Paradigm Shift: A New Way of Looking at AI/ML Design</strong></p><p>When I first started at Adobe, I came in thinking I would be looking at optimizing design workflows for existing flagship products. At some point in my design process, I realized that I had to wipe clean my pre-existing ideas for AI/ML functionalities before being able to think beyond the present- that there is the potential for another kind of creative relationship with AI. One of the ways that this new creative freedom is brought into Adobe’s tools is through the advancement of Generative Adversarial Networks, which can generate new audio or visual data. Currently, the user’s ability to create is dependent upon the depth of knowledge regarding the creative tool they are using. In the future, perhaps there is a chance to democratize creation using Machine Learning and GANs as a new creative medium. Instead of pixel-pushing, imagine being able to work with the machine to experiment and generate new imagery. GANs open new possibilities as a creative medium in instigating a shift in the design cultural paradigm.</p><p><strong>Machine Learning is the New Buzzword: We Need New Vocabularies</strong></p><p>In the age where Machine Learning became just another hashtag, it is ever more important to understand the unique properties of different Machine Learning models beyond exaggerated cliches or analogies. Perhaps it is time for new vocabularies for when working with AI beyond just “magic happens.” It involves layers of neural nets and a lot of training.</p><p>These exaggerations are partially the result of pop culture homages in sci-fi films, bold statements in media headlines meant to catch the public eye, alongside undecipherable acronyms only pertinent to those fluent in technical jargon. What I have discovered during my internship is that at a time when data privacy is at the forefront of our conversations, it is no longer sufficient to justify the lack of transparency due to the black-box model. Perhaps it is the perfect time to open up that conversation and start to communicate about what might be happening. Conversely, while the seemingly infinite possibilities of GANs are extremely exciting and intriguing, they also come with a unique set of limitations and interaction mechanisms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*G_zKZhVuxY8zsXTyxUICEw.gif" /><figcaption>The Black Box Model</figcaption></figure><p><strong>Design by Experimentation: Exploring the Latent Space</strong></p><p>Since very few guiding frameworks exist on how we should tackle these design challenges related to AI/ML capabilities, we have to experiment often. This made me especially anxious at the beginning of my internship — constantly doubting if I was exploring the right thing. A month in, I remember frantically approaching my manager on how I should tackle my internship project, he responded with“If you are really struggling, I can define the scope for you, but I wanted to give you time to discover it yourself.” I realized that to be comfortable with exploring the unknown, I had to be okay with not having the right answer on the first try and letting go of pre-existing ideas. It is a different way of designing than I was used to — much more experimental and fluid and not necessarily bound by any specific approach or framework.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Wcr0lab4V9TqMHgkivpCHA.gif" /><figcaption>My Non-linear Design Process</figcaption></figure><p>If I said my design process was linear and streamlined, I would be lying. I spent the first four or five weeks exploring different options, each time realizing my scope was yet still too broad. I discovered that sometimes I would try to sit there and think things through, but my mind would draw to a blank, that is until the moment I started being scrappy and starting making mockups and testing my ideas. At some point I had a realization: if my creative process was so messy, how can the machine help myself or a potential user get to some eventual end goal in the workflow? I saw an opportunity for intelligent facilitation and sought to imagine what the feedback system between the user and machine could look like.</p><p><strong>Value of Design: Battle of the Existential Crisis</strong></p><p>Over the summer I was fortunate enough to have been exposed to discourse regarding the future role of design in the face of emerging tech. With the homogenization of creative tools and a time when anyone can create content, what value do designers continue to hold? I am always an optimist. I believe that the advancement of AI/ML capabilities gives designers an ever more crucial role in tackling the wicked problems we are facing.</p><p>For so long, we have been searching for a design problem to fit the algorithm. This results in deeply convoluted interactions and tech for the sake of tech. It is only natural that users feel disconnected have set off a wave of fear regarding automation. Hence, in the era of data privacy scandals, we need design more than ever in establishing trust and transparency between the user and the technology adopted. Design brings the product closer to the user, and designers frame problems in a user-centric way that can be solved. Coming from various backgrounds and expertise ranging from graphic design to political science, philosophy and film to cognitive science, computer science, and architecture, working alongside my team this summer gave me insight into the value of hybrid thinkers and designers. The diversity of background is crucial from the beginning, collaborating with the Adobe research and engineering teams to ensure that we are aware of the user’s needs, potential biases in the dataset and other potential blind spots.</p><p><strong>Conclusion:</strong></p><p>This summer has been transformative, not just in exposing me to the inner workings of the most prolific distributor of creative software, but also to be able to contribute to conversations surrounding the future of Creative Tech. I am an optimist, yet at the same time painfully aware of the potential negative impact of AI/ML. My team and I share a concerning number of articles on how Machine Learning is used for <a href="https://medium.com/@jamesbridle/something-is-wrong-on-the-internet-c39c471271d2">malicious intent</a>, and are constantly reminded of our responsibility in considering the ethical implications of our design. I am nowhere near figuring out the answers to the questions I raised earlier, but I call for designers to start believing in our role in designing more humane interfaces in trying to design for a humane world.</p><p>Sisi was a summer intern with Adobe Design’s Machine Intelligence Design team, based in New York. She is currently pursuing a Masters of Integrated Innovation for Products and Services at Carnegie Mellon University. She has a background in Architecture and Design.</p><p><em>The Adobe Machine Intelligence Design team promotes a user-centered approach to machine learning and artificial intelligence in creative tools and works to establish a deep understanding of how these technologies are changing the ways we interact and create.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=513d6544fd3a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/adobe-machine-intelligence-design/summer-reflection-on-imagining-the-future-of-ai-ml-for-creative-tools-513d6544fd3a">Summer reflection on imagining the future of AI/ML for creative tools</a> was originally published in <a href="https://medium.com/adobe-machine-intelligence-design">Adobe Machine Intelligence Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[We’re Shaped by Our Creative Tools]]></title>
            <link>https://medium.com/adobe-machine-intelligence-design/were-shaped-by-our-creative-tools-44a393371033?source=rss----8328e3348dd1---4</link>
            <guid isPermaLink="false">https://medium.com/p/44a393371033</guid>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[design-tools]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[design-process]]></category>
            <category><![CDATA[design]]></category>
            <dc:creator><![CDATA[Adobe Machine Intelligence Design]]></dc:creator>
            <pubDate>Mon, 08 Jul 2019 17:31:33 GMT</pubDate>
            <atom:updated>2019-04-08T15:48:14.775Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*2FCVk2o5GKBR3ipm-CaOmQ.png" /></figure><h4>Narrowing the Creative Language Gap with Machine Intelligence</h4><p><em>By Archie Bagnall, Lisa Jamhoury, Madeline Hsia, and Patrick Hebron</em></p><p><strong>There’s a language gap present in today’s creative landscape.</strong> One that separates our creative applications from our creative intent. The gap is the reason we are required to “on-board”, the reason we find ourselves disoriented when a button moves after a software update, and the reason we watch online videos to learn features our tools have in fact offered for years. We accept the gap, because the historic nature of computers — <em>binary execution of pre-programmed functions</em> — has caused it to always be there. This gap demands that users speak like a computer so that they might effectively use a computer.</p><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*PDO9x5QR7Xkk6tXxKGPWcw.png" /></figure><p>Today’s creative applications could be described as a collection of digital tools: a digital paintbrush, a digital typesetter, a digital brightness control, et cetera. Together, they deliver an experience that asks users to translate their creative intent into a sequence of tools. For example: to <em>“highlight the colors of the sky”</em> in an application such as Photoshop might translate into the following tool sequence: <em>Magnetic Lasso Tool -&gt; Hue/Saturation Tool -&gt; Brightness/Contrast Tool.</em> There are multiple tool sequences that could achieve a user’s creative intent. Users have many multiple tool combinations and sequences available to them in order to achieve their intent. Sequences can develop their own vocabularies and language shortcuts around certain creative tasks. Single tools can also achieve a wide array of outputs depending on how they are used and manipulated.</p><p>The language gap reveals limitations that users persist through as they exercise their intent within creative applications. Here’s three in particular:</p><ul><li>First, that their ability to enact creative intent is <strong>limited to the language of tools</strong>. Users cannot successfully use an application unless they interact with it using the language of tools.</li><li>Second, that their ability to enact creative intent is <strong>limited to their knowledge of the tools available to them</strong>, including their ability and availability to learn new tools. If a user’s intent extends beyond their knowledge of the available tools, they must either consult documentation outside of the application, or alter their course towards use of more familiar tools.</li><li>Third, that their ability to enact creative intent is <strong>limited to the capability of the tools available to them</strong>. If a user’s intent is greater than the function of their tools, they must either change their intent or look for new tools elsewhere.</li></ul><p>Two decades ago, <a href="https://www.nytimes.com/1999/07/27/science/a-conversation-with-john-maeda-when-mit-artist-shouts-his-painting-listens.html">John Maeda</a> was interviewed by the New York Times. He talked about the language gap in relation to Adobe tools:</p><blockquote>“The problem is that most people can’t just ‘’finish’’ things with [an Adobe product]. They have to use it to start them, also… , the styles that emerge are homogeneous because the software is universal. Without being able to know how to program, you can’t break out of the technology.”</blockquote><p>Maeda recognized a consequence of the gap: that the language of tools can subvert the language of creative intent. Rather than continue translating intent across the gap, users can instead develop a habit of formulating their intent directly in the language of the tool. Maeda describes the outcomes of this phenomenon as <em>“homogeneous styles”</em>, a devolved sameness that emerges when creativity starts at the opening of an application, and is then led only by the tools that the user knows. Maeda’s sentiments are echoed in <a href="https://quoteinvestigator.com/2016/06/26/shape/">this</a> common quote:</p><blockquote>“We shape our tools, and thereafter, they shape us”.</blockquote><p>If the language of tools is by nature, binary and mechanical, the language of intent is contextual and human. Where a creative application hears an intent of <em>“select the brush tool and place four brushstrokes on the artboard”</em>, a user might speak that same intent as <em>“turn a chair into a barstool”</em>. Intent can also be vague and multi-layered. Vague, because another user could achieve the same outcome with <em>“make the seat taller”</em>. Multi-layered, because the task might contribute to a greater intent of “re-designing a restaurant interior”.</p><p>When directing his junior designers, <a href="https://vimeo.com/64811872">Massimo Vignelli</a> would famously describe a visual layout as needing to <em>“bang”</em> or have <em>“reverence”</em>. His intent could simultaneously be classed as human, contextual, vague, and multi-layered all at the same time, where his designers could only learn the true meaning of the direction through experience. It highlights the multi-dimensional complexity of creative intent, and raises question as to whether a creative tool is capable of accepting and facilitating <em>“bang”</em> in the way Vignelli meant? Will technology allow for the language gap to be narrowed?</p><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*BGUzXxbOBcrU7PmMQmCgag.png" /></figure><p>At the beginning of this piece, computing was described as a historically “<em>binary execution of pre-programmed functions</em>”. In this style of computing functions are rules-based, and rules are pre-programmed into software before their release. The resulting functions are defined, engineered, and inflexible to adaptation.</p><p>Machine learning offers an alternative style of computing that takes a different approach. Here, intelligent computing is still rules-based, but the rules are not pre-programmed. Instead, machine intelligence infers what the rules should be after recognizing patterns and relationships in a dataset. This method allows intelligent functionality to be adaptive to the individual user, following rules that are calculated to best meet each individual request. This logic allows a pair of users to give the same search term and receive different results, or a single user to input the same search term at different points in time and be given different results. In both instances, a greater number of inputs beyond the single-given search term are utilized in calculating the most relevant result.</p><p>Through contextual learning and dynamically refined outputs, machine intelligence offers to learn the language of the user, and in doing so observe the subject and context of a user’s content. In recognizing the human language of intent, users are empowered to engage their creative applications without first needing to learn the language of tools, and creative applications are empowered to <em>“highlight the colors of the sky”</em> or <em>“turn a chair into a bar stool”</em>.</p><p>Below are visualizations of <em>“turn a chair into a bar stool”</em> and <em>“highlight the colors of the sky”</em>. The first image shows the steps taken when translating creative intent into the language of tools. The second suggests what’s possible as the language gap is narrowed.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*K0tjrOkdXqisXTMiuH1PpQ.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YEIPcDlkmPxIPgBOeb-tjA.gif" /><figcaption>Left: Wide Language Gap | <strong>“Turn a chair into a barstool”</strong> | Right: Narrow Language Gap</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yl3-wgCLyCw7AQ6qQ4H7Jw.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*v18SzNNcTWBcjkWjRyIH5Q.gif" /><figcaption>Left: Wide Language Gap | <strong>“Highlight the colors of the sky”</strong> | Right: Narrow Language Gap</figcaption></figure><p>We’re already starting to see the language gap narrowing in today’s creative applications. Below, Photoshop’s ‘<a href="https://helpx.adobe.com/photoshop/how-to/face-aware-liquify.html">Face-Aware Liquify</a>’ feature allows for the semantic editing of human faces.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EYM_1LKmeb7ZngDRNSPYlA.jpeg" /><figcaption><strong>Face-Aware Liquify in Photoshop CC 2019</strong></figcaption></figure><p>There’s a language gap present in today’s creative landscape. One that separates our creative applications from our creative intent. But advances in machine intelligence are narrowing the gap and allowing us to reimagine creative applications of tomorrow. These applications won’t just offer a collection of enhanced “smart” tools. They’ll offer a personalized relationship between a user and their creative intent. They’ll be active facilitators in the creative process and of our creative navigation. They’ll bring new creative possibilities for application users and application makers alike. They’ll bring challenges too.</p><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*3jZquhw6BZpg2wAoaf5M1w.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*zpmIJeiEJhUXrhlqRbBnAA.jpeg" /></figure><p><em>Machine Intelligence Design is a team at Adobe Design, promoting a user-centered approach to machine learning and artificial intelligence in creative tools, while simultaneously working to establish deep understanding of how these technologies are changing the ways we interact and create.</em></p><p><em>Adobe Design is </em><a href="https://adobe.design/#JobOpenings"><em>hiring</em></a><em>!</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*lsRR8Z7tdabmLstY1tMKZw.jpeg" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=44a393371033" width="1" height="1" alt=""><hr><p><a href="https://medium.com/adobe-machine-intelligence-design/were-shaped-by-our-creative-tools-44a393371033">We’re Shaped by Our Creative Tools</a> was originally published in <a href="https://medium.com/adobe-machine-intelligence-design">Adobe Machine Intelligence Design</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>