<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Agoston Nagy on Medium]]></title>
        <description><![CDATA[Stories by Agoston Nagy on Medium]]></description>
        <link>https://medium.com/@_stc?source=rss-1fb5146c84d------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*2tOM1O7T4JEQ0G_7gt3TsA.png</url>
            <title>Stories by Agoston Nagy on Medium</title>
            <link>https://medium.com/@_stc?source=rss-1fb5146c84d------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 07:22:42 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@_stc/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Generative Art Systems*]]></title>
            <link>https://becominghuman.ai/generative-art-systems-f3b35ea78421?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/f3b35ea78421</guid>
            <category><![CDATA[blockchain]]></category>
            <category><![CDATA[generative-art]]></category>
            <category><![CDATA[game-theory]]></category>
            <category><![CDATA[systems-thinking]]></category>
            <category><![CDATA[algorithms]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Thu, 04 Aug 2022 15:42:22 GMT</pubDate>
            <atom:updated>2022-08-16T13:53:35.463Z</atom:updated>
            <content:encoded><![CDATA[<p><em>* an epistemological approach</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8qUxeRfb_9aM2MJ9jtD9ZA.png" /></figure><p>It is challenging to navigate the ever-increasing complexity of our time. Dave Snowden has built a complete <a href="https://www.wikiwand.com/en/Cynefin_framework">framework</a>(1) in order to analyze and understand such systems around and inside us. It is especially useful in times of recurring challenges, like pandemics, environmental emergency situations, supply chain crisis and social collapse (war). Reading generative art resembles many aspects of the tactics of understanding dynamic complex systems. On the <em>perceptual level</em>, generative structures can appear as sophisticated, complex visual systems that can seem both familiar and alien-like the same time. On a <em>taxonomical level</em> (structure, underlying mechanisms), these systems can be understood at their core behavioural mechanisms, on the level of functions, instructions and algorithmic strategies. Then there is another layer for interpretation, which is a much wider <em>contextual level</em>, where history of the cultural scene, set and settings of the artwork and the artist, social and political integration plays role. This post covers some of these attributes with a focus on an epistemological approach.</p><h4>access.</h4><p>On the <em>perceptual level</em>, new forms of media, unconventional platforms, never before seen formats, different expressions and corresponding trends arise. As we see the transformation of the human attention span, combined with new ways of selection mechanisms and recommendation systems, one interesting aspect of perceptual observation would be time itself. While temporal aspects of an artwork can work on almost non-human extremities (think of some of the pieces of contemporary <a href="https://universes.art/en/specials/john-cage-organ-project-halberstadt">music composers</a>, emergent, long-form generative and conceptual art), we can see an emerging trend of the compression and decrease of focused attention recently, perhaps as a survival strategy against our oversaturated environment. Few decades ago, we spent many hours observing a single image, so the intimate relationship with those artefacts were developed on a long term, gradually unfolding, subjective process. As responsive media became widespread and more accessible through personalisation, <a href="https://www.nngroup.com/articles/microinteractions/">micro-interactions</a> and similar agencies in the digital domain, we are in a transition towards consuming much more material with less intimate contact that lacks repetitiveness, gradually built confidence and subjective involvement. We founded our cultural backgrounds step by step to understand paintings, even photographs and drawings, through constant omnidirectional discourse along the cultural fields and developments. Now, while shifting from physical-only objects to hybrid, digitally signed networked media, we have to integrate systems thinking, dynamic properties, conditional structures, even <a href="https://www.wikiwand.com/en/Game_theory">game theory</a> and evidence based speculation strategies into our cognitive resources. This leads to the second level of reading generative artworks.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*o57Mn-bHBOLXq6xBjmXhiA.png" /><figcaption>Entropy VII (2)</figcaption></figure><p>On the <em>taxonomical level</em>, a generative piece is composed of different automated, functional and outsourced methodologies. Computer science, math, physics, gestalt, social engineering, all became part of the arsenal that takes part in the creation of a piece. Generative art usually incorporates algorithms from its simplest forms (adding two numbers) to more complex (using pre-trained machine learning models run by several machines independently) combinations of formalisable methods. An algorithm originally meant to describe a solution to a problem, so when we see colours, forms and shapes of a piece, we can also see the intention, variability, symbolic possibility field behind their actual configuration, depending on the level of our algorithmic literacy. The images are built up with textual code, so the original formulations of the exact steps can be traced back to discrete elements in the system. The accessibility and transparency of these elements define explicitly our experience of the observation and affordance of these projects. The nature of code (open / closed source) it has been built with, the quality and structure of the underlying datasets (public / privately controlled) are active components of the whole, extended body of a particular piece. Today, transparency, traceability becomes more and more problematic, as we see the wider acceptance and smart monetisation of closed, black-box like AI tools, where nor the artist, nor the audience have access to the data and algorithms that the system was trained on and the <a href="https://www.engadget.com/dall-e-generative-ai-tracking-data-privacy-160034656.html">intellectual properties are questionable</a> to say the least. However, in general, an algorithmically literate person can read a generative artwork closer to its full completeness than one without such skills.</p><blockquote>”What people call “AI” is actually a long historical process of crystallizing collective behavior, personal data, and individual labor into privatized algorithms that are used for the automation of complex tasks: from driving to translation, from object recognition to music composition. Just as much as the machines of the industrial age grew out of experimentation, know-how, and the labor of skilled workers, engineers, and craftsmen, the statistical models of AI grow out of the data produced by collective intelligence. Which is to say that AI emerges as an enormous imitation engine of collective intelligence.”<em>(3)</em></blockquote><h4>practice.</h4><p>The methods used for generative arts are a mixture of individual decisions, personal experience and community based solutions. These are <em>ideas, thoughts, philosophies, belief systems, moral innovations, source code, video tutorials, microblog feedback mechanisms, reusable software libraries, math equation implementations, openly usable authoring tools</em> with very different software architectures and corresponding community structures. The realtime feedback mechanism affects the trends and the behaviour of generative art ecosystems, they are constantly adapting and evolving, it is encoded in their dna.</p><p>With generative art we can see a separation of planning and evaluation, instead of manipulating the substance directly, the artist forms some ideation, then build a framework around it, and let the evaluation unfold based on the parameters of the framework. In this sense, we can identify <em>choreography, conceptual art, instruction based art, programming, music composition, game design</em>, etc. as loosely coupled parts of this field.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qnNACKZudX6dqURWHYxMxA.png" /><figcaption>Generative Art Methods by Effective Complexity (4)</figcaption></figure><p>We can choose among many features that we find meaningful while thinking about the types, clusters and nature of algorithms that are being used for creating creative output. Identifying features, information extraction and similar tasks became really important while facing complex scenarios that are larger than what we can process from their completeness. Lets take an approach as a feature to identify the agencies of algorithms. We can point out two ways of constructing applications with them: the top down and bottom up approach. In this sense, top down algos are complex artificial intelligence, like neural networks and pre-trained systems, where the artists are using black boxes, tinkering with them, reverse engineering and trying to modify the outcome to fit their needs. Bottom up, or grass roots structures are the ones, where the artists start with some simple set of rules and let them grow, unfold and mature, waiting for their emergent properties to arise. Geometry, certain fields of mathematics, combinatorics, systems theory and conditional simulations are examples for these approaches. Or we can take another feature dimension: the entropy component, the transition from a chaotic to an ordered state, or vice versa. If we think of algorithms as formulated solutions that are reordering their environments over time, we can have <em>constructive</em> algorithms, such as world building simulations (cellular automata, l-systems etc) and we can have <em>deconstructive </em>algorithms where a system converges towards chaotic, erosive processes (such as subdivisions, noise systems, randomness).</p><p>These are just some examples of how we can access, recognize and integrate generative algorithms and computational thinking into our practice, but of course there might be many more interesting aspects that would help building a <a href="https://github.com/jasonwebb/morphogenesis-resources">vocabulary</a> for a widely adopted, commonly used algorithmic literature.</p><h4>recognize.</h4><p>On the wider, <em>contextual level</em>, a generative artwork can mean many things. From combining fine arts and the computers (like in <a href="https://piratefsh.github.io/2019/01/07/computer-art-history-part-2.html">early plotter graphics</a>) through the demo scene of the 80s, the glitch and abstract constructivist <a href="http://dextro.org/">environments</a> of the 90s, <a href="https://jodi.org/">net art</a> and computational pieces usually share a common aspect: most of them are influenced by counter culture and critical thinking — they are all questioning the status quo from time to time. In the early years these questions targeted the medium itself. Computational art was about to use computer for artistic practice instead of calculating only, making abstract visuals of debug views and wireframes, creating sound sculptures of glitch, errors and limits of the environment. The glitch scene and net art continued this tradition by exploring errors, limits and unintended interruptions of systems and new media. Today, many digital art projects question current distribution models, dead-end economical models, vendor lock-ins and <a href="https://www.techtarget.com/searchsecurity/definition/walled-garden">walled gardens</a>, with strange combinations of traditional information technology and more recently, decentralized ledger networks (blockchains).</p><blockquote>“ The choices we are faced with today are especially important because digital technology so dramatically increases the ‘space of the possible’ that it includes the potential for machines that possess knowledge and will eventually want to make choices of their own.” <em>(5)</em></blockquote><p>An interesting way of thinking about the position of a specific culture is to think of its wider context and history. In a recent <a href="https://thenetworkstate.com/">book</a>(6), Balaji Srinivasan shows that there are basically two ways of writing history. One of them is a top-down approach, while the other one is a bottom-up, self governing approach. While most traditional historical events are written “top-down” by the winners (who have the power to write and execute) throughout successful events in a particular field, the latter is building up context from an atomic level, by letting each and every change be logged in the system in an immutable way, so the participants don’t need social consensus to determine which event was true and which was false. Writing and exchanging generative art in networked communities has many aspects of this second approach. Since the creators are using self logging computational tools for their practice, they are constantly building up the micro-history, reputation, social relevance and accountability of their culture in an automated way, where each of their actions (thus, transactions) leave traces in a ledger structure. These logs act as references for community members, art historians, curators, entrepreneurs, researchers and for the artists themselves as tracing method for personal progress. In the meantime, the same logs also act as immutable building blocks that define consensus mechanisms within a social guild, they are transformative tools of cryptographically valid, self operating layers that are built on existing infrastructure, which can be integrated into our everyday life within reasonable energy and time.</p><ol><li><a href="https://thecynefin.co/about-us/about-cynefin-framework/"><em>The Cynefin Framework</em></a></li><li><a href="https://versum.xyz/token/versum/27345"><em>Entropy VII</em></a>, a single edition digital token by the author</li><li><a href="https://www.e-flux.com/journal/101/273221/three-thousand-years-of-algorithmic-rituals-the-emergence-of-ai-from-the-computation-of-space/"><em>Three Thousand Years of Algorithmic Rituals</em></a><em> </em>(Matteo Pasquinelli)</li><li><a href="https://www.researchgate.net/publication/334643022_Artificial_Intelligence_and_Problems_in_Generative_Art_Theory"><em>Artificial Intelligence and Problems in Generative Art Theory</em></a><em> </em>(Philip Galanter)</li><li><a href="https://worldaftercapital.org/"><em>World After Capital</em></a><em> </em>(Albert Wenger)</li><li><a href="https://thenetworkstate.com/"><em>The Network State</em></a><em> </em>(Balaji Srinivasan)</li></ol><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f3b35ea78421" width="1" height="1" alt=""><hr><p><a href="https://becominghuman.ai/generative-art-systems-f3b35ea78421">Generative Art Systems*</a> was originally published in <a href="https://becominghuman.ai/">Becoming Human: Artificial Intelligence Magazine</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[SoundBow — a personal journey]]></title>
            <link>https://medium.com/swlh/soundbow-a-personal-journey-5789fc2caba8?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/5789fc2caba8</guid>
            <category><![CDATA[music]]></category>
            <category><![CDATA[design]]></category>
            <category><![CDATA[games]]></category>
            <category><![CDATA[ios]]></category>
            <category><![CDATA[art]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Wed, 03 Jun 2020 08:52:07 GMT</pubDate>
            <atom:updated>2020-06-20T09:55:20.993Z</atom:updated>
            <content:encoded><![CDATA[<h3>SoundBow — a personal journey</h3><p>Being fully present at a moment and paying attention onto ongoing processes in the surrounding environment always fascinated me. The act of listening is inseparable from the act of sound making (at least, it is the absence of making it). Also, contemplating on a beautiful painting takes part in a process of recreating an internal image on the observed subject. This eternal conversation between perception and cognitive responses is part of our everyday life, if we listen carefully, we can recognise that there are so many changes happening while we are just sitting on the ground and watching birds.</p><p><em>Drawing</em> is a way of representing the world, but it also acts like a direct translator for new ideas and thoughts. I like to refer to the so called <a href="https://medium.com/@_stc/game-world-98a0f18e3a13">Magic Circle</a> a lot, where one draws a circle (defining a set of rules), and everything that falls inside the circle, will become a playground of a game, while artefacts outside the circle will not play any role in the game. We can think of the world as nested networks of magic circles, where each circle defines different rules for different situations based on social, biological or other abstract consensus.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Zs_Hzew2n0QoFmsqYVfvWA.jpeg" /></figure><p>Instead of generating new ideas, the medium of <em>sound</em> or <em>music</em> is much closer to some sort of meditative act that resonates our attention with patterns and rhythms of natural frequencies. It directs us to the understanding of time, sustainable and non-sustainable cycles and repetitive rituals. It is not only presented in the audible domain, it is embedded into very slow movements, celestial transformations, digital algorithms, network topology, music of the spheres and anything that has a relationship with time.</p><p>This dialogue between defining new ideas by <em>spatial</em> magic circles (drawings) and observing temporal rituals through sound and time led me to the creation of <a href="http://www.binaura.net/soundbow">SoundBow</a>, a visual instrument that helped me understand a lot about play, design, distribution, failure, production, communities, and creative curiosity in general.</p><h3>Playgrounds</h3><p>Since I&#39;ve been an “in-between” type of person — I switched my studies in high school from music education to visual arts, then from graphic design to time based video art in the university, just to name a few transitions within my interests — it became natural that my intentions in research and aesthetic practice should combine somehow these two areas, so I made my Phd afterwards on the topic of <a href="https://medium.com/@_stc/visual-sound-instruments-a7e9cde93aeb">Visual Sound Instruments</a>. I researched basic interaction principles within sonic environments that have resonating bodies (such as string instruments, wind instruments, membranes, etc) and sonic systems that do not have resonating bodies, only abstract digital descriptions and interfaces (software synths, <a href="https://toplap.org/">live coding</a> environments, electroacoustic gadgets). I was an active member of the live coding community at that time (today the scene is mostly called <a href="https://algorave.com/">Algorave</a>) and was trying to understand how <a href="http://www.sonicwriting.org/"><em>writing music</em></a> (thus, code and notation) can be combined with live performance. I was using the visual programming language called <a href="http://msp.ucsd.edu/software.html">Pure Data</a> to build up complex sonic structures from a blank canvas. In fact, this language is still used within SoundBow as the sound engine for recording, manipulating and playing back sounds within the application.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*zgtjmwf6Aq7TZpmf4RfISQ.png" /><figcaption>Sound Engine of SoundBow, written in Pure Data (when editing the source code, the boxes can be opened, they contain nested sonic building blocks)</figcaption></figure><p>There are some cases, when one becomes the writer (composer) and the performer (interpreter) of a piece at the same time, such as when you take part in a fluxus piece, or you are practicing <a href="https://www.deeplistening.rpi.edu/about-deep-listening/">Deep Listening</a>. There are many cases where you can find opportunities for this state in your environment, based on your interests and experiences. Back then, when I started thinking over these possibilities, a new form of medium was unfolding: the world of touch based devices. These tools became <a href="https://en.wikipedia.org/wiki/Shapeshifting">shape shifters</a> of our time: you observe <em>while</em> manipulate a graphical notation in the same interaction cycle, and the visual symbols can turn into anything while you are interacting with them. You become the performer and the audience in a very intimate journey that can be limited or very open, depending on the intentions of the instrument designer. The balance between constraints of a system (where this system means every component and relationship inside the magic circle) and the amount of areas left open for creative experimentation and unintended accidents plays a key role in designing these kind of cognitive computational experiences.</p><p>Another important aspect of these recent devices is that they are part of ecosystems where content distribution differs from earlier supply chains completely. An indie artist and developer can make a product grow from the seed of the original idea into the hands of the audience without the need to really deal with logistics in their workflow during the distribution of the piece. Again, this model needs a bit of the already mentioned &quot;in-between&quot; mindset: you become the artist, the developer, the producer, the designer and everything in between, which can raise truly challenging, sometimes frustrating, yet very inspiring moments for the most of us.</p><h3>Variations, in depth</h3><p>I made the first incarnation of SoundBow in early 2012, when I was trying out nonconventional user interface ideas within the <a href="https://processing.org/">Processing</a> programming language. At that time, it became possible to combine my favourite languages together (Processing + Pure Data) and play with the results on touch based Android devices. Soon I made a prototype and published it to the Android store (now called Google Play), where it is still available to <a href="https://play.google.com/store/apps/details?id=com.processing.soundbow&amp;hl=en">download</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/854/1*IFpZriMb_XZnpjsN4XFE-g.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/854/1*rFeslKiALe9FLB8Uekox0Q.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/854/1*rc0NMmBSzkvsS8UzWtLbUg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/854/1*41twDq3KAAXHWlxjhfbL0g.png" /><figcaption>Some screens of the very first Processing prototypes from 2012</figcaption></figure><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F_Y77BoCKkU0%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D_Y77BoCKkU0&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F_Y77BoCKkU0%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="640" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/e5ea09d58b799986843442c6177f9d5b/href">https://medium.com/media/e5ea09d58b799986843442c6177f9d5b/href</a></iframe><p>Later, my favourite language became compatible with modern web technologies by magically turning the code into javascript, so I made an <a href="http://www.binaura.net/stc/wrx/soundbow/web/">online version</a> of the prototype, that became part of the series of many beautiful pieces that can be found at <a href="https://experiments.withgoogle.com/experiments">Google Experiments</a>. In 2012, the Android version of SoundBow was selected as the Mobile App of the Day by FWA (Mobile Favourite Website Awards) which indicated to me that I am into something interesting.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*W39ICW1LjNLR-3prlKL9ag.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DJYYWdq7kJ9tIhB19fbLnQ.png" /><figcaption>FWA Prize, 2012 (left), Appearance in Chrome Experiments, 2013 (right)</figcaption></figure><p>That year I had a project in which I had to program some sounds and graphics on a <a href="https://www.raspberrypi.org/">Raspberry PI</a>, which is a small, cheap linux computer with a bit lower processing power than laptops and PCs. Since performance, nice graphics and high quality sounds were crucial in the piece, I started using <a href="https://openframeworks.cc/">OpenFrameworks</a> for application development, which is a very similar coding platform to Processing, but is built on C++, so low level, native operations and improved graphical performance can be accessed in a handy, flexible way. Since my favourite sound programming language (Pure Data) could be included in the compiled app bundle using <a href="https://github.com/libpd/libpd">libPd</a>, I could continue my workflow: completely separated visual interface development combined with an interchangeable, independent sound engine. This was the time I discovered that OpenFrameworks can be used to build apps for the iPhone and the iPad, too.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7C82RYoeZS2OHnH_aleAsg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*T-UytDml_LOSs2uqXLo_Uw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*te5UiDNAXnfInUsll336Zw.jpeg" /><figcaption>Reconfigurable environment, calligraphic drawing interface on iOS (2016)</figcaption></figure><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2Fdlg9GRAQ5OM%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3Ddlg9GRAQ5OM&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2Fdlg9GRAQ5OM%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/481bc8e23d8680f6946d5371f713328b/href">https://medium.com/media/481bc8e23d8680f6946d5371f713328b/href</a></iframe><p>Most musicians were using iOS by that time, sound performance, connectivity, digital signal processing and the creative community was insane and completely next level compared to the Android world. So I decided to make SoundBow for iOS, but with a redesign, where the players can do a lot more things with it: record small samples of their own voice, play with those in a more open way by reconfiguring elements around their drawings. Also, a very important option has been added to the experience: people were invited to export their compositions and share them with their loved ones or include them into their professional workflow as high quality sound recordings. The first release was in the mid of January, 2016. I remember well, since it was just after the death of David Bowie. Talking of him, let&#39;s pause &amp; rewind for a moment and remember what he said in 1999:</p><blockquote>&quot;I don&#39;t think we&#39;ve even seen the tip of the iceberg. I think the potential of what the internet is going to do to society, both good and bad, is unimaginable. [...] It is an alien life form [...] that is going to crush our ideas of what mediums are all about.&quot;</blockquote><p>This rhymes well with the distribution model of the app stores, as former MIT Media Lab professor John Maeda highlights these analogies in his <a href="https://cx.report/">CX 2020 report</a>. Indeed, SoundBow could reach more than 100.000 installs on Google Play, and reached more than 13.000 people on Apple’s App Store (13.1K unit downloads as of writing this article). These numbers might not be impressive in the world of widely available consumer software products and utilities made by giant companies, but they have very different meaning in a niche, experimental art “market”. It would have been impossible for me to bring an experience at this level of intimacy for the audience without computational (freely scalable, location-agnostic, omni-presented) distributional models such as these stores. Beyond apps, these systems today are applied for most distribution channels from games through music and digital entertainment in general. Content and context are both going over a previously unimaginable transformation by this alien life form that we are interacting with on a daily basis.</p><h3>Taking care</h3><p>Being an &quot;in-between&quot; indie developer, I had many hands-on experience with digital distribution and the nature of a sustainable software. The immediate responses through app reviews and social media took a lot of energy out of me. It took time to understand and deal with the psychological consequences caused by that amount of influence. There were special lessons I learnt while tracking and observing the lifecycle and the effects of my app. One of the most intense experiences was the realisation that there are clones appearing in the app stores that are mimicking the appearance and interaction mechanics of SoundBow. These clones caused quite shocking feelings sometimes for me, in which I did not always know how to react accordingly to these situations.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*B3WS24aNCbhKvjTQAgl4mQ.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*rDpXvY0kfu1q9PO0GieBdg.jpeg" /><figcaption>SoundBow connected to physical objects &amp; instruments using MIDI (2018)</figcaption></figure><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F_Aw_YcRUyU8%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D_Aw_YcRUyU8&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F_Aw_YcRUyU8%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/7a1b76c8558c29c712cda340247e9c3c/href">https://medium.com/media/7a1b76c8558c29c712cda340247e9c3c/href</a></iframe><p>Another interesting lesson I learnt is when I tried to bring SoundBow to the studios of professional musicians as opposed to regular people who are just playing around with their sounds and drawings and use the app as a toy. By integrating a third party service called <a href="https://retronyms.com/audiocopy/">AudioCopy</a> and adding support for <a href="https://www.midi.org/">MIDI</a> output among other music production related solutions, I was trying to fulfil feature requests that led to infinite nested rabbit holes in the development process. Newer versions brought forward more possibilities to errors, and the high-level expectations from musicians were impossible to manage as being only one individual developer and not a dedicated music software company. Realisation of the hardest part of it just arrived later: going into these specialised directions turned my attention away from my original intention, which was to provide a smooth, creative flow for playing with sounds and drawings by people who don&#39;t make music or drawings otherwise. It is an inclusive goal at its heart and now I know I have to take it seriously.</p><p>Identifying this and understanding the lessons I had (both bad, confusing and good, exciting) during the last almost 10 years, I can now continue taking care of SoundBow and its future variations (I already have some strange ideas to try) and I do it for your convenience and delight. Thank you for being on this journey with me. If you wish, download or update SoundBow from the <a href="https://itunes.apple.com/hu/app/soundbow/id1069359097?mt=8">AppStore</a>, or just go out and practice some cognitive sampling: take your time and listen to the myriad beautiful sounds of the surrounding world.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5789fc2caba8" width="1" height="1" alt=""><hr><p><a href="https://medium.com/swlh/soundbow-a-personal-journey-5789fc2caba8">SoundBow — a personal journey</a> was originally published in <a href="https://medium.com/swlh">The Startup</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Augmenting Network Sculptures]]></title>
            <link>https://medium.com/swlh/augmenting-network-sculptures-9e3585ebad06?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/9e3585ebad06</guid>
            <category><![CDATA[creative-coding]]></category>
            <category><![CDATA[education]]></category>
            <category><![CDATA[openframeworks]]></category>
            <category><![CDATA[network]]></category>
            <category><![CDATA[augmented-reality]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Fri, 27 Dec 2019 15:58:54 GMT</pubDate>
            <atom:updated>2019-12-28T15:03:02.959Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*bhNS7KhVwM6_qGWD_XzdkQ.png" /><figcaption>Coloured clusters of a network</figcaption></figure><p>This article is introducing an ongoing collaboration between <a href="https://mome.hu/en">Moholy-Nagy University of Art and Design</a> (Budapest, H) and <a href="https://www.barabasilab.com/">Barabasi Lab</a> (Boston, US). The aim of the project is to bridge physical, 3D printed spatial networks with their corresponding background information layers using <a href="https://en.wikipedia.org/wiki/Augmented_reality">augmented reality</a>. Since a virtual model is aligned to the actual, printed network sculpture, the audience can reveal layers of information by navigating over different layers of reality: interacting with a touch based mobile device on its screen, but also, navigating in the actual space by moving the device around. Using the built in motion sensors, gyroscope and the realtime camera image, the result is a mixed reality experience, where layered digital information is connected to the actual, physical network sculpture.</p><h3>A workshop</h3><p>After an initial brainstorming with network scientist <a href="http://barabasi.com/">László Albert Barabási</a>, we started the project with a workshop at MOME campus with <a href="http://datavistraining.eu/">Mihály Minkó</a>, where designers, artists, engineers and people from different fields of humanities were invited. We were investigating ways of how we can mix the language of augmented reality with <a href="http://networksciencebook.com/">network visualisation problems</a>. Two theoretical lectures were given as a starting point, dealing with the taxonomies of augmented reality (and its corresponding cognitive models of the different modalities of space) and network topology: visualizing, understanding the structures of <a href="http://netwonder.net/">scale-free and complex networks</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HLZoCkiTud4kZZaw9QNBfQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*twy0vqtI6ctMgm1W6ZE-aw.png" /><figcaption>Some slides from the lecture</figcaption></figure><p>Collaborative thinking, tinkering and DIY culture is also a crucial part of our workshop methodology, so we got some plastic components that consist of simple building blocks for assembling different molecular systems, and the participants had to build simplified networks by their own. The instructions were based on some extremely filtered and limited data they got in their hands, sitting around a table, constructing the object together, regardless of their professional background. This way of collaborative design opens up meaningful conversations, invokes several questions on the topic that is being investigated by the group. As a result of the workshop, we got some interesting ideas on the navigational concepts within augmented reality, we also had a very first-hand experience on how networks, nodes and their edges can be created.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PQoR7SWIxIZNP6gPwm15fg.png" /><figcaption>Different spatial concepts for handheld Augmented Reality</figcaption></figure><p>Since networks are abstract structures in their own, visualizing them in another abstract model (augmented reality) is even more challenging, we are building something that none of us experienced before.</p><p>So far, so good. It seems that</p><p><em>The methods of understanding complex networks and relationships can be learnt and understood better if we have hands-on experience regarding to a structure (building, combining, restructuring parts and pieces) besides reading theories and abstract concepts only.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VBRb5se9JddnIcgunhs_oQ.jpeg" /><figcaption>Placing virtual content on a simple physical network</figcaption></figure><p>Augmented reality is an emerging field of visual communication, that has a lot of potential, which means it also needs a lot of hands-on experimentation. As the computational paradigm where melting actual space and algorithms started with <a href="https://en.wikipedia.org/wiki/Navigation">nautical navigation</a>, our time is also dealing with the same paradigm with new methods. Today, people have to combine actual physical space with layers of virtual content: these are the basics of space-aware computing, where we have to build the language for the next era of computational design.</p><p>Telling meaningful stories within this hybrid space is a very novel concept for both content creators, designers and engineers. Understanding the context of these complex scenarios involve people from different background professions, including engineers, humanities (literature, semiotics, etc), cognitive scientists, visualization experts, and most importantly, experts who are dealing with the ethical, biological consequences of technology, such as artificial intelligence and different layers of reality.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FZ4VyZguPePY%3Ffeature%3Doembed&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DZ4VyZguPePY&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FZ4VyZguPePY%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/a041d0de3fa6ffeda18557b8c1629760/href">https://medium.com/media/a041d0de3fa6ffeda18557b8c1629760/href</a></iframe><h3>A prototype</h3><p>The goal of the collaboration between the two institutes is to find and build meaningful visualizations for these conceptual interrelations between space, data and its representation. It is an interesting journey in order to create new aesthetics based on data &amp; networks, where scientific concepts are easier to grasp for people who are outside of the academic circles of design or scientific communities.</p><p>We started to build an iOS prototype in C++ (<a href="https://openframeworks.cc/">OpenFrameworks</a>) that is based on Apple’s augmented reality platform, <a href="https://developer.apple.com/augmented-reality/">ARKit</a>. We are using feature points from the device’s camera feed to construct, load and save world coordinates that are connected to the physical network sculpture. We also use the same app to render virtual content on the screen, using OpenGL combined with Apple’s Metal as the graphical renderer.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/809/1*Bu-RKMSWexlh_UiDx7dcEw.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*PBzhEPDK0sFZjOITpeeZqw.gif" /><figcaption>Calibration process in the prototype</figcaption></figure><p>The UI and the application lifecycle is based on custom components, there are no OS-specific built in elements and modules that are used, which leads to easier portability and future-proof, cross-platform development strategy. The prototype later can be ported to Android’s <a href="https://developers.google.com/ar">ARCore</a> platform or other operating systems of the upcoming head mounted reality industry.</p><p>The usage of the application is intended to be “space aware”, which means it is using some special concepts beyond conventional navigational routines (such as touch, swipe, pinch, etc). The distance from the actual, physical object plays an extremely important role in the experience.</p><p><em>The application concept, data transformation, design and development is made together with </em><a href="http://datavistraining.eu/"><em>Mihály Minkó</em></a><em>. The app is about to be released in 2020 as an integrated part of the forthcoming exhibitions of different networks and generative sculptures made by Barabasi Lab, this post will be updated, accordingly.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/755/1*1axm1ieIV2bZjXqcsJWamA.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9e3585ebad06" width="1" height="1" alt=""><hr><p><a href="https://medium.com/swlh/augmenting-network-sculptures-9e3585ebad06">Augmenting Network Sculptures</a> was originally published in <a href="https://medium.com/swlh">The Startup</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[30 Days of Coding Practice]]></title>
            <link>https://medium.datadriveninvestor.com/30-days-of-coding-practice-3004d51a02e7?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/3004d51a02e7</guid>
            <category><![CDATA[games]]></category>
            <category><![CDATA[art]]></category>
            <category><![CDATA[sound]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[coding]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Wed, 12 Dec 2018 10:10:13 GMT</pubDate>
            <atom:updated>2018-12-13T14:16:35.848Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*IlKOMdmmJoPaJPRqh9UWbg.jpeg" /></figure><p><em>This post is a brief summary of what I learned from coding a small audiovisual sketch, every day, during a month.</em></p><h3>Motivation</h3><p>These sketches that I am referring to are results of a daily coding practice, called ‘Hackpact’. Hackpact itself originates from live coding activity of musicians, but in recent years it has been extended into different directions. You can find several precursors in art history, specifically in the fields of instruction based and algorithmic art. Also, there are several artists, technologists and enthusiasts who took part in developing this format.</p><p>Originally, <a href="https://www.fredrikolofsson.com/f0blog/?q=node/490">Fredrik Olofsson</a> and Click Nilson initiated the idea of ‘pact’ where they shared <a href="https://toplap.org/">live coding practice</a> and musical ideas between each other. Soon, a growing scene of live coders continued the tradition, including <a href="http://mndl.hu/2009-09-30-hackpact.html">Gabor Papp</a>, <a href="http://slab.org/">Alex McLean</a>, Kassen Oud and Daniel Jones. Lately the idea of every day coding through a period of time took interest in a broader audience.</p><p><a href="http://codevember.xyz/">Codevember</a> is a challenge basically for frontend developers, while <a href="https://www.100daysofcode.com/">100 days of code</a> is a somewhat longer challenge, for a larger coding community. My friends at <a href="https://xorxor.hu/">XORXOR</a> also completed several <a href="https://xorxor.hu/projects/research/codevember_2016.html">challenges</a>. Back then in London, Dave Griffiths and Alex introduced me the field of (audiovisual) live coding, they also developed their own tools for creating realtime art, including the great, lisp based <a href="http://www.pawfal.org/fluxus/">Fluxus</a> environment, the funky game engine <a href="http://www.pawfal.org/dave/blog/2013/02/al-jazari-2-minecraft-meets-fluxus/">Al Jazari</a>, or the more recent <a href="https://tidalcycles.org/">Tidal Cycles</a> live coding environment. Thor Magnusson’s <a href="http://www.ixi-audio.net/">IXI Software</a> was also a very inspirative hub for making visual music and live coding.</p><p>There are artists also, coming from other, non musical motivated fields of the scene. For example, <a href="http://thesystemis.com/">Zach Lieberman</a>, a Brooklyn based artist and one of the developers of the creative coding tool <a href="https://openframeworks.cc/">OpenFrameworks</a> is making his daily sketches since years, he also made great articles and summaries on his experiments <a href="https://medium.com/@zachlieberman/daily-sketches-2016-28586d8f008e">here</a> and <a href="https://medium.com/@zachlieberman/daily-sketches-in-2017-1b4234b0615d">here</a>.</p><h3>Manifest</h3><p>This process was all about</p><ul><li><em>trying to find my own voice</em> (including inspirations, interests, methods, formats, visual language, sonic synthesis etc.)</li><li><em>escaping the comfort zone</em>: Think in space (3d) instead of a 2d canvas. This has been done using transparent, current web based technologies like WebGL, WebAudio &amp; ES6 debugging and building environments.</li><li><em>problem framing</em> instead of problem solving (more on that later)</li><li><em>plasticity</em>: sound should always affect the graphics and/or vice versa</li></ul><p>I wanted to keep things simple, so I used some handy frameworks for sketching: <a href="https://p5js.org/">p5js</a>, <a href="https://tonejs.github.io/">tonejs</a> and <a href="https://webpack.js.org/">webpack</a>. Since the original goals of a hackpact are both practice and knowledge transfer, it was essential to share the source that can be reused by anyone at will. Ideas matter over technological solutions, so anyone should come up with their own ideas and use these existing technological ways to implement them. Ideas are a continuous flux, they are not coming from nothing. We are clearly standing on shoulders of great giants. So one last and important aspect of the whole process was to highlight any inspiration: name the sources and influences that are affecting the work. It is essential for reasonable knowledge sharing.</p><h3>Things I learned</h3><p>Although it seems evident, each day differs from the other. Some day it’s hard to continue, some day it’s easier. <a href="http://lawsofsimplicity.com/">Simplicity</a> helps you keeping on track on the hard days, and focusing on the idea on the easier days. So, simplicity, first.</p><p>Regarding to the focus, I think I had a different type of interest in the flow, compared to Zach’s daily sketching routine. While he is focusing on iteration instead of new ideas (which is great as a tool for unconscious exploration), my method was more about ‘<em>problem framing’</em>. This interest is the opposite of problem solving: while computable algorithms and traditional design thinking is about (creative) problem solving, I see the that the future of human creativity (especially when it comes to fusion with artificial thinking machines) lies in creative ‘problem framing’. Find the areas that needs to be covered. Spot the hard places. In my case: find your true interest.</p><p>With these experiments, my goal was to find out what type of ideas are important to me that still can fit into my set of limitations. Limitations are strong helpers when one needs to be creative.</p><p>After all, as I see it turned out, there are mainly three directions that caught my interest.</p><h3>1. The sound of algorithms &amp; natural processes</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-MzHOTK7FIXlTxmsboNUMw.png" /><figcaption>Sonificating Algorithms: Prime Number Distribution (left), Diffusion Limited Aggregation (middle), Bubble &amp; Linear Sorting (right)</figcaption></figure><p>A truly interesting area of computation is understanding algorithms. Several decades ago, people were literally listening to them. Computer scientists could tell if a process runs well by only listening to the machine. Of course, today’s computers are much faster, underlying processes are inaudible for the human ear. So, it turned out, sonificating algorithms is a special field, where time must be slowed down, in order to let the algorithm folding out within an audible domain. This topic can be a great start to discuss the speed, rhythms and cycles of regular routines, today’s algorithmic practices, highlighting strange and semi-legal activities of <a href="https://en.wikipedia.org/wiki/High-frequency_trading">high frequency trading</a> for example.</p><p>While making these sketches it turned out that these artificial, binary, numerical algorithms are really similar to patterns that we can find in nature. <a href="http://mathworld.wolfram.com/CellularAutomaton.html">Cellular automata</a>, <a href="https://twitter.com/MrPrudence/status/1069643452877586437">natural sorting algorithms</a> and other abstract natural data processes are really interesting methods to play with. Regarding to this path, the <a href="https://natureofcode.com/">Nature of Code </a>by Dan Shiffman is a quintessential reference. Also, <a href="http://www.dataisnature.com/">Data is Nature</a> by Paul Prudence is a highly intensive source of inspiration when one is dealing with these topics.</p><h3>2. Visual Notation</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Cm7so_5hQUv0JYPHUflAzQ.png" /><figcaption>Visual notations: Realtime trainable Markov Chain (left), Shepard Tone (middle), Hungarian Folk Song (right)</figcaption></figure><p><a href="https://johncage.org/">Cage</a>, chance operations, and different <a href="https://www.artsy.net/article/artsy-editorial-fluxus-movement-art-museums-galleries">fluxus</a> notations are the precursors of today’s realtime digital artistic practice. A drawing that can be turned into sound, an event that can be added to a notation, a pattern that can be repeated and unfolded based on several text based instructions are all taking part within this game. Aleatoric compositions, random artefacts, the will to leave behind artistic decisions are all examples of a great legacy marked by the artistic movements from the 20th century. On one hand, they are indicators of a possible world, where nonhuman, unfamiliar or alien companies and intelligences are shaping the flow of creativity, among humans, plants, fungus or animals.</p><p>On the other hand, visual music notations are not only graphic beauties, they are functional, they have to be interpreted and actualized, just like plain computer code.</p><h3>3. Game play</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*p_0LfRbV3fYZnyXEeywY_w.png" /><figcaption>Game-like environments: Path finding (left), Hexagonal music interface (middle), Gravity as musician (right)</figcaption></figure><p>If you read <a href="http://bogost.com/books/play-anything/">“Play Anything”</a> by Ian Bogost it is no question that simple stones can act as complex playgrounds if rules are set well. Play is the natural need to make things move, play is the method we interact and experiment with reality. Board games are simulations of more complex universes. Game is the ultimate abstraction layer, with infinite complexity of rules, methods, tactics and solution mechanisms. Games are both challenging and joyful, adults like to forget the importance of their role in our everyday lives.</p><p>I like to think about the cultural context of music today as the context of (meaningful and intelligent) game environments. Sounds and contemporary music needs active participation from the audience, a will to explore and express themselves and their interests. The cognitive and psychological aspects of a gameplay are very interesting fields for further research and experimentation. New musical instruments, computer games, abstract and immersive environments are also fields that need in-depth investigation in both sociocultural and psychological ways.</p><p><em>All sketches are live &amp; can be tried out at the </em><a href="https://stc.github.io/HackPact/"><em>code repository</em></a><em> (please note they are incomplete rough web apps, each made during a few hours, so they are not optimized for mobiles, smart door bells or other fancy IoT gadgets)</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3004d51a02e7" width="1" height="1" alt=""><hr><p><a href="https://medium.datadriveninvestor.com/30-days-of-coding-practice-3004d51a02e7">30 Days of Coding Practice</a> was originally published in <a href="https://medium.datadriveninvestor.com/">DataDrivenInvestor</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Visual Music & Machine Learning Workshop for Kids]]></title>
            <link>https://becominghuman.ai/visual-music-machine-learning-workshop-for-kids-a90c957dab33?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/a90c957dab33</guid>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[workshop]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[machine-intelligence]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Tue, 03 Apr 2018 10:31:11 GMT</pubDate>
            <atom:updated>2018-04-24T13:42:35.511Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xWXzKYs0bJxzaLjwqBrrWg.jpeg" /></figure><p>This writeup is a summary of the thoughts &amp; experiences we had along a workshop that we designed for kids, in order to transcend gaps between generations via playful knowledge sharing and understanding cutting edge technology through making instead of relying only on theoretical descriptions.</p><p>It all started with the 50th anniversary of the <a href="https://www.leonardo.info/">Leonardo Almanach</a>. We’ve been asked by <em>Nina Czegledy</em> to make an event that makes it possible to share high level, advanced topics (science, technology) for kids in playful forms. Since Leonardo is an academic journal, it is an interesting experiment in itself: making such concepts available for people who were not involved in it before. If we have a look on the current (and near future) media art landscape, we see that there are a lot of developments on both the hardware side and the software side. Since current popular hardware advancements are so ephemeral, unreliable, and entertainment related (VR, AR &amp; the like), we wanted to dive into the realms of something different. Something that can tell more about paradigm shifts, cognition, thinking and the world: the area of creative usage of machine learning.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3qB3jZrvNHOZovtJvDqN4Q.jpeg" /></figure><p>We have large experience in audiovisual performances and fine arts — <em>Andrea Sztojanovits, Lorand Szecsenyi-Nagy</em> are both artists &amp; researchers such as myself — so we decided to share concepts through creative ways of music creation. While drawing and building are ways of constructive expression, music is a form of communication using intuitive, sensual contexts, so if we go this way, kids can find connections and consequences in a more personal aspect as opposed to more regular, abstract ways that are operating only on the visual domain.</p><figure><a href="http://bit.ly/BusinessOfBots"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*S_E42x8_h-YHrGnfJLosoQ.png" /></a></figure><h3>Embedded Experience</h3><p>First we tried and played around with the possibilities of the human body: showing how conductivity can form electric circuits is always releasing a bunch of ideas that helps in leaving behind cognitive bias for the children. By letting electricity flow through each of us, interrupting &amp; connecting the circuit, we immediately became part of a larger, distributed system. When children were touching each other, it became clear, that this is something that we can do together, everyone is equal and very important in the circuit. By letting current rise through all participants, concepts like trust, equality, experimentation, play, openness arise naturally, and these lead to constructive conversations, it also helps children to get comfortable with the situation, and initiate communication &amp; sharing of subjective experience.</p><h3>Trending AI Articles:</h3><blockquote><a href="https://becominghuman.ai/paper-repro-learning-to-learn-by-gradient-descent-by-gradient-descent-6e504cc1c0de">1. Paper repro: “Learning to Learn by Gradient Descent by Gradient Descent”</a></blockquote><blockquote><a href="https://becominghuman.ai/reinforcement-learning-for-autonomous-vehicle-route-optimisation-d97efec9abbd">2. Reinforcement Learning for Autonomous Vehicle Route Optimisation</a></blockquote><blockquote><a href="https://becominghuman.ai/code-wonders-96d629bb8d8c">3. Best websites a programmer should visit in 2018 @code_wonders</a></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GLM34O6YxWZscGKB3ldc7A.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*9o1JwLnvIsbgtm5eySwU1g.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xfxS9xe8rUlPD0qBm2qnTA.jpeg" /></figure><p>We were adding &amp; connecting fruits, environmental artefacts (gas tubes that we found in the room), any sort of conductive material to the system. This way we were showing the possibility of abstraction in a system, asking questions like <em>if something works, what else can work, how can we extend existing concepts regarding to a problem</em> (in this case, generating sound)? Objects, environment were followed by the introduction of conductive paint, so we could face challenges and inspiring aspects of drawing, painting &amp; organizing sounds in a visual way.</p><h3>Sounds</h3><p>After making drawings of weird &amp; surreal creatures, distant, never-seen before landscapes and newly created constellations, we connected the drawings with the computer, mapping accurate sounds to different regions and semantic components of the drawings. Musical structures (piano sounds, xylophone, marimba) and sampled sonic realms (bubbles, animal sounds, natural forces) both found their ways to appear along with the tangible space of the drawings. Since kids came from different backgrounds with different interests, we found ourselves in a very diverse set of sonic galaxy: some of them were more musical, some more tactile &amp; open for strange sounds, some are just observing the whole scene.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F6XC3x6_vNkE%3Ffeature%3Doembed&amp;url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D6XC3x6_vNkE&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F6XC3x6_vNkE%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="640" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/a9f260c0f61182254bb0e2960e4d5043/href">https://medium.com/media/a9f260c0f61182254bb0e2960e4d5043/href</a></iframe><p>These sounds, combined with the drawings were definitely creating a very unique way to understand abstract components and their correlations. Although it was purely intentional and experimental, children were tackling at the deep interrelations of interface &amp; usability design, cognitive science, software ergonomics, system theory without touching any concept verbally &amp; directly of these fields.</p><h3>Machine Companion</h3><p>After turning drawings into working models of playful sonic interfaces (connecting the cables, mapping the inputs), we started to try and discuss the possibilities of what an artificial machine can add (or take away) to extend play, expression &amp; creativity to the system. First we started to add simple delay effects to the sounds. This is a concept where the sound is repeated with a certain amount of feedback. We could say, time is captured, and rotated backwards into the musical sequence. Time, repetition is the very basic of musical structures, so it is a good point to start with the concepts. Our second playful example was to add states for the repetition: we’ve been teaching <a href="http://setosa.io/ev/markov-chains/">Markov chains</a> on the fly, to continue our recently added sound sequences. This system does no more than repeating some events we’ve already showed them: while we are training the chain, we teach the probability (of switching fro m one pitch to the next one) too, that makes possible to move along from one state to the next one, etc. This model is used within a lot of fields from creating content for games, composing music, or simulating conversations. It is much more advanced compared to our previous feedback-delay model, since it really takes care of the “state” that we pass to it.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2Fzdl0injiD9w%3Ffeature%3Doembed&amp;url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3Dzdl0injiD9w&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2Fzdl0injiD9w%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/924f7bad1ef09566460e92ce986d6d5d/href">https://medium.com/media/924f7bad1ef09566460e92ce986d6d5d/href</a></iframe><p>The third example was about to introduce the companion of an artificial entity more further: we were playing together with a machine where the system was trying to catch up where we left off. By playing simple melodies to the system, it was trying to continue our “musical thought” by improvising in the same scale &amp; mode, using a <a href="https://en.wikipedia.org/wiki/Recurrent_neural_network">Recurrent Neural Network</a> that is not only aware of current state, but is also time aware, so can track and notice changes during the evolving composition. We were using pre trained models from <a href="https://magenta.tensorflow.org/">Magenta</a>, implemented in <a href="https://deeplearnjs.org/">deeplearn.js</a> by <a href="http://teropa.info/">Tero Parviainen</a>.</p><p>What we’ve noticed, that kids grabbed immediately the constrains &amp; possibilities of the first (delay-feedback) system. They started to play around with it, they changed their mood for playing, they were both acting &amp; listening. What was more surprising is that playing together with the neural network was also very smooth: they understood that they have to wait for the next improvised “answers” from the system, they also integrated these answers into their own playing technique. Since it was very basic, we could observe it only through the dynamics and the speed (including breaks, longer silence) in their play.</p><h3>Across generations</h3><p>The workshop was followed by a very inspiring talk on Neural Art by <em>Daniel Varga</em>, that was investigating the visual aspects of current deep learning methods and artistic outputs. It also turned out as a relevant way to connect the gap between the children and their parents, describing more on the topics of <a href="https://en.wikipedia.org/wiki/Generative_adversarial_network">GANs</a>, <a href="https://en.wikipedia.org/wiki/DeepDream">Deep Dream</a> and the role of those vision based convolutional approaches in our regular life.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iPL--GXu4t00PJlRJmLxLg.png" /><figcaption>Still from the Neural Art lecture by Daniel Varga</figcaption></figure><p>At the end, we also saw some inspiring examples from the works of <a href="https://twitter.com/quasimondo?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor">Mario Klingemann</a> &amp; <a href="http://www.memo.tv/category/work/by-type/">Memo Akten</a> who are investigating the edges and borderlines of current ML technologies from a very provocative and artistic point.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*uhZiKwZStlGDDMIW5CR8DQ.png" /></figure><p>This event was part of the worldwide <a href="https://www.leonardo.info/50th-anniversary">Leonardo 50 celebration year</a>. It would have not been realized without the hosting of <a href="https://prezi.com/">Prezi</a> &amp; the help of <a href="http://aether.hu/"><em>Adam Somlai Fischer</em>.</a></p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fupscri.be%2F8f5f8b%3Fas_embed%3Dtrue&amp;dntp=1&amp;url=https%3A%2F%2Fupscri.be%2F8f5f8b&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=upscri" width="800" height="400" frameborder="0" scrolling="no"><a href="https://medium.com/media/c43026df6fee7cdb1aab8aaf916125ea/href">https://medium.com/media/c43026df6fee7cdb1aab8aaf916125ea/href</a></iframe><figure><a href="https://becominghuman.ai/artificial-intelligence-communities-c305f28e674c"><img alt="" src="https://cdn-images-1.medium.com/max/255/1*2f7OqE2AJK1KSrhkmD9ZMw.png" /></a></figure><figure><a href="https://upscri.be/8f5f8b"><img alt="" src="https://cdn-images-1.medium.com/max/255/1*v-PpfkSWHbvlWWamSVHHWg.png" /></a></figure><figure><a href="https://becominghuman.ai/write-for-us-48270209de63"><img alt="" src="https://cdn-images-1.medium.com/max/255/1*Wt2auqISiEAOZxJ-I7brDQ.png" /></a></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a90c957dab33" width="1" height="1" alt=""><hr><p><a href="https://becominghuman.ai/visual-music-machine-learning-workshop-for-kids-a90c957dab33">Visual Music &amp; Machine Learning Workshop for Kids</a> was originally published in <a href="https://becominghuman.ai/">Becoming Human: Artificial Intelligence Magazine</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Procedural Drawing]]></title>
            <link>https://medium.com/@_stc/procedural-drawing-fb18aab70268?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/fb18aab70268</guid>
            <category><![CDATA[art]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[algorithms]]></category>
            <category><![CDATA[drawing]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Mon, 01 Jan 2018 16:10:33 GMT</pubDate>
            <atom:updated>2018-01-03T17:38:27.018Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*AVubEARjlBHPjSBHUUH6wQ.png" /></figure><p><em>This text is an updated &amp; extended version of a post from my doctoral research blog, entitled “Procedural Drawing”, written in 2014</em></p><h3>Process</h3><p>Procedural properties are ancient problem solving techniques in communication, art, crafts and all type of human activities. We can see its incarnations in everyday life, from beautiful handmade <a href="http://en.wikipedia.org/wiki/Rangoli">indian rangolis</a> to formalised <a href="http://en.wikipedia.org/wiki/Generative_Design">design practices</a>, mathematics, geometry, music, architecture and even pure code language. Controlling process involves a continuous cognitive effort from the maker: a presence, combined with some kind of respect and patience while applying the pre-scripted rules.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/550/1*DIkHraR6F1NtmYJA0LMWqQ.jpeg" /><figcaption>Rangoli (South India)</figcaption></figure><p>Media and technology has an overwhelming relationship with our cultural society. Stream of events, speed of information sharing grows rapidly, it is hard to catch up with the latest directions of specific areas of tools, art and technology. New social contexts, cultural interactions arise day by day. These days designers need to focus and reflect on the ‘here and the now’ and have an overview on the current methodologies, design practices. We can always learn and adapt new, short term, overestimated technologies that are sitting on the top of the <a href="https://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/">hype cycle</a>, but it is much harder to grasp the underlying phenomenons, ancient design decisions, the human factor. My recent procedural drawing workshops were about to catch these properties under the hoods. The method relies heavily on the practice of <a href="http://www.fluxus.org/">fluxus</a> and some exercises of the <a href="http://conditionaldesign.org/">Conditional Design</a> team.</p><p>The language of the workshop is <a href="http://www.unf.edu/~broggio/cop2221/2221pseu.htm">pseudocode</a>. There is no specific type, no predefined syntax, we do not rely on any computers, function libraries, we use only pens, lines, papers, logic, repetition, rules, process. We are following the path that many philosophers, engineers, inventors, mystics have been followed before us: think and draw.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/353/1*N1zUGBeEdXgvO6_pZopG1A.jpeg" /><figcaption>A simple, branching structure by Lindenmayer</figcaption></figure><p>A very beautiful procedural example is the system made by Aristid Lindenmayer who was trying to describe complex biological and natural growth with a simple set of rules. This system is named after him. He also wrote a really inspiring book on <a href="http://algorithmicbotany.org/papers/abop/abop.pdf">“The Algorithmic Beauty of Plants”</a>. He wanted a way to test his theory about the growth pattern of a particular type of algae. His theory stated that the cells of this algae could be in one of two states: growth or reproduction. An algae in the growth state eventually grew into the reproduction state. An algae in the reproduction state eventually divided into two cells, one of which was in the growth state and the other in the reproduction state. Lindenmayer’s grammar system proved a fantastic method for proving his theory. What Lindenmayer could not have predicted is the incredible usefulness of his system in many other areas, both in biology and in mathematics.</p><p>A Lindenmayer grammar is fully defined by an initial axiom and a set of one or more transformation rules. The initial axiom consists of a “string” of characters (e.g., alphabetic letters, punctuation, etc.). Each transformation rule gives a set of characters to search for in an axiom, and a set of characters to replace the original characters with. Applying all of the transformation rules to the initial axiom produces a new axiom. The rules can then be applied to this second axiom to produce a third axiom. Applying the rules to the third axiom produces the fourth, and so on. Each application of the transformation rules is called an iteration of the grammar.</p><p>Another interesting aspect of procedural, algorithmic thinking is something that we can call the “stage-analogy”. As <a href="http://fadesingh.tumblr.com/post/43391943394/stage-software-spectrum-a-short-personal-hist">Rohid Gupta (Fadereu) refers</a> to the analogies between stage, performance &amp; programming: “As much as our machines, we have become the processors of information, but we do not read text and instructions line by line as computers do. We scan in less than a blink and get an overall visual sensory pattern — like the notes in a musical chord, or the Fourier Transform of a rich spectral signal from atomic emission, we break it down in a subconscious way.” Actors, performers are acting based on predefined set of rules, be it improvisational or fully, “strictly” followed algorithms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/550/1*HD8T-E7L4IjqFtml5UZUXg.jpeg" /><figcaption><em>Pen Drawing from the Course: Attila Somos was experimenting on how to formalize &amp; define recursion</em></figcaption></figure><p>Visual arts started to adapt these concepts with the rising of the Dada movement in the first decades of the twentieth century: artists, performers were giving instructions, pseudo codes for interpreting (compiling) their piece. Like musical notations, which are originally interfaces for representing different events that are distributed in time, drawings, visual arts also reached a state where the liveness or the actual “happening” of the concept is separated from the thoughts aka the software. <a href="http://www.fluxus.org/">Fluxus</a> in the sixties, conceptual artists, Sol Lewitt, <a href="http://www.georgkargl.com/en/box/exhibition/miklos-erdely-and-the-indigo-group-fotoworks-from-the-70ies-and-80ies">Miklós Erdély</a> with his creative drawing workshops and conceptual works also continued the tradition.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/550/1*5g30H5Wu-5MzGBLUFvVuSg.jpeg" /><figcaption>Pen Drawing from the Course: <em>Marcell Török gave instructions to synchronize your length of line with the time you are breathing in and breathing out</em></figcaption></figure><p>This tradition is widely used and democratized today, since we are working with software separated from hardware, we can find this concept embed very deep in our everyday life. The first workshop was then followed by a second one, where participants were also practicing computational thinking without the use of machines. This event was made together with <a href="http://www.artus.hu/en">Artus Contemporary Arts Studio</a> in 2014, Partapur (Rajastan, India). The following images are a selection of some executed, completed examples.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/794/1*JFy4QreCig-pZtgzfYI6-Q.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/795/1*kpCJ_FYcspNHWS0lyFLplg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/794/1*09ugy7AeGmv_P3s1PpDuEg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/791/1*TPAHKlbQe1aly5s8zRYYCw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/793/1*irklBgcTZ7m5nGBcePQogg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/857/1*zabMUyY_QglNYb_x61frKA.jpeg" /><figcaption>Drawings and corresponding instructions from the Indian workshop</figcaption></figure><h3>Extended Cognition</h3><p>Extended cognition is the view that <a href="https://en.wikipedia.org/wiki/Mental_process">mental processes</a> and <a href="https://en.wikipedia.org/wiki/Mind">mind</a> extend beyond the body to include aspects of the <a href="https://en.wikipedia.org/wiki/Physical_environment">environment</a> in which an organism is embedded and the organism’s interaction with that environment. <a href="https://en.wikipedia.org/wiki/Cognition">Cognition</a> goes beyond the manipulation of symbols to include the <a href="https://en.wikipedia.org/wiki/Emergence">emergence</a> of order and structure evolving from active engagement with the world. When creating procedural artifacts, the human mind also extends some of its cognitive efforts into its environment: specifically into the (pseudo) code that acts as the ‘dna’ for the unfolding traces of the piece. By extending cognition, the mind can take care of other aspects of presence: it is freed from ordinary decision making and problem solving, and acts as a more open entity to its environment.</p><p>One such beautiful example in nature for extended cognition can be found in the relationship of the <a href="https://www.theatlantic.com/science/archive/2017/05/spider-brain-spider-brain/528153/">spider and its web</a>. In fact, there are very similar things happening with humanity as with small creatures that would need too much energy to improve their inner brains, so they outsource cognitive efforts into their environment. With the interconnected digital networks, note taking, computational tools, books, or recorded descriptions in general, humans are also extending their cognition in order to face the ever growing complexity of reality.</p><p>Moreover, <a href="http://tal.forum2.org/hofstadter_interview">some thinkers go even deeper </a>with this observation, and they say we extend our cognition into each other, resulting in a form of co-existence, where consciousness is not living only in one separated body, but within a cluster of people who know each other.</p><p>Extended cognition can be cached or visualised in several ways that would go beyond this text, however I would like to highlight one interesting field that can be treated as the materialisation of extended cognition in information society: the field of <a href="http://neuralnetworksanddeeplearning.com/">neural networks</a>. These constructions are similar to the human nervous system in terms of emergent behaviour that is based on simple function gates called perceptrons. A common thing is with them that they need lots of (preferably ‘big’) data from large corpuses in order to train them function well. These data can result from all regions of recorded life events (accounts, media, texts, biological data etc). Some people refer to neural networks (and machine learning in general) as <a href="https://medium.com/@genekogan/from-deep-learning-down-85e527a5fe7b">‘statistics on steroids’</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*RxF4FQMQNvnBDUrY81agFg.jpeg" /><figcaption>Predictions for a simple circle-like curve, from the Sketch RNN database, in the “bird” category. Each drawing starts with the same circle shape (usually ends up as the head), which is then completed by the network. The process can be thought as steps within the exploration of the latent space</figcaption></figure><p>One interesting data set is called <a href="https://magenta.tensorflow.org/sketch-rnn-demo">Sketch RNN</a>, where human drawings are collected and categorised into a recurrent neural network (RNN), that is able to construct stroke-based drawings of common objects. The model is trained on thousands of crude human-drawn images representing hundreds of classes. The system outlines a framework for conditional and unconditional sketch generation, and describes new robust training methods for generating coherent sketch drawings in a vector format.</p><p>These images are resembling a very large corpus of extended cognition, organised into a latent space.. <a href="https://research.googleblog.com/2017/08/exploring-and-visualizing-open-global.html">Observing this or similar datasets</a> can give interesting highlights between cultural differences on the act of reduction, understanding, and representing the world through simple lines of drawings, since this shows how people filter, understand and interpret everyday objects around them.</p><h3>Building a polargraph</h3><p>Lately we have been asked to make a small exhibition that is fulfilled with inspiring constraints at <a href="http://juranyihaz.hu/">our studio house</a>. One of these interesting limitations is that the walls are painted black and it is only possible to draw in the exhibition space with chalk. However creating an image with chalk is quite ephemeral and slow, so the method itself serves as a very interesting thought for critical thinking on the creation of contemporary images.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*15A_5kPFFGfkk-zKG45UcQ.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZkwifS122vgKOHZZlJmuIg.jpeg" /><figcaption>Our PolarGraph in action</figcaption></figure><p>Photographs are shot and shared rapidly over <a href="http://manovich.net/index.php/projects/instagram-and-contemporary-image">social media sites</a> with no intention on the quality of the image itself. Also, countless images are created by machines for machines only that leaves behind human awareness <a href="https://thenewinquiry.com/invisible-images-your-pictures-are-looking-at-you/">from the loop</a>, using CCTV and other automated, networked technologies.</p><p>As a matter with chalk: it is a perfect contrast for these hegemonies, where the act of drawing (thus image creation) is extremely limited in terms of colours and line qualities, so we decided to automate the process of chalk drawing, by building <a href="http://www.polargraph.co.uk/whats-a-polargraph/">polargraphs</a> that are drawing algorithmically formalised thoughts on the wall.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hKgwyhylOakjM6WIyL9xkQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*q21J8w3s_pUBQ8aiDFq7Pg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dkeLMWM37U3Gu1elaSnLDQ.png" /><figcaption>Variations for single line topologies (images: Bence Samu, Agoston Nagy)</figcaption></figure><p>A self chosen constrain was that the tool can not elevate the chalk from the wall: so we have to create a kind of ‘single line’ topology, where all shapes are segments of a continuous line, usually originating from a spiral or similar one lined structure. Limitations are some special rules within a system (such as gravity in a playground: how many interesting games evolved by tackling only with this limitation) that lead to strange and unintended creative outputs. Building such custom tools (software, polargraphs, music instruments, etc) is really balancing at a state where the snake bites its tail, where the thing you would like to say <a href="https://twitter.com/_stc/status/415944088853024768">determines your language</a>.</p><blockquote>Made famous by artists such as Paul Klee, there are clear stylistic benefits to this method of drawing. The demand of using only one line allows greater freedom in that an impression of your subject is all that is expected, rather than a true to life reproduction.</blockquote><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fb18aab70268" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Visual Sound Instruments]]></title>
            <link>https://medium.com/@_stc/visual-sound-instruments-a7e9cde93aeb?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/a7e9cde93aeb</guid>
            <category><![CDATA[games]]></category>
            <category><![CDATA[application]]></category>
            <category><![CDATA[music]]></category>
            <category><![CDATA[creativity]]></category>
            <category><![CDATA[theory]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Mon, 06 Nov 2017 15:54:19 GMT</pubDate>
            <atom:updated>2017-11-06T16:25:12.925Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*6XBhCGtgTxifmdOWcuUv_Q.jpeg" /><figcaption><a href="http://www.binaura.net/soundbow">SoundBow</a></figcaption></figure><p><em>This text is an extract of my thesis introduction from my doctoral studies at Moholy-Nagy University of Art &amp; Design, multimedia department, written in 2014</em></p><p>When speaking of (music) instruments, some of the most problematic areas are dealing with direct attention, presence and the attitude of being in the here and now, making a healthy mix of curiosity and improvisation. These fields of course include the chance of making (and learning by) mistakes, failures and disappointments.</p><p>On the theoretical side, this situation makes me use the different forms of analogies and metafors when bringing forward new ideas, describing problems, understanding questions. New technologies, inventions are also based on metaphors when hitting the audience of the wider society. The analogy of musical instruments can be understood easily in cultural terms. While these instruments are globally present, they also reflect the needs and specialities of local communities. Their structure is very simple: making sounds with physical energy. This goal has a truly interesting, deep ergonomic tradition rooted in the past few centuries.</p><p>Software based interfaces are fresh, ephemeral tools that are lacking these type of long term cultural traditions. Therefore, comparative research of traditional instruments and digital tools are raising really interesting questions. And, last but not least, the conclusions of these investigations can be adapted into a more general approach of current creative interaction systems. Luckily, mostly I myself am making software based tools for performances, installations and different interfaces, therefore the research text and my final practical master work form a uniting whole.</p><p>Language, as a tool for manipulating abstract symbols is serving the basis for these studies on visual sound instruments. Language is a tool for interpreting the world, communicating ideas, describing thoughts and feelings on different levels of abstraction layers. Among natural languages, artificial languages have important roles in shaping the processes of the world. Language as a mimetic communication system has a nature that is generative, open, ever-evolving.</p><p>Mimesis is the first form of understanding social signs, which is mainly based on episodic fragments, thus creating an <strong>analog</strong>-like information transmission. Instead of mimetic (spoken, movie, photo) languages, the text focuses on <strong>digital</strong>, or cryptographic languages (such as musical notations, computer code, binary systems) which helps understanding the architecture of digital sound instruments. <strong>Designing with cryptographic languages needs a different understanding than the process applied in the design using mimetic languages.</strong></p><p>The introduction of today’s widely used programming paradigms are helping to understand the different abstraction layers in interactive systems. Starting from one dimensional, text based representation, followed by a two dimensional, visual representation, it turns out that on the higher levels of abstractions, <strong>these systems are constructed of multidimensional interaction modalities, where behavior patterns, cognitive aspects and the nonlinear nature of time are also taking part in the experience.</strong></p><p>To illustrate it accurately, the <a href="http://www.ixi-audio.net/thor/Magnusson_NIME2010.pdf">phenomenological dimension space</a> is introduced as a method to process and categorize these dimensions.</p><p>Musical instruments naturally have these dimension spaces embedded in them, shaped by their ergonomic aspects, cultural functionalities and resonating bodies. <strong>In the case of software based interfaces, these dimensions are not originating a prior from the physical parameters of the object so they have to be built in explicitly into these systems.</strong></p><p>This means, that <strong>the lack of a physical body induces a new type of inner coherence in software based visual instruments, which drives to unknown territories both designers and players.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/606/1*y1HGgTmleNO_ZtHphYZvmQ.png" /><figcaption>Plate of Ernst Chladni, a tool for investigating physical shapes of soundwaves. Source: William Henry Stone: <em>Elementary Lessons on Sound</em>, London: Macmillan, 1879, p 26, fig 12.</figcaption></figure><p>If we look at the history of software based tools, there are identical shifts compared to what we find in the history of classical instruments with resonating bodies. The need of scalability, universality generates new paradigms in each lineup of the different tools. In classical music, such paradigm shift is the twelve tone tempered music from the early renaissance. This change made possible to tune the different types of instruments into a common pitch spectrum with the reduction of natural sounds, negotiating the importance of harmonics and natural overtone frequencies. A very similar approach related to digital tools is the invention of the MIDI protocol in the twentieth century, which was made for synchronizing different devices with 128 discrete values for each parameter. <strong>The invention of the tempered scale and the invention of the MIDI protocol were pretty similar in their time: they both constrained musical creativity because of the need for universality.</strong></p><p><strong>Reconfigurable, dynamic media systems bring forward new kind of creativities where the forementioned dychotomies are always present.</strong></p><p>The concept of sound instrument is an extended one here. The interface includes the playground for the interaction while it is a representational surface, also. <strong>The role of the composer, performer, listener are now changed in mainstream</strong> culture such as with the rise of progressive contemporary communities of the fluxus and related art fields in the middle of the twentieth century. <strong>The composer includes notational elements in her instrument, which has been interpreted by the listener when consuming it. The prescriptive nature of notation and the descriptive nature of recording, visualization are merged, visual instruments became interactive notations at the same time.</strong></p><p>The concept of composer, performer, audience is not valid anymore in these systems. The artworks are tools themselves the best analogy to describe them can be borrowed from the world of <strong>games</strong>. The relation of music and game are deeply rooted in our language also, think of the terms <em>play the piano, play some music</em>, <em>when do you play?</em> etc. The ecosystem of digital games are much more adaptable to the distribution of contemporary visual sound instruments than the heritage of musical production: instead of buying heavy vinyls or magnetic tapes, people get their tools and music for a few cents from online distribution channels. Since they get their material from these online entry points, realtime response from the audience is an essential component in the consuming of these artefacts. <strong>In the case of software based instruments, feedback from the audience has more and more components that works like the feedback in the consuming of games.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*c11jz68n_DvtYyZZ_38cgA.gif" /><figcaption><a href="http://www.binaura.net/atlas">Atlas</a></figcaption></figure><p>An immersive game flow is key element in the experience of a sound instrument: exploration, chance probabilities, playfulness and failure are all taking part in the whole. Game makers are making sonic instruments (game levels, if you prefer) where the players are navigating and the composition is brought forward during their personal journey.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a7e9cde93aeb" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Game World]]></title>
            <link>https://medium.com/@_stc/game-world-98a0f18e3a13?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/98a0f18e3a13</guid>
            <category><![CDATA[experiment]]></category>
            <category><![CDATA[notation]]></category>
            <category><![CDATA[visual-music]]></category>
            <category><![CDATA[games]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Mon, 09 Oct 2017 09:13:57 GMT</pubDate>
            <atom:updated>2017-10-09T10:31:30.303Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*25C8_sSX9H0noXHGzBXJJw.gif" /><figcaption>Interactive visual notation using agents in the browser, pre-trained with reinforced learning algorithms</figcaption></figure><p>After the experiments that were dealing with analysis, generative systems and data curation, it is time to have a look at the third learning principle, called <a href="https://en.wikipedia.org/wiki/Reinforcement_learning">reinforcement learning</a>. This method is a mixture of the previously described methods, If you ask, I would call it environmental learning, since the solution for a specific problem is defined and learnt from the behaviour (feedback) of the environment. Pre-trained agents are fascinating in terms of behaviour, so I am thinking about a strange relationship between these skills and the human player. Competing against these artificial agents directly would be too direct and unfair (they are dumb in the beginning, but they get quicker than humans slowly during the training process), so I decided to build another kind of interaction with them: the user should <strong>help</strong> one of them achieving its goal, while constantly <strong>avoiding</strong> the other achieving the same goal.</p><p>This experiment is like an indirect interaction, derived from games like <a href="https://en.wikipedia.org/wiki/Lemmings_(video_game)">Lemmings</a>, <a href="http://www.simcity.com/">SimCity</a> or other strategic games, where the user sometimes reconfigures the environment, then acts like an observer, leaving space for causalities and possibilities to happen within those directed constrains. I like the word we use for making music: musicians usually <em>play</em> their instruments, so it is also part of these experiments to make music (or event based sonification if you prefer) not in terms of realizing musical ideas, but more like leaving traces of problem solving steps within an abstract playground.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Ft1ys0Xk8VhYxw1KJtUYug.jpeg" /><figcaption>Atlås ( experimental game research project )</figcaption></figure><p>This basic, minimal &amp; constrained application has many possibilities in it, I already started to turn this thing into a more complex sonic toy, generating levels, scenes, time structure, involving philosophical statements from mid 20th century experimental thinker &amp; composer John Cage, leading to the birth of my forthcoming app, called <a href="http://www.binaura.net/atlas/">Atlås</a>, that is available to download as of October 20, 2017.</p><p>Meanwhile, play with the experiment in your browser <a href="http://www.binaura.net/stc/research/code/melody-learning-pt3/">here</a>, or get the code from the research <a href="https://github.com/stc/Exp-res/tree/master/melody-learning-pt3">repository</a>. The original sketches were built with <a href="https://p5js.org/">p5js</a> (using webaudio) and <a href="http://cs.stanford.edu/people/karpathy/reinforcejs/">reinforcejs</a>.</p><h3>The magic circle</h3><p>“The arena, the card-table, the magic circle, the temple, the stage, the screen, the tennis court, the court of justice, etc., are all in form and function play-grounds, i.e., forbidden spots, isolated, hedged round, hallowed, within which special rules obtain. All are temporary worlds within the ordinary world, dedicated to the performance of an act apart. ” (in: <em>Homo Ludens, </em>Johan Huizinga, p. 107)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*gIeR84gB_Cqwq0Tuy-liTw.png" /><figcaption>The magic circle</figcaption></figure><p>“Somehow we got the idea that fun refers to enjoyment, and that games offer us special access to that enjoyment. But games and fun are not connected because games are already intrinsically entertaining or enjoyable, but because games are already intimately associated with playgrounds. Games are experiences we encounter through play.</p><p>Play is the act of manipulating something that doesn’t dictate all of its capacities in advance, but that limits its capacities through focus and exclusion. […] Play is everywhere, in anything we can operate.” (in: <em>Play Anything, </em>Ian Bogost, p. 92)</p><p>“[advanced speed of browsers] encouraged me to continue the development. Along the way I was also labeled as “insane” for working on this project by a good friend of mine, which only made me further step up my efforts — when people call you insane you know you’ve hit on something interesting!” (in: <em>Data Science Weekly, </em>Andrej Karpathy)</p><p>“Even if play produces fun, the basic experience of play is not letting loose or doing whatever you want, but carefully and deliberately working with the materials one finds in a situation. Play is not only fun, not only a child’s activity, but also exploring the free movement present in a system of any kind, where system might refer to a social situation as much as a machine assembly. […] Thinking worldfully, it is better to think of play as a condition of the universe rather than a human activity — everything is ‘at play.’ ” (in: <em>Play Anything, Ian Bogost,</em> p. 113)</p><p>“It’s like gaming sometimes, trying to guide it. There’s some very basic AI in there — I mean only using “if” statements, conditionals, if-the-situation-is-this-then-do-that type things. It’s as basic as a game AI, if you look at the AI for the characters in a game, it’s just a chain of “if” statements, basically. It’s very much on a level to that, really. So playing music on it is about as fun as playing Grand Theft Auto, doing random shit with pedestrians, seeing if you can get someone to run up a wall or whatever. If I can get the musical equivalent of that, I’m generally quite happy.” (in: <em>Autechre interview: Joe Muggs goes deep with the seminal Warp Records duo</em>, Sean Booth)</p><p>Hacking, altering (bending) existing contexts is a good way to learn not only from people but from systems (machines) around us. Such as the machine starts understanding its environment and learn from the patterns in it, we humans need new kind of learning methods and existential attitudes such as <a href="https://criticalengineering.org/">critical engineering</a>, ethical technology awareness, conscious consuming strategies, reasonable activism among others.</p><p>In the past few decades, the role of media audience turned into media (thus software) user, becoming a central element in the whole experience: understanding narratives, revealing stories, sharing information needs active participation. This human centered approach is based on conditions that previously did not take part in the process of designing content: cognitive, physical, ergonomical actions and limitations, metadata, context of the environment, metrics, role and frequency of the usage. The future of media culture is shifting from classic time based contexts to the worlds of playgrounds, where users create, play, share and reflect on their thoughts and experiences.</p><p>I find the act of <em>play </em>a key role in today’s creative playgrounds, where gamification is a practical component and an interesting research field within music creation, drawing, education and storytelling.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=98a0f18e3a13" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Sonic State Machines]]></title>
            <link>https://medium.com/@_stc/sonic-state-machines-1784b02ad121?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/1784b02ad121</guid>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Fri, 01 Sep 2017 11:28:34 GMT</pubDate>
            <atom:updated>2017-09-01T11:28:34.458Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*Ee_OSRTN_NrAiKmnjlfD6g.png" /><figcaption><em>Ramon Llull: Ars Magna (1305)</em></figcaption></figure><p>Since sound and music are time based media, events (that are triggering sounds) are occurring in varying patterns of frequencies and repeating occurrences. This sound experiment is treating with the events of sounds as entities that can be transferred or permutated forward and backwards using random probabilities. Sequencers in electronic music and time based media do nothing else than distributing events within small cells of discrete timeframes. This method is purely combinatoric, that might involve ancient techniques such as permutation, repetition and other basic algorithmic manipulations. Some people compose those cells by hand (just like most composers in the last century), others let algorithms take part in the process, leading to unexpected generative results. Manipulating sequences with a machine companion reminds me to some of the techniques of the 13th century philosopher <a href="https://monoskop.org/Ramon_Llull">Ramon Llull</a>. As it is pointed out by Umberto Eco in his brilliant book <em>The Search for the Perfect Language</em>, Llull’s masterpiece <em>Ars Magna</em> introduced an abstract language of a reduced alphabet to create cosmic questions and seek answers for a reconfigurable universe. His intent was to convert muslims to christians through praying, reasoning and pure logic (instead of war) so he studied arabic language, combinatorics and other unfamiliar-at-the-time practices.</p><p><em>Ars Magna</em> was using a mechanic, reconfigurable circular geometry that could be rotated (using papers with a pin in the middle), which led to a large set of constellations of the symbols (each symbol meant different principles). This attend to seek answers through such logical combinatorics reminds me to the current trend of using neural networks and machine learning in order to find meaningful answers regarding to interrelationships within the quantified universe. Again, we find the rhyming nature of history in those practices: we regularly like to build soft machines, state machines, learning machines to achieve the devine &amp; the ultimate and propose questions that can be answered only by using some extended cognitive process. Some computer scientists have adopted Llull as a sort of founding father, claiming that his system of logic was the beginning of information science. Regarding to (machine) learning, mathematics and classification: with the discovery of his lost manuscripts <em>Ars notandi</em>, <em>Ars eleccionis</em> and <em>Alia ars eleccionis</em>, <a href="https://alchetron.com/Ramon-Llull-808121-W">Alchetron enciclopedia</a> says “Llull is recognized as a pioneer of computation theory, especially due to his great influence on Gottfried Leibnitz. Lull’s systems of organizing concepts using devices like trees, ladders and wheels, have been analyzed as classification systems”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/913/1*diDBcHKppyHXJ2SBGcEwjw.jpeg" /><figcaption><em>Markov Graph of transition probabilities between states A, B and C</em></figcaption></figure><p>Learning machines (especially in reinforcement learning), generative music, autonomous poetry are all using <a href="http://setosa.io/ev/markov-chains/">Markov Chains</a> as their state swapping machine components. For simple generative purposes, I built the following Pure Data patch on the top of a first order Markov model. In the patch, lists of numbers define the probabilities of the next state. Most abstractions are built with <a href="https://github.com/rjdj/rjlib">rjLib</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*cZca-AYDPW-W3TFHRIeCtg.png" /><figcaption><em>First order, 4 state markov chain with probability lists</em></figcaption></figure><p>For the first state, a 0 1 1 0 would mean, the next step can’t be itself, but can be the 2nd and 3rd state, it also can’t be the 4th. For the 2nd state, a 1 0 1 0 means, it can continue with the 1st &amp; 3rd states, but not with itself, nor the 4th state, etc. First order markov chain sequences can be designed like this, on a meta-level of the sequencing process.</p><p>The patch works with weighted probabilities on a smaller level, too: each sound sample occurrence is defined with a percentage, that leads to the probability of the actual sound production.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*YW1AM_q78Tmdo-jhynZq5Q.png" /><figcaption><em>Probability distribution of sonic triggers in the sequence (0: not to play, 50: to play or not to play, with 0.5 probability, 100: play)</em></figcaption></figure><p>For example: in the sequence that consists of 8 elements, a list like 100 0 0 0 0 0 0 50 means, when reaching the first position, the sound will be triggered for sure, 100%. Then, no sound, and the last position will be on or off, with a weight of 50%. Some sound sculpting is involved in the process, such as pitch &amp; gain changing in order to make the resulting sound more diverse. As a rule of thumb, it is good to follow: avoid empty and boring repetitions. Take care of each sound occurrance: modulate, change their gain, with some LFO, permutate other parameters along time to achieve an organic sound.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FRadLlzr45VU%3Ffeature%3Doembed&amp;url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DRadLlzr45VU&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FRadLlzr45VU%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/357925b4e9e0326f599bca868ec753e1/href">https://medium.com/media/357925b4e9e0326f599bca868ec753e1/href</a></iframe><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1784b02ad121" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Graph Topologies]]></title>
            <link>https://medium.com/@_stc/graph-topologies-acc4716dffd?source=rss-1fb5146c84d------2</link>
            <guid isPermaLink="false">https://medium.com/p/acc4716dffd</guid>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[random]]></category>
            <category><![CDATA[generative]]></category>
            <category><![CDATA[network]]></category>
            <category><![CDATA[graph]]></category>
            <dc:creator><![CDATA[Agoston Nagy]]></dc:creator>
            <pubDate>Mon, 07 Aug 2017 13:54:47 GMT</pubDate>
            <atom:updated>2017-08-07T13:54:47.929Z</atom:updated>
            <content:encoded><![CDATA[<p>Based on some books like <a href="http://barabasi.com/networksciencebook/">Network Science</a> and <a href="http://linkgroup.semmelweis.hu/weaklinks_HU.php">The Power of Hidden Networks</a>, we can say networks, conversations, interconnected elements can be treated as graphs, that are containing many interesting topics such as modelling, analysis,, measurements, motifs and other interesting areas. Random models for generating networks were one of my favourite ones so I created a sketch to try out different “DIY” algorithms to generate unique graph topologies. Let’s see first some models for generating random networks.</p><p><strong>- G(N, L) Model</strong>: N labeled nodes are connected with L randomly placed links. Pál Erdős and Alfréd Rényi used this definition in their string of papers on random networks</p><p><strong>- G(N, p) Model</strong>: Each pair of N labeled nodes is connected with probability p, a model introduced by Edgar Nelson Gilbert.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*3BvfYN6kHtYWS50XCk5SrQ.jpeg" /><figcaption><em>Evolution of a random network. The relative size of the giant component in function of the average degree ‹k› in the Erdős-Rényi model. The figure illustrates the phase tranisition at ‹k› = 1, responsible for the emergence of a giant component with nonzero NG (</em><a href="http://barabasi.com/networksciencebook/chapter/3#evolution-network"><em>source</em></a><em>)</em></figcaption></figure><p>Apart of the Erdős Model, there are some other methods to generate networks, such as configurational models, where the number of edges are pre-configured on initialization, so the generated mesh will consist of vertices with pre configured edge connectedness. Qualitative models are starting from an organized network where local components are connected, and the edges are reconfigured through randomisation to connect distant areas of the network.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PkGGVy_tfaqNiB1p7i82Bw.jpeg" /><figcaption><em>Watz-Strogatz Graph Generation Model (</em><a href="https://en.wikipedia.org/wiki/Watts_and_Strogatz_model"><em>source</em></a><em>)</em></figcaption></figure><p>The code I wrote for this experiment is about to visualize a simple force directed graph with vertices and edges, where the graph can be built from a list of parameters stored in a csv file, or the components of the graphs can be added to the system individually, with different connection configurations. Later on, connectedness, betweenness, the presence of motives are planned to be visualized with the code. A vertex’s edge number is defining the size of the vertex at the moment.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*KMS8b5unIQFAxd9IhEDvDw.gif" /><figcaption><em>Generating graph: each new node is connected randomly to a previous existing node. No clusters and triangles arise.</em></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*iG8q-eE8Wee-h1eOZsqb5g.gif" /><figcaption><em>Generating graph: each new node is connected to all existing nodes. Heavy clusterization.</em></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*KDdWUKJODrejsxUeYdejgA.gif" /><figcaption><em>Generating graph: each new node can be connected to any existing node with a probability of 0.1. Some clusters arise, there are also vertices that have no edges.</em></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*hWSD0PJx8fJgr-c8KA-K8Q.gif" /><figcaption><em>Generating graph: each new node is connected randomly to one of the first three elements. The result is a heavily centralized network.</em></figcaption></figure><p><strong>Random facts, according to networks</strong></p><p>There are basically <a href="http://mathinsight.org/image/three_node_motifs">16 different motifs</a> can be found in directed graphs. Large scale graph characteristics can be visualized by their motif frequency distributions respectively. Interesting example is the “triangle closure” that can be found in social networks: motifs start forming closed triangles by time.</p><p>Usually network connectedness is high within local areas and low on the global scale.</p><p>The “network approach” is more sensitive to the cleanliness of data compared to other analytic methods.</p><p>Mathematical quantities can be described by computation, whereas representational qualities are thoughtfully interpreted aspects that can be used for visualization.</p><p>(Network based) Data analysis usually consists of the following steps:</p><blockquote>Complex System -&gt; Data -&gt; Network -&gt; Mathematical Quantities -&gt; Representational Qualities -&gt; Conclusion</blockquote><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=acc4716dffd" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>