<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Motion Bank - Medium]]></title>
        <description><![CDATA[Research from the Motion Bank project - Medium]]></description>
        <link>https://medium.com/motion-bank?source=rss----6079129e5f73---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Motion Bank - Medium</title>
            <link>https://medium.com/motion-bank?source=rss----6079129e5f73---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Thu, 19 Nov 2026 01:18:46 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/motion-bank" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Dance, Cells and Grids—The Story of MoSys]]></title>
            <link>https://medium.com/motion-bank/dance-cells-and-grids-the-story-of-mosys-92d2fa284230?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/92d2fa284230</guid>
            <category><![CDATA[glam]]></category>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[research-software]]></category>
            <dc:creator><![CDATA[Florian Jenett]]></dc:creator>
            <pubDate>Sun, 24 Jan 2021 15:59:49 GMT</pubDate>
            <atom:updated>2021-05-07T10:00:24.731Z</atom:updated>
            <content:encoded><![CDATA[<h4>How our choreographic publishing system evolved from a simple site builder to a multimodal annotation tool</h4><blockquote><strong>TL;DR </strong>— MoSys is the publication element of the current Motion Bank System (2018 – now) but also a multimodal annotation tool in its own regard. This article traces MoSys’ story, current state, and future.</blockquote><p>When we talk about our research at Motion Bank we often phrase it as “working on methods and tools for the documentation, enhancement and publication of knowledge inherent in contemporary dance”. Here “tools” refers to two building blocks of our work which we just recently (in early 2018) integrated into one/the “Motion Bank System”, and “methods” refers to the way we (and others) think about and use these. One part of the new joint system is the well known <strong>Piecemaker</strong> tool for annotation of time-based media. The other is what we call <strong>MoSys</strong> and in this article, we’d like to draw a clearer picture of it.</p><h3>The Origins</h3><p>MoSys was originally started as the backbone of our “Online Score” web publication format. In dance, a “score” is commonly understood to be a document that provides instructions for action and can be translated into a performance. An “Online Score,” on the other hand, got established as a label for web documents that brings together various formats and can serve various purposes … as you will learn below.</p><p>In 2012, slowly finishing our “phase one” (2010–2014) we realised, looking at our results from the work with <a href="http://scores.motionbank.org/dh/">Deborah Hay</a>, <a href="http://scores.motionbank.org/jbmf/">Jonathan Burrows &amp; Matteo Fargion</a>, <a href="http://scores.motionbank.org/two/">Bebe Miller, and Thomas Hauert</a>, that we would need a tool to not only publish these diverse results but also enable experimentation with and discussion about the content of these “web pages”. Content here refers to both the materials, that is text, image, video, animated and interactive elements, and also the perspectives formulated with them.</p><p>The “Online Score” format, a way of communicating and enabling the reading of dance knowledge on the web, originates from the <a href="https://synchronousobjects.osu.edu/">“Synchronous Objects”</a> project (The Forsythe Company with Advanced Computing Center for the Arts &amp; Design at The Ohio State University, 2009) which is considered to be the pilot project to Motion Bank. In Synchronous Objects, following questions like “What else might dance look like?” (William Forsythe) the team at ACCAD OSU (Maria Palazzi, Norah Zuniga Shaw, Matthew Lewis) created a web format that would bring various results from the experimentation, visualisation and documentation around Forsythe’s piece<em> One Flat Thing, reproduce</em>d into a form of interconnected tableaus that each allow for deeper exploration.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mFWo5nYwIFqRyOI5pBjyUg.png" /><figcaption>Viewing all “objects” of Synchronous Objects (2009).</figcaption></figure><p>One project goal for the first phase of Motion Bank was to create more Online Scores with content from other choreographies and hence, extend the spectrum started in Synchronous Objects. Although we were clearly setting out to continue that heritage, we eventually arrived at creating MoSys from another angle.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*CpuMRv5PYT6w8SO7jBAWbw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*MuT7idJxqA0OBb3bsCgHDw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vIqrqu1OPuInl0FhzTUg7g.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*UAYhAVLGvvTMLUEh0jbtpQ.png" /><figcaption>Very early (2013) wireframes and sketches for the Online Score about “No Time To Fly” by Deborah Hay.</figcaption></figure><p>The first results to be published originated from the work with Deborah Hay on her solo “No Time To Fly” between 2010 and 2012. Initially, in 2013, we were working on a classic page-based website to publish these. Prototyping it we ran into a very interesting problem. The highly interconnected information around the many recordings of the solo made it difficult to come up with a reasonable way for uninformed users to navigate that information space.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*M7pSMPz7XLD7vTz5ExNBBw.png" /><figcaption>Trying to figure out how to handle diverse materials and ways of looking at them.</figcaption></figure><p>There were the aspects of the recordings and how to visualise them, the piece and Deborah Hay’s overall pool of work and choreographic practice. The recordings to be published consisted of 21 solos performed by three different dancers and recorded with multiple camera angles and sound. In addition there was more data: 3D traces and annotations for each of the recordings. The information around the piece consisted of its history, structure, and additional documents like the underlying score booklet. Also, we expected people to arrive at the site with different perspectives. Some might have a relation to dance others might arrive with an interest in data or its visualisation. After multiple iterations, we arrived at the idea of letting the material itself become the means to navigate all these aspects. Everybody seemed fine to play a video online, so why not structure the other information around that?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EPD83gEfk8dyJ8SpNzwl6w.png" /><figcaption>Thinking about our data as being time based. 2013 concept illustration.</figcaption></figure><p>With time-based annotations (done in Piecemaker) at hand which link to most of the other aforementioned aspects, we were able to put this connection at the heart of the navigation mechanism. Choosing and playing videos would change other content of the page to display the corresponding bits of information or adapt form and visualisations. We instantly liked the outcome as it felt very intuitive to navigate content like this, and it also emphasised the depth of information embedded in something as “simple” as a video of a performance. Clicking annotations or changing interactive visualisations would make the videos and other content catch up and hence connected the many dimensions (time, space, data) in a natural way. This is why we originally referred to MoSys as a <em>choreographic publishing system.</em> The choreography became the structuring element. The possibility to define and use interaction between page elements transformed compiling these pages into a task of organising and structuring … which can be a way of working choreographically.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*n1wX66f6BwhwYPa8izatKA.png" /><figcaption>Screenshot of “Using The Sky“, the Online Score about “No Time To Fly“ by Deborah Hay (released 2013, MoSys v2).</figcaption></figure><p>Another early thought guided our design decisions for MoSys. Addressing two very different audiences we were worried that emphasising either one perspective, “documentation” or “data”, might drive the other away. Putting the performances at front might make “data people” feel lost looking for visualisations and how to access and work with the captured information. Putting that quantitative and also technical perspective at front, on the other hand, would not invite a dance-oriented audience to explore the results we wanted to give access to. Looking at this problem we came up with the picture of an <strong>exhibition space with two entrances:</strong> one that would allow visitors to start from the performance and be guided to other forms of looking at and thinking about what they’ve seen. Another entrance on the opposite side would start from the data. From there it guides the audience to arrive at the performances making the underlying artistic work visible to them. This thinking led to the later layout of the MoSys pages (we call them grids) as a horizontally scrolling arrangement of elements, giving the impression of following along with the walls of an exhibition space.</p><h3>Versions: v1, v2, v3</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*zNRJE9KtV_mRy7EEpdBAoQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*eZ7yovSG2BTuGD4M7n_c_A.png" /><figcaption>Screenshots of the MoSys v1 front end (2012–2013), an internal development version.</figcaption></figure><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F122409987%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F122409987%2F222a9020e9&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F511355507_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1280" height="720" frameborder="0" scrolling="no"><a href="https://medium.com/media/561c531ef12e3cfa5f345e0a54181882/href">https://medium.com/media/561c531ef12e3cfa5f345e0a54181882/href</a></iframe><p>MoSys, similar to Piecemaker, has gone through three main iterations. An early version (v1, 2012) was developed by the Frankfurt score team, a first release was crafted at <a href="https://meso.design/en">Meso</a> and later continued by Motion Bank (v2, 2013–2017) and a third version (v3) was created by the current <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">team at Hochschule Mainz</a>. This last version is now part of the public <a href="https://app.motionbank.org/">Motion Bank system</a> and under constant development since early 2018. It is a full re-write as we decided to streamline and synchronise our technology stack. Since version 2, the system has been open source and based on a decoupled website paradigm meaning that the back end (database, application) and front end (public site, editor) are connected through an application interface (API) delivering only the data, but not the actual views.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FTMT3jNFBSWk%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DTMT3jNFBSWk&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FTMT3jNFBSWk%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/5300d10e5b848b10d9bbf71f8fbe2f60/href">https://medium.com/media/5300d10e5b848b10d9bbf71f8fbe2f60/href</a></iframe><h3>Core concepts</h3><p>The focus and space of this article do not provide enough room for a full-length documentation which we offer on our <a href="https://tutorials.motionbank.org/#/mosys/grids/3097c10c-e385-4465-bfea-f1b5330b71d0">tutorials site</a> already. The following description of how MoSys works is to introduce the terms and core functionalities so that you can understand what you are reading and seeing in this article.</p><p>There are two “content types” that make up a MoSys publication: cells and grids. The <strong>cell </strong>is a lightweight container or wrapper for all kinds of page contents like text, titles, video, images, animated or interactive content, etc. The idea is that diverse data sources can be attached to a MoSys installation and these provide the actual contents. The Piecemaker instance running side-by-side in our system is already set up to do this and it is easy to pick a video or annotations from there to use as cells. Video hosting platforms like YouTube or Vimeo can be used to provide additional video sources. Specific installations like the one at the Pina Bausch Archive can also make use of their private data collection. This openness for almost any kind of source allows the possibility for your own local data sets to be connected and grow into a rich network of information. It places local knowledge back into the broad fields of knowledge (and anything else) available on the internet.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4rsIHceRqb8gnJ_UARicHw.png" /><figcaption>Concept of grids, cells, and referenced materials. From a 2016 internal paper.</figcaption></figure><p>A cell can be placed into a <strong>grid</strong> which is a horizontally expanding “page” with a flexible row and column setting. Within a grid, the cells can be placed, moved around, and expanded to consume more than one grid field. This forms a very flexible layout system.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F8TR7ii_QpTk%3Fstart%3D167%26feature%3Doembed%26start%3D167&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D8TR7ii_QpTk&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F8TR7ii_QpTk%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/f41fba9a742662dbcf88487bfdbbe64d/href">https://medium.com/media/f41fba9a742662dbcf88487bfdbbe64d/href</a></iframe><p>Another aspect of the horizontal grid layout is that by navigating through it with a sliding (browser) window one wanders through the contents as if reading a book or strolling through a gallery. There is a beginning and an end and a story that builds up. The cropped (browser) view allows one to focus on small knowledge fragments, sometimes inviting the user to spend more time at a single “location” and explore. The horizontal scrolling has been critiqued quite often, but we still opted for it because it felt more natural to explore unknown terrain along this axis following the picture of turning your head sideways to look around.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kP-Fs3CAHwVuFn5mi70UoQ.png" /></figure><p>Underneath the grids lives a <strong>messaging service</strong> that allows cells to communicate with each other. Similar to performers on stage they can give or respond to cues or adapt to other information that is being passed around, like the current time of a video that is playing or information from an annotation like who the performers are or what scene is visible. This layer allows for both simple interactions and the creation of quite complex constellations.</p><p>Being based on web technology it is easy to also use many other formats as cell contents. One could add a map or 3D viewer or even make their own cell content using &lt;iframe&gt;s. We have done that for some of our interactive visualisation cells or even to allow things like commenting and feedback inside a grid. Title cells can act as hyperlinks between the grids and allow for navigation and information organisation. Often we create an opening grid with introduction texts and links to other (sub-) grids with more extended views. A classic tree-like website structure.</p><p>With the most recent version from mid-2020, we added a way to collaboratively work on and share grids. This was long-planned for and then finished and published as we opened our systems for educational and professional use as <a href="https://medium.com/motion-bank/motion-bank-web-systems-now-offer-collaboration-and-sharing-4a411e742d0">a reaction to the COVID-pandemic</a>. Not only can you now co-edit grids it also became possible to export a set of grids as a self-contained website package that can easily be hosted on almost any server.</p><p>On an even more technical side, the cells are spatial annotations (position and also size) onto a grid. They follow the <a href="https://www.w3.org/TR/annotation-model/">W3C Web Annotation Data Model</a> standard (as do our Piecemaker annotations) and, being linked data, are easy to export and work with in other archival contexts.</p><h3>Using and exploring MoSys</h3><p>Working on our initial Online Scores, as described above, we soon discussed what MoSys would also allow us to do. One thing that came up early was realising that we started to use it to collect contents as a starting point to think about them, often without really knowing why exactly they had to sit next to each other on a grid. MoSys became a sort of <strong>moodboard</strong> for conceptional bits and pieces and once further refined these grids often were used to share and discuss these ideas internally. This also turned out to be a good way of discussing perspectives with the artists involved to get feedback.</p><p>With our original Online Score, we were exploring different forms of putting things together. Some grids came out being structured in a very light and open way, others ended up being very dense with cells covering almost all of the grid surface.</p><p>One interesting use case for MoSys traces back to our first public presentation of Motion Bank results <a href="http://motionbank.org/en/event/tanzkongress-deborah-hay-beta-release-workshops.html">at Tanzkongress Düsseldorf in 2013</a>. Back then, we set up an interactive installation in the central meeting space consisting of two iMacs running the very first version of MoSys. On view were interview snippets, recordings, visualisations, and text fragments from the work with Deborah Hay. Visitors were able to start anywhere in the layout of materials, and the grid was set up to then navigate and play automatically through all kinds of fragments forming a storyline. This allowed for both an explorative approach to the content but also to join a sort of playlist and simply follow along and observe. In a way this opened our perspective up for not only looking at MoSys as a publishing tool where editors would prepare content and users would consume it but also as a <strong>knowledge terminal</strong> that would enable browsing and exploring of diverse materials.</p><p>Some grids we built tell stories similar to an article (<a href="http://scores.motionbank.org/dh/#/set/introduction-to-concepts">see here</a>), some are tutorials or presentations, others are just collections of data (<a href="http://scores.motionbank.org/jbmf/#/set/jonathan-burrows-single-movements">see here</a>). Yet again others are like stages and have a life of their own (<a href="http://scores.motionbank.org/jbmf/#/set/ping-pong-ping-pong">see here</a>). The format has proven that it is flexible enough to be used for all kinds of applications around and for our partner’s communication needs.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F80662449%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F80662449&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Fvideo%2F456641761_1280.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1280" height="720" frameborder="0" scrolling="no"><a href="https://medium.com/media/05f3a13994803b87c87722322c5a1e8b/href">https://medium.com/media/05f3a13994803b87c87722322c5a1e8b/href</a></iframe><p>After publishing our first round of Online Scores and finishing up phase one (2013/2014) the MoSys part of our (then still separate) systems was further used and developed only in specific projects.</p><p>In 2014/2015 we organised two <strong>“System Hackathons”</strong>, hosted at h_da – Hochschule Darmstadt (Campus Dieburg) with a group of select designers and developers. The hackathons also included members of the Pina Bausch Archive which was originally <a href="https://ikum.mediencampus.h-da.de/projekt/pina-bausch-archiv/">developed at h-da</a> (Prof. Bernhard Thull and team). The one-week meetings consisted of a deep dive tour into aspects of everybody’s systems and then free time to explore, prototype and discuss new connections, ideas, and features. One thread that showed up began with a question from the Pina Bausch Archive about how to enable guest researchers to better dive in and work with the materials at their location in Wuppertal. The idea of a <strong>workstation</strong>, based on MoSys, that would not only give access to the data collection but would also allow for easy grouping of materials under their research questions came up. This nicely linked back to our experience with the 2013 installation in Düsseldorf as discussed above. To explore the idea of a workspace we later set up a cooperation with the archive and built a prototype that was attached to their immense linked data store and had specialised cells for selecting and showing their different data types and contents.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*UC_NGhQHCJzlatmgzpX9GQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5rBmps6Rz0HFiyK7UFIDOw.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*q0z5UD2cQtU7iguX5pEdAg.png" /><figcaption>Prototype of MoSys v3 (2018) with the Pina Bausch Archive database attached and specific cells to show their content types (costumes, places, …, photos)</figcaption></figure><p>Working on this we realised that this use case would also allow for knowledge institutions to gain a better understanding of how their data is actually being used. And in addition, the connections made by guests might create completely new and unforeseen connections in the data set. This became the basis of a totally new perspective, “multimodal annotation”, which we will address in a later section of this article.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*C9LuO6YWtxr6BO0wQwdv0A.png" /><figcaption>From an internal 2016 concept paper: grids as graph representation of linked data and including external references.</figcaption></figure><p>Since its beginning in 2010 Motion Bank was set up to also include perspectives on dance education. When we started to work on MoSys and seeing it being used we felt that it might well suit some needs of dance education: transmission of implicit knowledge and reflection on bodily practice, process and performance. In 2016/2017 we got invited to join the <a href="https://dopodo.eu/">“Dance On, Pass On, Dream On”</a> (DoPoDo) Creative Europe project which became the perfect setting to further explore these ideas. Motion Bank&#39;s role in the project was to work on an “Online Toolbox” to bring together, make visible and available what all the partners were working on. On the education side project partner <a href="https://www.codarts.nl/en/">Codarts Rotterdam</a> was working on multiple aspects: transmission of knowledge of senior teaching staff to future generations, process and method documentation of dance therapy sessions, supporting students&#39; personal progress through self-reflection and feedback and monitoring and support of health assessments. This gave us a broad basis to put both Piecemaker and MoSys to use, and it was in the realm of this project that we rewrote and united the two tools into the current Motion Bank system. In regards to MoSys, the most interesting results for us were seeing it being used as a publication format for final projects in the master&#39;s program, working on ideas of automatic and personalised grid generation based on health assessments and prototyping feedback cells that allowed in-grid collaboration on the user level (vs. in the editor-system level).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qCgU9o84D20b_DPO4Qo8Jw.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EnN8Ap99_ZeN8-_tlD2E0Q.jpeg" /><figcaption>Working at Codarts Rotterdam with the very first release of MoSys v3 (2018). Commenting in MoSys (left), live annotation with Piecemaker in the studio (right).</figcaption></figure><p>Following up on the discussions about a workstation with the Pina Bausch Archive, we came to the conclusion that MoSys could be used in the context of exhibitions as exploration terminals and also to plan and even steer whole <strong>interactive installations and rooms</strong>. This idea came to realisation in the <a href="https://www.kulturstiftung-des-bundes.de/de/projekte/buehne_und_bewegung/detail/between_us.html">“Between Us”</a> project and exhibition that we worked on with the Staatstheater Mainz and Kunsthalle Mainz between 2018 – 2020. There, the question of exchange between artistic disciplines was at the heart of the collaboration, and the Motion Bank system was used to both collect data (Piecemaker) but also to communicate the process and give visitors to the exhibition the means to explore it more deeply (MoSys). One dedicated room of the exhibition at the Kunsthalle Mainz was set up as a physical MoSys grid with interactive components and four workstations that could be used by visitors to dig into and further explore the collected materials. It was great to see some visitors spending up to an hour just with these stations.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qki25mj8FM_Wq0kBatA95w.jpeg" /><figcaption>Motion Bank documentation room of <a href="https://www.kunsthalle-mainz.de/de/exhibitions/archive/16">“Between Us”</a> at Kunsthalle Mainz, 2019. Photo: Norbert Miguletz / Kunsthalle Mainz</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yvWo77fQdpyFZ89BzYWfRg.jpeg" /><figcaption>ŻfinMalta Studios. Rosemary Lee and the company performers in the background. Jan. 2020. Photo: Scott deLahunta</figcaption></figure><p>In 2020 we were seeing new Online Scores being released in parts stemming from the opening of our systems as reaction to the pandemic, but also as part of our own internal research. In September 2020, we published a “behind the scenes” look at the process of creating Threaded Fine, a 5 hour durational work by the choreographer Rosemary Lee. Commissioned by <a href="https://www.zfinmalta.org/">ŻfinMalta</a>, Malta’s National Dance Company, the creation of Threaded Fine took place in January 2020 and involved the development of 23 separate solos by 10 members of the dance company and a cast of 13 other performers. The <a href="https://threadedfine.motionbank.org/#/">Online Score</a> has recordings of the full performance, offers insights into how the solos were learned and practiced and includes a selection of interviews with the performers sharing their experience. This project shows the potential for an in-depth study of choreographic processes to be conducted by a single researcher equipped with a video camera, tripod, wireless microphone and computer running our systems.</p><p>Since the beginning of MoSys we’ve been curious about how it might be used by other researchers to study the published materials. To better understand this we invited media &amp; performance scholar Danae Kleida to revisit our Online Score “Seven Duets” (2013) about the work of Jonathan Burrows and Matteo Fargion. In the article “<a href="https://doi.org/10.1080/14794713.2021.1880182">Entering a dance performance through multimodal annotation: annotating with scores</a>” (International Journal of Performance Arts and Digital Media, Special Issue 2021: “Digital Annotation and the Understanding of Bodily Practices”) she reports on how she went from arriving at the joint work of choreographer Burrows and musician Fargion with almost no prior knowledge to studying their work through the publication and bringing that together in her own Online Score.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qe65kaio76386XxqV7-dRQ.png" /><figcaption>The grid structure of “Patterns &amp; Pulse” from <a href="http://scores.motionbank.org/jbmf/#/set/patterns-and-pulse">“Seven Duets”</a> (Burrows &amp; Fargion) with spatially derived graph data overlayed. <a href="https://observablehq.com/@fjenett/cells-grids-and-dance">Live version here</a>.</figcaption></figure><h3>Multimodal Annotation</h3><p>As mentioned before this term refers to the aspect of creating annotations inside MoSys’ grids through placing (spatially) and hence (conceptually) relating various (local or remote) materials through cells. As Kleida puts it in her 2018 master’s thesis <a href="http://dspace.library.uu.nl/handle/1874/368577">“On the Technological Conditions of Representation of Movement”</a>:</p><blockquote>What makes the MoSys presentation system so distinct is that it allows more than just a text-centric examination. In fact, through MoSys it is possible to annotate dance with images, sounds, links, videos, additional dance videos, other grids, and so forth.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*lrs2U1BR4SBMw56nZ6KTbA.png" /><figcaption>A MoSys Online Score as graph. (S) score is at the center, (G) grids, (C) cells and referenced content. <a href="https://observablehq.com/@fjenett/cells-grids-and-dance">Explore live version here</a>.</figcaption></figure><p>This is a very interesting and fruitful perspective for us as it extends our current research in the methodology and application of text-based annotation (mainly through Piecemaker). On one hand, it links into current pop-cultural “annotation practices” like responding with emojis or gif animations. Looking at it more generally it makes use of the idea that data points (materials) themselves can become means of expression through the contextual relationships they are placed into. And in reverse also become a kind of taxonomy. This is also very common in research, just consider the listings of citations that a specific paper has received. On the other hand, multimodal annotation also dips into functionalities like making audio-notes in WhatsApp or similar chat software. This is interesting because of two aspects: the media form that is chosen for what type of message and also the ease of use that comes with voice recording. Just consider the difference between placing a person cell (linking to an artist for example) into a grid versus having to manually add a profile entry with name, picture, title, link, etc. The outcome might visually be similar, but besides the extra work invested also only provides very loose connections to other grids or external instances of that person being mentioned.</p><h3>Next Steps</h3><p>We have a long and curated list of feature requests and ideas that we would like to explore in the future. Systematising the attaching of data sources, being able to customise cells, or even add new types, easy configuration of the messaging system… to name just a few. Of course, there are also some bugs that need to get squashed.</p><p>During the last months, while everybody is working from home, we all have seen the rising demand for tools that help foster exchange. Most of the tools that we’ve seen being used – and some we tested – seem to fall in the categories of communication (chats, whiteboards, etc.), organisation (to-do lists, mind-maps, etc.) or collecting (image boards, link lists, cloud storage, etc.). But only few seem to focus on exchange around bodily practice, performative process or ephemeral content and this is why we <a href="https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93">opened up our systems</a> last year. We are seeing a growing user group apply Piecemaker for reflection and feedback and it makes us wonder how more of this can be translated into MoSys especially in regards to being able to respond/exchange through other means than just text. This raises not only questions about types of content that can be added but also how connections between cells in the grids can be made and made visible. This is why multimodal annotation will be a future field of exploration.</p><p>Another field will be to look into how to capture and handle the state that describes the annotators perspective extending the aspect of time based annotations. The Piecemaker user interface now has an experimental 3D viewer as alternative to the video player. It allows to not only navigate time but also change the camera perspective. This raises the question of how to deal with the additional information of zoom level and point of view in annotations. These specific conditions might be important for understanding the annotation.</p><p>Motion Bank is fortunate to just have received funding from the ministry of science, education and culture (MWWK) of the state of Rhineland-Palatinate to work for 18 months (2021–2022) on making its system more mobile-friendly responding to needs that arise from remote collaboration in the body-based practices. In #cotanz, we will also work on integrating AI machine learning to support referencing and interaction in dedicated mobile interfaces for use during dance practice and in parallel to performing or in performance-observer scenarios. This also sheds new light on MoSys not only in terms of mobile-friendliness but also in terms of how to deal with these new forms of relations in regards to representation and interaction.</p><h3>Online Scores</h3><p>Here is a list of all Online Scores that we are currently aware of:</p><p>2009 _ <a href="https://synchronousobjects.osu.edu/">Synchronous Objects</a> / William Forsythe: “One Flat Thing, Reproduced” _ Palazzi, Zuniga Shaw / Ohio State University</p><p>2013 _ <a href="http://scores.motionbank.org/dh/">Using The Sky</a> / Deborah Hay: “No Time To Fly” _ Motion Bank</p><p>2013 _ <a href="http://scores.motionbank.org/jbmf/">Seven Duets</a> / Jonathan Burrows &amp; Matteo Fargion _ Motion Bank</p><p>2013 _ <a href="http://scores.motionbank.org/two/">TWO</a> / Bebe Miller, Thomas Hauert _ OSU / Motion Bank</p><p>2018 _ <a href="https://dopodo.motionbank.org/">Online Toolbox</a> / Martin Nachbar, Jan Martens, CODARTS _ Motion Bank</p><p>2019 _ <a href="http://lab.motionbank.org/amos60/">OFFprojects</a> / Amos Ben-Tal _ Suzan Tunca / ICK Amsterdam</p><p>2019 _ <a href="http://www.sdela.dds.nl/motionbank/brazillab2019/">Motion Bank Lab Brazil</a> _ Scott deLahunta / Motion Bank</p><p>2019 _ <a href="https://betweenus.motionbank.org/">Between Us</a> / Taneli Törmä: “Effect” _ Motion Bank</p><p>2020 _ <a href="http://lab.motionbank.org/somatic-sauce/">Somatic Sauce</a> _ <a href="https://ameliauzategui.com/">Amelia Uzategui Bonilla</a> / Dance educator, researcher, alumni MA Contemporary Dance Education at Frankfurt University of Music and Performing Arts</p><p>2020 _ <a href="https://tutorials.motionbank.org/">Motion Bank System tutorials</a> _ David Rittershaus / Motion Bank</p><p>2020 _ <a href="https://threadedfine.motionbank.org/">Threaded Fine</a> _ Scott deLahunta / Motion Bank</p><p>2020 _ <a href="http://scores.motionbank.org/jbmf-annotating-with-scores/">Seven Duets, Revisited</a> / Jonathan Burrows &amp; Matteo Fargion _ Danae Kleida / Motion Bank</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=92d2fa284230" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/dance-cells-and-grids-the-story-of-mosys-92d2fa284230">Dance, Cells and Grids—The Story of MoSys</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Choreographic Coding Lab Format by Motion Bank]]></title>
            <link>https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/61d34fe28e82</guid>
            <category><![CDATA[motion-bank]]></category>
            <category><![CDATA[interdisciplinary]]></category>
            <category><![CDATA[contemporary-dance]]></category>
            <category><![CDATA[coding-lab]]></category>
            <category><![CDATA[creative-coding]]></category>
            <dc:creator><![CDATA[Danae Kleida]]></dc:creator>
            <pubDate>Thu, 07 Jan 2021 13:14:11 GMT</pubDate>
            <atom:updated>2021-01-07T13:58:14.119Z</atom:updated>
            <content:encoded><![CDATA[<h4>The CCL format invites ‘codes savvy’ artists interested in movement material to engage with dance data in five-day intensive labs.</h4><p>Following 12 unique CCL editions since 2013, we thought it is time to trace out the trajectory of our Choreographic Coding Lab format.</p><h3>The Format</h3><p>The Choreographic Coding Lab is an international traveling format offering ‘code savvy’ artists the opportunity to translate aspects of choreography and dance into digital form and apply choreographic thinking to their own practice. CCLs are five-day intensive labs bringing together a selected group of creative coders and choreography experts to work on experiments, prototypes, projects, and ideas relating to technology and the moving body. Taking place in an intimate interdisciplinary peer-to-peer setting, CCLs invite participants to work together, share knowledge, and find new collaborative modes of working.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F282848211%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F282848211&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F716992631_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1280" height="720" frameborder="0" scrolling="no"><a href="https://medium.com/media/a842fa2d7aa613846f4b768f59589cde/href">https://medium.com/media/a842fa2d7aa613846f4b768f59589cde/href</a></iframe><h3>The Story</h3><p>Since 2013, the <em>Choreographic Coding Lab</em> (CCL) format has been hosted in Frankfurt, Berlin, Melbourne, New York, Los Angeles, Auckland, Belo Horizonte, <a href="https://medium.com/motion-bank/choreographic-coding-lab-8-in-amsterdam-c71c4052166e">Amsterdam</a>, Bratislava, and of course in Motion Bank’s new home base in <a href="https://medium.com/motion-bank/between-us-choreographic-coding-labs-a9e43126040f">Mainz</a>. The CCL format was launched during the initial phase of the <a href="http://motionbank.org/">Motion Bank </a>(2010–2014), a research project initiated by <a href="https://www.dresdenfrankfurtdancecompany.com/de/home/">The Forsythe Company</a> researching and developing methods and tools for the documentation and transmission of knowledge inherent in contemporary dance. Since 2016, <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank is based</a> at Hochschule Mainz — University of Applied Sciences.</p><p>The format of the Choreographic Coding Lab was conceived by members of the Motion Bank team while working on their first <a href="http://scores.motionbank.org/dh/#/set/sets">Online Score</a> project “<a href="http://motionbank.org/en/content/deborah-hay.html">Using the Sky (2013)</a>” with guest choreographer Debora Hay. As they recall,</p><blockquote>“[…] through working so closely with the [Debora Hay / No Time To Fly] dataset we gained a deep understanding of choreographic thinking and knowledge that we were not able to get from other materials … even seeing the performances themselves. That inspired us to offer this experience to other people of our community” — Florian Jenett, co-director of Motion Bank</blockquote><p>The first-ever CCL took place between 26–29 November 2013 in Frankfurt at <a href="https://id-frankfurt.com/z/">Z Zentrum</a> alongside the final release of the first round of <a href="http://scores.motionbank.org/">Online Scores</a>. During this very first CCL, 25 artists with a wide spectrum of artistic backgrounds ranging from creative coding, visual &amp; media arts, to filmmaking, music, architecture &amp; choreography took part in the lab. After an initial orientation, the group began working on different themes such as the choreographic language of code, choreographic video composition, collaborative analysis of dance, and so forth. See <a href="http://motionbank.org/en/event/choreographic-coding-lab-motion-bank-report.html">project documentation here</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*F748Or4_8fqyDMiTqD5SAQ.jpeg" /><figcaption>Participants of CCL 1 working at Z-Zentrum during <a href="http://motionbank.org/en/event/live-online-2013-report.html">LOL 2013</a>, Frankfurt. Photo Jeanne Vogt / Motion Bank.</figcaption></figure><p>Following the success of this 1st CCL edition, a <a href="http://choreographiccoding.org/">series of labs</a> was launched.</p><blockquote>2013: Frankfurt, 2014: Berlin, 2015: Melbourne, (Frankfurt), New York, Los Angeles, 2016: Auckland, Belo Horizonte, 2017: Amsterdam, (Nairobi), 2018: Bratislava, Mainz, 2019: Mainz, Amsterdam</blockquote><h3>At its Core</h3><p>CCLs were envisioned as invitations to creative coders interested in movement, to work with dance data and attain a deeper understanding of contemporary dance-making practices. In other words, CCLs are conceived as opportunities for coders to work together in ways that allow them to exchange knowledge quickly while gaining insights into choreographic thinking &amp; practices that could eventually enhance their creative work. What we wish to suggest with this format is an innovative synergy between the creative coding community and the world of contemporary dance-making. By creating the CCL format we envision a space that makes choreographic ideas and practices available for study by other disciplines and at the same time aims at open-source sharing of expertise, tools, and techniques.</p><h3>Lab Environment</h3><p>What makes the CCL format unique are these ingredients: the people, the location, the input sessions, and the datasets. The combination of lab facilitators, special guests, data, and working atmosphere is what provides the lab with an especially inspiring environment for knowledge exchange between the domains of coding and dance-making.</p><p>One essential CCL element is the hosting team which provides each different lab with expert knowledge in a wide variety of subjects such as creative coding, VR, choreography, contemporary dance and performance, data visualisation, annotation, and others. For each unique CCL edition, a different group of people and partners team up and work together. CCL teams composed of Motion Bank members and invited guests are crucial also for the specificity that surrounds each individual lab edition. That is to say, each team member depending on the knowledge, research, and projects they bring with them contributes to the specificity of each different CCL.</p><p>Equally important for us is the working environment we create with the CCL format. By organising CCLs, we aim at creating a peer-to-peer, intimate but also intensive environment for people to work together. That means that with CCLs we do not aim at hosting a sort of a hackathon environment; we are not asking lab participants to produce specific products, projects, or prototypes. Instead, we envision CCLs as places that can spark creative vibrations between the domains of creative coding and dance/choreography. We see them more as invites to these two creative domains to study one another and find overlaps that were not visible before.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5EwjCL-Xa738lLSyY7rOOg.jpeg" /><figcaption>Discussing Gaga-Technique during CCL 4, NYC. Photo Motion Bank.</figcaption></figure><h3><strong>Input Sessions</strong></h3><p>To stimulate the transmission of knowledge and practices between the domains of coding and choreography, CCLs invite special guests to join the lab and share their knowledge on a wide variety of subjects. These ‘Input Sessions’ as we call them, are short presentations or workshops given by special guests that can cover a wide range of input such as creative practices, choreographic thinking, insight into specific modes of artistic practice, or even code-based making processes in relation to dance, movement, and the body. Invited guests stem from a vast range of fields: research, dance practice, art, design, code-based disciplines, music, humanities, etc.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*k9yyjR3_ckCI9FEzaWuLRg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dtJDSOvBuhVkkukGXYm0hA.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*0JM1t80qeWDu_Jie3HXFJw.jpeg" /><figcaption>Input sessions by Laurel Tentindo, Ros Warby at CCL 5 (2015) and Elizabeth Waterhouse during CCL 2 (2014). Photos Motion Bank.</figcaption></figure><blockquote>Most special to the CCL format are the specific ‘Choreographic Thinking’ input sessions. That is because “making choreographic ideas and processes available for study by other research domains was one of the aims of Motion Bank from its very beginning” — <a href="https://www.uu.nl/staff/MABleeker">Maike Bleeker</a> (Transmission in Motion)</blockquote><p>With the creation of the CCL format, the Choreographic Thinking input sessions were introduced as opportunities for direct exchange of choreographic practices and processes by highly experienced choreographers, dancers, performers, etc. By being introduced to choreographic thinking, creative coders can grasp a deeper understanding of what dance knowledge is, how it can be transmitted, and how they can eventually work with dance data. Our intention by introducing the ‘Choreographic Thinking Input Sessions’ is to engage the two different artistic disciplines to find common grounds and eventually work together.</p><blockquote>During CCLs, Choreographic Thinking Input has been given by Elizabeth Waterhouse, Howard Katz, Marlon Barrios Solano, Prue Lang, Sandra Parker, Steph Hutchison, Jon Kinzel, Silas Riener, Wally Cardona, Ros Warby, Ann Carlson, Laurel Tentindo, Adriana Banana, Dudude Herrmann, Rodrigo Pederneiras, Andrea Božić, Eric Minh Cuong Castaing, Arno Schuitemaker, Suzan Tunca, and many many others.</blockquote><h3>Data &amp; Tools</h3><p>At each CCL edition, we want to offer one specific piece, idea, or dataset to work with. During all the different editions this has happened in diverse ways.</p><p>Early CCLs were more engaged with creating and interacting with dance data material by capturing dance movement through Kinect sensors or similar means. Some labs were even organised to have direct access to motion capture facilities.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*RJnvE5sY8w1LV0B5XymdfQ.jpeg" /><figcaption>Working with motion capture (Vicom) at NYU (Magnet) linked to Unity during CCL 4, 2015.</figcaption></figure><p>Other times data sets were provided from well-documented dance choreographies and linked to the aforementioned Input Sessions. Most data sets provided by Motion Bank also contain rich annotations unlocking insights and providing a language for the specific piece or performance. The most recent example of a <a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">very advanced dataset </a>we have provided is from the “Effect” choreography.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1TnXhp-2qzZXj-YMcmTFIA.jpeg" /><figcaption>“Effect” by <a href="https://www.tanelitorma.com/en">Taneli Törmä</a> performed at <a href="https://www.kunsthalle-mainz.de/de/exhibitions/archive/16">Kunsthalle Mainz</a> by <a href="https://www.staatstheater-mainz.com/web/home_tanzmainz">tanzmainz</a> as part of <a href="https://betweenus.motionbank.org/">Between Us</a>, 2019. Photo by Andreas Etter / Staatstheater Mainz.</figcaption></figure><p>As part of the “Between Us” project, the Motion Bank team captured a unique data set about the dance piece “Effect” by Finnish choreographer Taneli Törmä. The package contains most of the six weeks of the rehearsal process in form of videos with annotations. A final version was then captured as full 60-minute motion capture recording with additional eight HD video perspectives and 4-channel sound. The package is rounded up by interviews and insights collected from the choreographer, dancers, artists and other participants of the project. To make studying and exploring the movement data easier we created a dedicated <a href="https://data.motionbank.org/">data player</a>. The player contains the data and allows you to playback and stream it on your own computer using the OSC and WebSocket protocols for easy access through a language and framework such as Processing, P5, OpenFrameworks, VVVV, …</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VqnKtK7rLuzc5oVU-oM7lA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/828/1*f9XxxszCQ0RbAjayNagqLw.png" /><figcaption>Screenshot Effect Data Player and schema of motion capture data. <a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">More here.</a></figcaption></figure><h3>Different Versions — Different Takes on CCL</h3><p>As the founding organisation of the CCL format, Motion Bank guides different partners, institutions, and organisations such as <a href="https://tisch.nyu.edu/itp">ITP@NYU</a>, <a href="https://www.fiber-space.nl/">FIBER</a>, and <a href="https://www.sensorium.is/">Sensorium </a>to realise their own CCL editions. CCLs can be curated in diverse ways. Some might be very specific and focussed on one piece like the Between Us CCLs. Others can also have an open and more exploratory disposition that is more attentive to local communities, like CCL Belo Horizonte in 2016 which was co-organised with Thembi Rosa Leste.</p><p>Also, CCLs like Amsterdam 2019 can encourage the exploration of specific research questions. During that CCL, the lab paid extra attention to two areas of interest: ‘Reimagining Dance Data in Space’ and ‘Dancing with Machines: Experiments with machine learning in the context of dance, choreography and movement.’</p><p>Sometimes the CCL format takes slightly different forms depending on the context of its organisation. As for now, we have experimented with the CC-Workshop (<a href="https://nodeforum.org/activities/festival/node15/">NODE Festival 2015</a>) and CC-Production-Lab (<a href="https://nodeforum.org/announcements/choreographic-coding-production-lab-in-nairobi/">Nairobi 2017</a>) sub-formats.</p><h3>Participation, Costs &amp; Fees</h3><p>CCLs are being paid for by the participants with a very special currency. We are not asking for any fee but want participants to invest five days of their precious time and attention. We feel that this removes certain expectations from the labs like being taught about a special technology and opens up for a more sharing and experience-oriented mindset. This is also why we are guarding access to the labs with an application process that helps us understand who might arrive but also asks participants to formulate their expectations and what they might bring to the labs.</p><p>There will be costs. Participants have to make travels, pay for their accommodation and food. To minimize these costs we often try to curate the participant group to originate from a more local community. We are not offering residencies but sometimes participants had success with raising funding through various other sources and we are happy to help with an invitation letter if needed.</p><p>Other aspects that go into the group selection process are the level of expertise and diversity both in terms of disciplines but also personal backgrounds. On one hand, this helps to make sure people that arrive are able to work in the lab in a self-guided way (since labs are not workshops). On the other hand, we also aim to invite many different perspectives to form an interesting and diverse group.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-H6Sk89StjxLbWjmlZ1w3g.jpeg" /><figcaption>Participants and team of CCL 11 (2019), Mainz. Photo Vanessa Liebler / Motion Bank.</figcaption></figure><p>Other costs like travel and accommodation for invited artists and researchers, tech equipment and setup, etc. are covered by the hosting party. Often this happens in the realm of larger project grants or institutional funding possibilities.</p><h3>Looking Ahead</h3><p>Upcoming CCLs are already being planned for 2021 and 2023 in Germany. If you are interested in attending make sure you <a href="http://eepurl.com/cz2Vcb">sign up for our newsletter</a>.</p><p>But planning is just one side of the equation. For a while, we have been discussing what the next steps of the format could be. Our CCL “veteran” Naoto Hieda has been experimenting with a <a href="https://nodeforum.org/activities/festival/node20/program/greenhouse-naxos/choreographic-coding-lab-online/">VR edition during NODE 2020</a>. And we see related (but different) events being organised by other parties (<a href="https://group.bnpparibas/en/news/join-dansathon-collaborative-european-event-imagine-future-dance">Dansathon</a>, <a href="https://www.europeana-space.eu/hackathons/dance-hackathon/hacking-dancing-body/">Hacking the Dancing Body</a>) not affiliated with us. This is really fulfilling for us and we would love to not only see more experiments like this but also that the original CCL format is being translated into other domains … music or typography? Any takers?</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F493455033%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F493455033&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Fvideo%2F1020516579_1280.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/bb8c440aad8cf879708ea635697dd2f8/href">https://medium.com/media/bb8c440aad8cf879708ea635697dd2f8/href</a></iframe><p>For our original form of the CCL format, we are looking into how to grow the “other end”, meaning not only caring about the ins but also to support the outs. We are super happy to have been able to support/co-produce works like <a href="http://mariajudova.net/">Mária Júdová</a>’s <a href="https://www.kykeon-vr.com/">Kykeon</a> project, which originated from the two <a href="https://medium.com/motion-bank/between-us-choreographic-coding-labs-a9e43126040f">“Between Us”</a> CCLs, beyond the scope of the lab. Ideas like extended production residencies or exhibition formats are being discussed but naturally are hard to finance as Motion Bank is itself completely project funded. We have to see what the future brings.</p><p><em>Many thanks to co-author, </em><a href="https://medium.com/u/46677d1a7c61"><em>Florian Jenett</em></a></p><h3>Links</h3><p>→ <a href="http://choreographiccoding.org/">Choreographic Coding Labs</a> main website<br>→ <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank</a> (at Hochschule Mainz — University of Applied Sciences)<br>→ <a href="https://medium.com/motion-bank/choreographic-coding-lab-8-in-amsterdam-c71c4052166e">Choreographic Coding Lab #8 in Amsterdam</a> by Danae Kleida<br>→ <a href="https://medium.com/motion-bank/between-us-choreographic-coding-labs-a9e43126040f">Two Between Us (Choreographic Coding) Labs</a> by Danae Kleida<br>→ <a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">Choreographic Coding with Effect</a> by Florian Jenett</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=61d34fe28e82" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82">The Choreographic Coding Lab Format by Motion Bank</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Between Us — Choreographic Coding Labs]]></title>
            <link>https://medium.com/motion-bank/between-us-choreographic-coding-labs-a9e43126040f?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/a9e43126040f</guid>
            <category><![CDATA[dance-data]]></category>
            <category><![CDATA[vr]]></category>
            <category><![CDATA[motion-capture]]></category>
            <category><![CDATA[creative-coding]]></category>
            <dc:creator><![CDATA[Danae Kleida]]></dc:creator>
            <pubDate>Wed, 23 Dec 2020 11:44:48 GMT</pubDate>
            <atom:updated>2021-01-07T14:18:57.893Z</atom:updated>
            <content:encoded><![CDATA[<h3>Two Between Us (Choreographic Coding) Labs</h3><h4>CCL #10 (09/2018) and CCL #11 (05/2019)</h4><p><strong>TL;DR — </strong>These two CCLs (# 10 &amp; 11) happened in the context of the interdisciplinary project <a href="http://kunsthalle-mainz.de/de/exhibitions/archive/16"><em>Between Us</em></a>, a collaboration between the dance company <a href="http://www.staatstheater-mainz.com/web/home_tanzmainz">tanzmainz</a>, <a href="http://kunsthalle-mainz.de/de/">Kunsthalle Mainz</a> and <a href="http://motionbank.org/">Motion Bank</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*lSyUnAexLcVd6YjH56YfEg.png" /><figcaption>CCLab inside the <em>Between Us</em> exhibition at Kunsthalle Mainz; Photo: Vanessa Liebler</figcaption></figure><h3>Between Us</h3><p>The project <em>Between Us</em> brought together dance, fine arts, and research in order to explore questions arising from the exchange of knowledge between disciplines. The collaboration was based on a newly created dance piece named <a href="https://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz-19-20/effect"><em>Effect</em></a> by Finnish choreographer <a href="http://www.tanelitorma.com/">Taneli Törmä</a>. As part of the collaboration, the piece’s creation process at <a href="https://www.staatstheater-mainz.com/web/home_tanzmainz">tanzmainz</a> was digitally documented via video and annotation using Motion Banks systems. The finished piece was then recorded using motion capture, multi-channel sound and video, forming a uniquely complete digital data package. <em>Effect</em> and its data then served as the starting point for new works by international contemporary artists that were invited by Kunsthalle Mainz.</p><p>In the context of the<em> Between Us</em> project, Motion Bank organised two Choreographic Coding Lab editions in Mainz: <a href="http://choreographiccoding.org/labs/mainz-between-us-september-2018">CCL #10 (September 2018)</a> and <a href="http://choreographiccoding.org/labs/mainz-between-us-april-may-2019">CCL #11 (April/May 2019)</a>. These two editions framed the <em>Between Us</em> project. The first edition in 2018 was the kick-off of the creation process of Taneli Törmä’s new piece <em>Effect </em>which was at the center of <em>Between Us</em>. The lab was placed there to introduce the partners to the idea of dance data and how to explore it visually, or through other means, by offering the various perspectives of the participants on it. It also allowed the partners to learn about the ideas for the piece, its creation process, and take data samples for exploration. The second edition happened after the opening of the resulting <a href="https://www.kunsthalle-mainz.de/de/exhibitions/archive/16"><em>Between Us</em> exhibition</a> in 2019. Being able to draw from the recorded data and artistic results it allowed the participants to reflect on the results of the collaboration and suggest additional perspectives on dance data and <a href="https://betweenus.motionbank.org/#/">how to explore it</a> to the visitors of the exhibition.</p><h3>CCL #10</h3><p>CCL Mainz #10 (September 24–28, 2018) took place at Motion Bank’s <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">new home base in Mainz</a> and marked the beginning of the <em>Between Us </em>project as choreographer Taneli Törmä and dancers <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/bojana-mitrovic">Bojana Mitrović</a>, <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/amberpansters">Amber Pansters</a>, <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/milena-wiese">Milena Wiese,</a> <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/zachary-chant">Zachary Chant</a>, <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/finn-lakeberg">Finn Lakeberg</a>, &amp; <a href="http://www.staatstheater-mainz.com/web/menschen/taenzer/thomas-van-praet">Thomas van Praet</a> started working on the piece at the same time as the participants of the lab.</p><h4>Collaborating with tanzmainz</h4><p>As this CCL edition kicked-off the creation process of the contemporary dance piece <em>Effect </em>and the <em>Between Us</em> project it was curated as a moment for a more hands-on introduction among all the project partners. CCL #10 not only created the space and time for the lab participants and Motion Bank team to get to know Taneli and the dancers but also invited members of Kunsthalle Mainz and Staatstheater Mainz to visit the lab and gain a deeper understanding of Motion Bank’s research. In addition, Taneli and the dancers got to hear more about the recording sessions, the motion-captured data and also got to see possible visualisation results.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F8AgINDckbWI%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D8AgINDckbWI&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F8AgINDckbWI%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/85ca3a218802f36ac916e5774cc8b448/href">https://medium.com/media/85ca3a218802f36ac916e5774cc8b448/href</a></iframe><p>The collaboration started with Taneli’s Choreographic Thinking Input Session, during which he offered thoughts and insights into his work for the then-upcoming piece <em>Effect</em>. Following Taneli’s introduction, we attended <a href="http://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz18-19/im-orbit">a double bill</a> by the dance ensemble tanzmainz and got to know more about the Staatstheater and the dance company through a short introduction provided by <a href="http://www.staatstheater-mainz.com/web/menschen/mitarbeiter/honne-dohrmann">Honne Dohrmann</a> (director of <a href="http://www.staatstheater-mainz.com/web/home_tanzmainz">tanzmainz</a>). The next days we had our very first motion capture session with the dancers of <em>Effect</em> at the <a href="https://www.hs-mainz.de/studium/services/gestaltung/werkstaetten-kommunikationsdesign/ilab/">iLab</a> of Hochschule Mainz and following this, we had a Q&amp;A session with Taneli, the dancers, and members of tanzmainz. Questions about their rehearsal process, creative practices, and “yet-invisible” choreographic algorithms were brought up by the participants. At the same time, the Q&amp;A offered the dancers and choreographer a chance to pose their own questions about the participants’ backgrounds, interests and also aspects of recording dance and the resulting data.</p><p>During CCL Mainz #10 we visited one of tanzmainz’s dance studios and observed a full hour of rehearsal of <em>Effect</em>. Being there enabled the participants to see how a choreographic piece actually might come into being. It also gave a glimpse of the synergy between Taneli &amp; the dancers and allowed us to observe similarities in their respective creative practices.</p><p>The group was also invited to Kunsthalle Mainz to see the then current exhibition and learn about the location that the Between Us project later would be exhibited in.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*bKpjubjWxz_PSqBQgrNPGA.jpeg" /><figcaption>Visiting Kunsthalle Mainz</figcaption></figure><h4>Input Sessions &amp; workshops</h4><p>Next to Taneli’s Choreographic Thinking Input, Motion Bank invited two well-proven artists from the intersection of performance and technology to join the lab and share their artistic practices with the CCL group: <a href="http://mariajudova.net/">Mária Júdová</a> and Marc Downie (who forms <a href="http://openendedgroup.com/">Open Ended Group</a> together with Paul Kaiser). This is the first time we were able to also commission art works (more on the VR pieces further down in part 2) being started in a CCL and hence marks a next step in the evolution of the format.</p><p>Motion Bank co-director Florian Jenett gave an introduction to their research and <a href="https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93">systems</a>. More specifically, Florian traced back to the initial phases of Motion Bank, explained the trajectory of Motion Bank’s systems and provided a workshop on how to use them.</p><p>As with many CCLs, impromptu workshops popped up. During our morning rounds, participants requested and offered to have workshops &amp; presentations for subjects of common interest. For example, CCL participant <a href="https://www.uni-weimar.de/en/media/chairs/computer-science-department/human-computer-interaction/kontakte/contact-michaela-honauer/">Michaela Honauer</a> offered a hands-on introductory workshop of Arduino. Next to this, <a href="https://wwwfr.uni.lu/lcsb/people/elisabeth_guerard">Elisabeth Guerard</a> and <a href="https://www.uu.nl/staff/DKleida">Danae Kleida</a> gave a joint presentation on dance notation systems and especially <a href="https://en.wikipedia.org/wiki/Labanotation">Labanotation.</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*nvqUEIRjOjVcBbtNu-9OJg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8jInyDLILiYwXJ3j2uGNpw.jpeg" /><figcaption>Exploring Michaela Honauer’s suit</figcaption></figure><p>The first <em>Between Us </em>CCL (#10) concluded on Friday, September 28 with an open lab session during which participants presented their CCL experiments and projects. Experts, project partners, and the interested public were invited to look behind the scenes, test prototypes, and ask questions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*t-_KU7tEIpnr13Qr-oCJqA.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*w7gFOwqhRxtwCkTZ0Wm3ZQ.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Gm2jYLgRH83isKJjIeGHDA.jpeg" /><figcaption>Presentations at the Open Lab Session wrapping up CCL #10</figcaption></figure><h3><strong>CCL #11</strong></h3><h4>Working inside the “Between Us” exhibition</h4><p>CCL Mainz #11 (April 28-May 2, 2019) was the second<em> </em>lab in the context of the<em> Between Us</em> project and a special edition as it was set up inside the exhibition space of Kunsthalle Mainz. As this CCL took place right after the opening of the <em>Between Us</em> exhibition, the participants were able to enjoy the exhibition and then, explore and work with the <a href="https://data.motionbank.org/">“Effect data”,</a> annotations, interviews, and the “Effect Data Player.”</p><p>The lab started by welcoming the participants at the exhibition space of Kunsthalle Mainz. After a first round of introductions, Florian Jenett presented to the participants an overview of Motion Bank’s trajectory and introduced the current collaborative research project, <em>Between Us.</em> Following this, Florian guided the participants through the <a href="https://www.kunsthalle-mainz.de/de/exhibitions/archive/16"><em>Between Us</em> exhibition</a> and explained the thought behind Motion Bank’s contribution as exhibited in the tower of Kunsthalle Mainz. The first day concluded by watching tanzmainz performing <a href="http://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz18-19/twist">Twist</a> by Victor Quijada at Staatstheater Mainz and by having a meet &amp; greet dinner session.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*F9vkGONDKAU0XMoFMHB1lA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ryKq2zbdrB8BA8v_eKGqeQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*gz-zJh46ijGs2nt9nP1nfQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_03bz1T8-gsphtNO2xqqlQ.png" /><figcaption>Pictures from Motion Bank’s contribution the exhibition “Between Us”; Photos: Vanessa Liebler</figcaption></figure><h4>The Data</h4><p>As part of the <em>Between Us</em> project, Motion Bank captured a unique digital data set of the dance piece <a href="http://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz18-19/effect"><em>Effect</em></a>. It is so special because it contains most of the six weeks of the rehearsal process in form of videos with additional annotations. It holds a full 60-minute motion capture recording with additional eight HD video perspectives and 4-channel sound of the final version. The package is rounded up by interviews and insights collected from the choreographer, dancers, artists and other participants of the project.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Fas6oRRUUE1j763RzT8YWw.png" /><figcaption>Screenshot of the “Effect Player”</figcaption></figure><h4>Easy Access</h4><p>To make studying and exploring the movement data and related annotations easier Motion Bank created a dedicated “Effect player.” It contains the data and allows you to playback and stream it on your own computer using the OSC and WebSocket protocols for easy access. As part of the lab setting, we also brought our mobile and markerless motion capture system (the one used to record Effect) for the CCL participants to explore and even record their own data sets with.</p><p>→ <em>For details on the recording and documentation process, the movement data, and the “Effect player” see, </em><a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069"><em>Choreographic Coding with Effect</em></a></p><p>→ <em>The player and data can be downloaded here: </em><a href="http://data.motionbank.org/"><em>data.motionbank.org</em></a></p><h4>Artistic Input, Feedback &amp; Discussions</h4><p>As special input we this time invited two artists to work in the lab. <a href="http://mariajudova.net/">Mária Júdová</a> (SK) and Marc Downie (US) (<a href="http://openendedgroup.com/">Open Ended Group</a>) have been exploring issues around the body, movement &amp; space with their work. Maria and Marc were invited to join both <em>Betweens Us CCLs</em> to work with the “Effect Data” and share their expertise in interpreting motion data. This is the first time that we were able to actually include the creation of new art works as part of the CCL format. This marks a next step in the evolution of the format where we try to also enable the production of new works through commissioning.</p><p>During CCL #11, <a href="http://mariajudova.net/">Mária Júdová</a> worked with visual artist <a href="https://www.nisidis.com/">Constantine Nisidis</a> (GR) and sound artist <a href="https://ancestralvoices.bandcamp.com/">Liam Blackburn</a> (UK) (aka <em>Ancestral Voices</em>) on a new project: <a href="https://www.kykeon-vr.com/"><em>Kykeon: a virtual reality trilogy</em></a><em>.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5LAvxLx_qukMaGsyuAjClw.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*T20vZMiDym3gNxBWgGURNg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kD3FrKJX6RPXxNo4mOBihg.png" /><figcaption>Constantine Nisidis, Mária Júdová, Liam Blackburn working on Kykeon during CCL #11; Photos: Vanessa Liebler</figcaption></figure><blockquote>Kykeon is an immersive virtual reality experience exploring shamanism as a way to reimagine our current society. Inspired by an ancestral knowledge and wisdom, it invites the audience to take part in a new ritual. The VR trilogy reflects on loss of a sense of community and empathy, as well as lack of concern for others. A search for a path forward, examining tradition and the ways of the tribe. It takes ancient culture and civilization, ritualistic, folkloric practices as an inspiration, to re-examine them, and look at them as a way for us to move forward. — See <a href="https://www.kykeon-vr.com/">kykeon-vr.com</a></blockquote><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F491981980%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F491981980&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Fvideo%2F1020525651_1280.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/5e4ffd35e7c25a909b2d8f170b3592f2/href">https://medium.com/media/5e4ffd35e7c25a909b2d8f170b3592f2/href</a></iframe><p>Marc Downie worked on the creation of a new VR piece by continuing his work on the underlying question: <em>How to [not] draw a body?</em> The question of <em>how the human body can be drawn </em>is by no means new to Marc; it pervades his earlier works as part of the OpenEndedGroup including collaborations with renowned choreographers such as Merce Cunningham and Wayne McGregor. During the <em>Between Us</em> CCLs Marc worked on a VR piece around the <em>Effect </em>choreography which explored key problems of making a VR piece around a motion capture resource such as:</p><blockquote>How do you draw the human body? How do you put someone inside the dance? How do you extract from the medium?</blockquote><p>The way Marc sees it, the primary job for a new media artist is to invent, pose, explore, dramatise, and present new ways of seeing — and that is what this piece makes with dance. Marc referred to this piece as ‘dance under a microscope’ and ‘dance under a telescope’. It suggests new ways of drawing motion and movement. During the Open Lab session, Marc presented a 5 min trailer of his ~27 min piece inside the capturing area of the lab.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dW4vZuKYnKAKG-k-ozEvRg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ibDsj-t91Y5uGxNyPoXoQA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*inWI73m1cChLJmLE6kzXhQ.png" /><figcaption>Stills from Marc Downies’ VR piece</figcaption></figure><p>Next to their experiments and new works Marc, Mária, Liam, and Constantine shared with the participants their knowledge and insights on working with the data by giving two input sessions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*6x7o9ITr4Nv8yMgKZl1B7Q.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Bd3-7IlXyyf6PXkIquIIrg.png" /><figcaption>Marc Downie (left), Anton Koch &amp; Florian Jenett (right); Photos: Vanessa Liebler</figcaption></figure><p>Further input was provided by Motion Bank lead developer Anton Koch. First, Anton gave a workshop on how to navigate the “Effect data package” and the “Effect data player.” Later on, he introduced the marker-less motion capture system used by Motion Bank (see, <a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">Choreographic Coding with Effect</a>) and explained its possibilities and how the participants could use it for their experiments.</p><p>In addition, CCL participants set up their own workshops for subjects of common interest. For example, Jean-Philippe Rivière presented <a href="https://hal.inria.fr/hal-02378487/">his research</a> on “trackable qualities” &amp; “movement segmentation”, while <a href="http://alexandertrattler.com/">Alexander Trattler</a> gave a workshop on TouchDesigner. Also, <a href="https://naotohieda.com/">Naoto Hieda</a>, three-times-participant published a medium story about <a href="https://medium.com/@naoto_hieda/11th-choreographic-coding-lab-bf3e521d8894">his experience during the 11th CCL</a> to share his observations.</p><p>The second <em>Between Us</em> CCL edition concluded with an open lab session inside the Kunsthalle exhibition space. There, CCL participants and guest artists presented their experiments and prototypes to the visitors.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*IedfigMPfc24uKrkUJidBQ.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PPNk_QZ-9x5ns4_cC_cLGw.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*UrDYVBijLBB4nF_zUB6k0Q.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*el_zSI_X5Ms8S5a1SxlNfg.png" /><figcaption>Wrapping up CCL #11 with an Open Lab Session at Kunsthalle; Photos: Vanessa Liebler</figcaption></figure><h3>Looking back …</h3><p><a href="https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82">The CCL format was started in 2013</a> by Motion Bank as a way to open the knowledge and data collected around contemporary dance to an audience that is interested and also has the skills to approach these materials from an artistic perspective. For Motion Bank these two labs have been special in many ways: being the first ones to happen at our new home base Mainz, one lab being set up inside an exhibition space with extra areas to study its process and the works shown, having our motion capture system set up in the labs, offering a dedicated data player and being able to commission new works by guest artists. With the two upcoming CCLs in 2021 and 2023 we have to see how we can further explore the affordances of the format and make some of its long term impact visible.</p><p><em>Many thanks to co-author, </em><a href="https://medium.com/u/46677d1a7c61"><em>Florian Jenett</em></a></p><h3>Participants</h3><p>→ <strong>CCL #10 (2018):</strong> <a href="http://alexandertrattler.com/">Alexander Trattler</a> (DE), <a href="https://www.behance.net/celiabetouae7e">Célia Bétourné</a> (FR), Chiang ChiaYing (DE), <a href="http://clairecote7.wixsite.com/claire-cote">Claire Côté</a> (DE/US), Elisabeth Guerard (FR), Govienda Kumar (PAK/DE), <a href="http://www.isabella-roscher.com/">Isabella Roscher</a> (DE), Jean Böhm (DE), <a href="https://ex-situ.lri.fr/people/jean-philippe-riviere/">Jean-Philippe Riviere</a> (FR), <a href="/service/mailto:j.shaw@coventry.ac.uk">Jonathan Shaw</a> (UK), Louis Cortes (FR), Lukas Rudig (DE), Mark Matthes (DE), <a href="http://martinahuynh.com/">Martina Huynh</a> (NL), <a href="http://www.maxiestudies.com/">Maximiliano Estudies</a> (ARG/DE), <a href="http://www.mihoo.de/gallery/">Michaela Honauer</a> (DE), Ronja Timmer (DE), <a href="https://www.stephhutchison.com/">Steph Hutchison</a> (AU), <a href="http://www.tatjanatrynkun.com/">Tatjana Trynkun</a> (DE), <a href="http://www.timoherbst.org/">Timo Herbst</a> (DE).</p><p>→<strong> CCL #11 (2019): </strong><a href="https://vimeo.com/user22459061">Abi Price</a> (UK), <a href="http://alexandertrattler.com/">Alexander Trattler</a> (DE), Alvin Arthur (NL), <a href="https://vimeo.com/ericamott">Erica Mott</a> (US), <a href="https://www.instagram.com/k_of_r/?utm_source=ig_profile_share&amp;igshid=1ufyv9vr88lcz">Dieter Frueauff</a> (DE), Jean Böhm (DE), <a href="https://ex-situ.lri.fr/people/jean-philippe-riviere/">Jean-Philippe Riviere</a> (FR), <a href="http://www.katjarempel.de/">Katja Rempel</a> (DE), <a href="https://vimeo.com/showcase/5894066">Laura Schillke</a> (DE), Luigi Galbusera (IT), Lukas Rudig (DE), <a href="http://naotohieda.com/">Naoto Hieda</a> (JP/DE), <a href="http://www.tatjanatrynkun.com/">Tatjana Trynkun</a> (DE), <a href="https://tristanschulze.de/">Tristan Schulze</a> (DE), <a href="https://vimeo.com/sonscha">Sonja Thoms</a> (DE) <a href="https://ectoplastic.com/">Stephan Kloß</a> (DE).</p><h3>Guests</h3><p><a href="https://www.nisidis.com/">Constantine Nisidis</a> (GR), <a href="https://ancestralvoices.bandcamp.com/">Liam Blackburn</a> (UK), <a href="http://mariajudova.net/">Mária Júdová</a> (SK), <a href="http://openendedgroup.com/about.html">Marc Downie</a> (US).</p><h3><strong>Team</strong></h3><p>Anton Koch (DE), Benjamin Knichel (DE), Christian Hansen (DE), <a href="https://www.uu.nl/staff/DKleida">Danae Kleida</a> (GR), David Rittershaus (DE), Denis Klein (DE), Florian Jenett (DE), Mathias Bär (DE), Martin Schneider (DE), Moritz Jentgens (DE), Ronja Butschbacher (DE), <a href="http://www.sdela.dds.nl/">Scott deLahunta</a> (UK/US).</p><h3>Links</h3><p>→ <a href="https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82">The Choreographic Coding Lab Format by Motion Bank</a> by Danae Kleida &amp; Florian Jenett<br>→ <a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">Choreographic Coding with Effect</a> by Florian Jenett<br>→ <em>Between Us</em> <a href="https://betweenus.motionbank.org/">Online Score</a> and <a href="http://kunsthalle-mainz.de/de/exhibitions/archive/16">exhibition</a><br>→ <a href="https://medium.com/@naoto_hieda/11th-choreographic-coding-lab-bf3e521d8894">11th Choreographic Coding Lab</a> by Naoto Hieda<br>→ <a href="http://choreographiccoding.org/">Choreographic Coding Labs</a><br>→ <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank</a></p><p><em>Between Us</em> was funded by the <a href="https://www.kulturstiftung-des-bundes.de/">German Federal Cultural Foundation</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a9e43126040f" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/between-us-choreographic-coding-labs-a9e43126040f">Between Us — Choreographic Coding Labs</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Choreographic Coding Lab #8 in Amsterdam]]></title>
            <link>https://medium.com/motion-bank/choreographic-coding-lab-8-in-amsterdam-c71c4052166e?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/c71c4052166e</guid>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[creative-coding]]></category>
            <category><![CDATA[amsterdam]]></category>
            <dc:creator><![CDATA[Danae Kleida]]></dc:creator>
            <pubDate>Sat, 19 Dec 2020 13:22:06 GMT</pubDate>
            <atom:updated>2021-01-07T14:26:47.938Z</atom:updated>
            <content:encoded><![CDATA[<h4><strong>CCL Amsterdam #8, </strong>May 5–11, 2017</h4><p><strong>TL;DR — </strong>CCL Amsterdam #8 was organised within the context of the <a href="https://2017.fiberfestival.nl/">FIBER Festival 2017: Prima Materia</a> (May 11–14), by <a href="https://www.fiber-space.nl/">FIBER</a>, <a href="https://www.ickamsterdam.com/nl/">ICKAmsterdam</a>, <a href="https://www.uu.nl/en">Utrecht University</a> &amp; <a href="http://motionbank.org/">Motion Bank</a> and was hosted at <a href="https://www.brakkegrond.nl/">De Brakke Grond</a>. This CCL edition was part of <a href="https://2017.fiberfestival.nl/programme/labs/">Lab Programme</a> that happened in the framework of FIBER and created opportunities for high-level expert exchange. CCL #8 welcomed 26 participants from around the world and was combined with a public programme: an Open Lab session and the conference panel <a href="https://2017.fiberfestival.nl/programme/moving-matters/">Moving Matter(s)</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4QqDXg_i411Qv2TCuxcP0A.jpeg" /><figcaption>CCL inside the Rode Zaal, de Brakke Grond; Photo: Jeanne Charlotte-Vogt</figcaption></figure><p>Thanks to the collaboration with the international dance platform ICKAmsterdam, CCL Amsterdam #8 was enriched by input from selected choreographers who shared their practice and posed questions from the perspective of the contemporary dance field. The choreographers <a href="http://www.shonen.info/">Eric Minh Cuong Castaing</a>, <a href="https://andreabozic.com/andrea_bozic">Andrea Božić</a>, and <a href="http://www.arnoschuitemaker.com/">Arno Schuitemaker</a> participated in the lab and gave insights into their choreographic work. In addition, <a href="https://www.universiteitleiden.nl/en/staffmembers/suzan-tunca#tab-1">Suzan Tunca</a> (ICKAmsterdam) shared choreographic thinking input by <a href="https://www.ickamsterdam.com/en/about/ick">Emio Greco|P.C. Scholten.</a></p><blockquote>Read about <a href="https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82">the Choreographic Coding Lab Format</a> by Motion Bank</blockquote><h3><strong>Pre-Choreographics elements by ICKAmsterdam</strong></h3><p>The first input session for this lab was provided by Suzan Tunca (DE/NL) who gave a presentation on the system of ‘pre-choreographics’ as developed by ICKAmsterdam, which was then performed by Suzan &amp; dancers from ICKAmsterdam.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iW9J_Nca2qnDF0pMD0I2vA.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kiu_JZlTngrvbqimGEg5Ig.jpeg" /><figcaption>Suzan Tunca and dancers from ICKAmsterdam; Photos: Jeanne Charlotte-Vogt</figcaption></figure><p>Pre-Choreographics were developed from a need Emio Greco &amp; Pieter C. Scholten (EG|PC) had to build a unique notation approach for their work. It has been through several versions and has its origins in the <a href="http://insidemovementknowledge.net/">Double Skin / Double Mind</a> interactive installation work. The Pre-Choreographic Elements refer to the pre-phase of choreography during which movement material is being created, shaped, and tested. ‘Pre-choreographics’ is a formalisation of terms, categories, metaphors, types and modifiers used by the EG|PC dancers to develop and train their capacity with specific movement qualities. The current system (now referred to as ABCdaire) has a total of 161 terms. For CCL #8, Suzan described the system and showed how training sessions were recorded and annotated (using Motion Bank’s Piecemaker 2) while the performers demonstrated parts of ABDdaire.</p><h3><strong>Divided Attention by TILT</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZZanaGhAN1NxLFBEFj50-w.jpeg" /><figcaption>Julia Wilms and Andrea Božić; Photo: Jeanne Charlotte-Vogt</figcaption></figure><p>Andrea Božić (HR), founder of <a href="https://andreabozic.com/tilt2">TILT</a> along with <a href="https://andreabozic.com/robert_pravda">Robert Pravda</a> (NL/RS) and visual artist <a href="https://andreabozic.com/julia_willms">Julia Willms</a> (DE/NL), gave an input session on the practice of ‘divided attention’. TILT has evolved a unique approach to dance as an expanded form of choreography focused on the reorganization of perception and stimulating questions about the effects of attention and imagination, perception of presence, the politics of viewing, presentation of reality and distribution of authorship. During CCL #8, Andrea and Julia shared their practice of ‘divided attention’ which is central to their current work. Divided attention includes strategies such as looking in-between, zooming in and out at the same time, drawing in and distancing, and immersion and interruption at the same time. Also, Andrea and Julia spoke about their project, <a href="https://vimeo.com/146582948">Spectra: The Cube</a>, which explores questions on attention, time, and hybrid spaces.</p><h3><strong>Delving Bodies</strong></h3><p>Eric Minh Cuong Castaing (FR), associate artist with <a href="https://www.ballet-de-marseille.com/fr/collaborations/artiste-associe">Ballet National de Marseille</a> and ICKAmsterdam joined the lab, shared his choreographic research, and collaborated with the participants. Eric’s choreographic research focus is on the ‘augmented body’: new technologies that interfere with our everyday lives to such an extent that they become an extension of our own body. For CCL #8, Eric brought his Oculus system and first person camera that he’s been experimenting with. Eric works with the notion of ‘delving bodies’ and ‘body in revolt’ and explores how experimental devices such as immersive video games or virtual reality can destabilise our perception and at the same time generate a set of questions. For some insights into how this looks in the studio, you can see clips of his experiments <a href="https://vimeo.com/206091696">here</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*KT4L0OntVJJue604NqHb7A.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EJuu73l5PFm5mwgjy0Ohgw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZDODXqJP7OVPemOAg2OcSQ.jpeg" /><figcaption>Eric Minh Cuong Castaing and dancers from ICK Amsterdam; Photos: Jeanne Charlotte-Vogt, Danae Kleida</figcaption></figure><h3><strong>Double Awareness</strong></h3><p>Arno Schuitemaker (NL), contemporary dancemaker and ICK’s artist-in-residence (2015–2017), gave a presentation on his then-current projects and choreographic practices. Arno’s choreographic research revolves around questions about mirror neurons, movement patterns, and the participation/response of the audience. In his words:</p><blockquote>My work is not about movement but about moving, about timing and about spacing. I want to create not a performance, but an experience where things are happening. Audience and dancers are sharing the same space — you become part of it, because you are part of it.</blockquote><p>His input led to discussions around the ‘inner’ communication between the dancer and the choreography and the ‘outer’ communication between the dancers amongst each other in relation to the choreography and to the audience.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EOdcSy3PgNofCO-uXdwZLA.jpeg" /><figcaption>Toby Knyvett &amp; the Sapfundament; Photo: Jeanne Charlotte-Vogt</figcaption></figure><h3>Projects</h3><h4><strong>“Sapfundament”</strong></h4><p>Kind of the mascot of the lab was Toby Knyvett’s juice robot: <em>Sapfundament: Experiment with broad neural network for rapidly capturing human expression. </em>For his time in Amsterdam, Toby wanted to take a stab at answering a very specific question about the mapping task :</p><blockquote>can human expression be extracted by a broadly trained neural network?</blockquote><p><em>→read all about it: </em><a href="http://buildlog.tobyk.com.au/ccl/"><em>Part 1</em></a><em>, </em><a href="http://buildlog.tobyk.com.au/sapfundament2-neural-networks-motion-capture-and-flamenco/"><em>Part 2</em></a><em>.</em></p><h4>Random text script + ICK choreographic vocabulary</h4><p><em>as described by Joana Chicau</em></p><p>After Suzan’s inspiring presentation. CCL participant Joana Chicau built a computer script based on Emio Greco’s pre-choreographic principles as a base for creating new combinations from ICK’s choreographic vocabulary for thinking and generating movement.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*KsSJpPD8oLU40FL_B7gnjw.png" /><figcaption>A screenshot from the WebPage generating displaying the word sequence generated from the script above; Joana Chicau</figcaption></figure><blockquote>We [Joana and Suzan] went through three different iterations; in each of them the code was activated for a movement session to happen. In the end of each iteration a shot feedback/ discussion session would follow and I would make adjustments in the code to be tested in the following iteration. Here are some comments extracted from our discussions:</blockquote><blockquote>The presence of the script became a constant condition for discovery; The new random element as a potentiating element for improvisation; A movement generator; A fertile area to adopt a strategy; How one movement/’word’ unfolds into another = layering; Waves of information that are absorbed and accumulated in the body;</blockquote><blockquote>In Suzan’s words <strong>“Concepts coming from the body and then returning to it”</strong>, and I add <strong>“in a constant loop.”</strong></blockquote><p><em>→see, </em><a href="https://vimeo.com/218473261"><em>Snippet of experiment</em></a></p><h4>Tool for Choreography</h4><p><em>as described by Naoto Hieda</em></p><iframe src="https://www.instagram.com/p/BT3sGTylp4u/embed/?cr=1&amp;amp;rd=https%3A%2F%2Fwww.instagram.com" width="658" height="864" frameborder="0" scrolling="no"><a href="https://medium.com/media/e8f6ec511fab480d8bbb49a6549ce294/href">https://medium.com/media/e8f6ec511fab480d8bbb49a6549ce294/href</a></iframe><p>The Tool for Choreography is software to augment geometric choreography processes, originated from discussions with choreographer Janine Harrington. In her practice, Janine uses axes or grids as a unit of movement patterns or pathways. Then, she applies mathematical transformations to the space such as scaling or transposing axes. These transformations are purely mathematical (although individual dancers have to adapt these patterns to their movements later in the process) so that an aid of a computer program is expected to facilitate her practice dramatically.</p><p>There is existing software called Pathfinder, developed by Christian Mio Loclair in earlier CCLs. Though both programs generate geometric patterns, the philosophies are different. The Tool for Choreography is thought to be an extension of a notebook where movement patterns are sketched. These sketches can be input to the Tool for Choreography to simulate transformations of the geometry, which can be drawn back into the notebook. Therefore, the Tool for Choreography is a part of the iterative process led by a choreographer. On the other hand, the patterns generated by Pathfinder is purely algorithmic and has almost no human intervention.</p><p><strong>Links</strong><br><em>→</em><a href="https://www.instagram.com/p/BT1lLttF21x/"><em>https://www.instagram.com/p/BT1lLttF21x/</em></a><em><br>→</em><a href="https://www.instagram.com/p/BT3sGTylp4u/"><em>https://www.instagram.com/p/BT3sGTylp4u/</em></a><em><br>→</em><a href="https://www.instagram.com/p/BUBj6B6ldJ5/"><em>https://www.instagram.com/p/BUBj6B6ldJ5/</em></a><em><br>→</em><a href="https://www.instagram.com/p/BUIiitUFpU8/"><em>https://www.instagram.com/p/BUIiitUFpU8/</em></a><em><br>→</em><a href="https://github.com/micuat/ccl8tool"><em>https://github.com/micuat/ccl8tool</em></a></p><h3><strong>Open Lab Session</strong></h3><p>Wednesday, May 10 was the last CCL#8 day and it concluded with an Open Lab Session. The process of setting up the session was quite special for this CCL. Guided by Scott deLahunta and Jeanne Charlotte-Vogt, the participants gathered all together and decided to host the session in a ‘walk-around exhibition’ sort of style. Brakke Grond ‘s Red Hall really encouraged this setup as the participants used the balconies for installations &amp; interactive projects while the main stage was used for showcasing experiments and small presentations.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_qBAM42ES82OC06Hkb7XpA.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*gjNYt2gWiHa-0dl-a6YIWg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*IL4FHZIR0UbL4MfwwEIoQg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*aO7mNs8aE8xXATGfDodqXw.jpeg" /><figcaption>Transforming the lab into an exhibition (under ~30 min); Photos: Jeanne Charlotte-Vogt, Danae Kleida.</figcaption></figure><p>With the help of all participants, the lab was transformed into an exhibition under ~30min. Following an opening talk by Scott and Jeanne, we welcomed the audience and invited them to meet the artists and their experiments. You can watch small excerpts from the evening and the rest of the CCL days in Chris Ziegler’s channel:</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F218376846%3Fapp_id%3D122963&amp;dntp=1&amp;url=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F218376846&amp;image=http%3A%2F%2Fi.vimeocdn.com%2Fvideo%2F635829829_960.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="960" height="540" frameborder="0" scrolling="no"><a href="https://medium.com/media/bcb115ac1ea7a7be828d0eaa0e3b8683/href">https://medium.com/media/bcb115ac1ea7a7be828d0eaa0e3b8683/href</a></iframe><h3><strong>Moving Matter(s)</strong></h3><p>CCL#8 was concluded with the panel: <a href="http://2017.fiberfestival.nl/programme/moving-matters/">Moving Matter(s) — A panel on code, choreography, and dance data</a> which was organised by FIBER, Motion Bank, and De Brakke Grond in the context of the CCL Amsterdam &amp; FIBER Conference 2017. This panel presented current day practices and research &amp; education institutes, which are connecting the domains of creative coding, interaction design, dance, and choreography.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mA6kpMH8yMmfbYKQa_lBhA.jpeg" /><figcaption>Scott deLahunta, Ruairi Glynn, Gaby Wijers, Maaike Bleeker; Photo: Danae Kleida</figcaption></figure><p><a href="http://www.sdela.dds.nl/">Scott deLahunta</a> (Motion Bank/UK), <a href="https://www.uu.nl/staff/MABleeker">Maaike Bleeker</a> (Utrecht University/NL), <a href="http://www.ruairiglynn.co.uk/">Ruairi Glynn</a> (Bartlett School of Architecture/UK), and <a href="http://www.li-ma.nl/lima/about">Gaby Wijers</a> (LIMA/NL) shared their work and knowledge, and reflect on the past, present and future of interactive dance, digital notation and choreography preservation. The panel also explored how artists, designers and artistic engineers can translate aspects of choreography and dance into digital form and apply choreographic thinking to their own practices.</p><p>Coming from different backgrounds and approaches the speakers addressed questions such as:</p><ul><li>How can various technologies, from the more conventional to the very new, be used to archive, share and understand dance movement? How can they become part of new ways of creating dance? What does this tell us about the ways in which technology is part of how we make sense and think?</li><li>How is dance re-formed and re-contextualised through digitisation? How does digitisation effect the ontology, form and potential of dance (and data)? What does the emergence of dance digitisation for future artistic and academic endeavours contribute, for spectatorship, education and disciplinary exchange?</li><li>How can performative material and structure, be engineered /choreographed to be responsive? Can the act of making space and performing space be hybridised with the use of robotics?</li><li>Live, digital or media art, and performances depend upon the practices not the objects, and upon the performative role of the work and the spectator. How can we experience these artworks by documentation and re-interpretation? How can documentation and re-interpretation function as creative acts for the mediation, transmission and preservation of these artworks?</li></ul><h3><strong>Participants</strong></h3><p>Adam Russell (UK), <a href="https://www.uni-weimar.de/projekte/costumes-and-sensors/category/ha/">Aline Martinez</a> (BRA/DE), <a href="https://www.youtube.com/channel/UCjUNBZGPoK_DjJeyI3uiaEQ">Amy Louise Cartwright</a> (UK), <a href="http://rayzhekov.com/">Antoni Rayzhekov</a> (BGR/AUT), <a href="http://www.tbedrijf.be/">Bram Lattré</a> (BE), <a href="http://movingimages.de/">Chris Ziegler</a> (US), <a href="http://www.formedview.com/">Christopher Matthews</a> (US/UK), <a href="http://cargocollective.com/twotinygirls/About">Claudia Ribero</a> (PRT), <a href="https://davidbeermann.com/">David Beermann</a> (DE), <a href="https://www.eraxeg.com/">Erik Axel Eggeling</a> (SWE), <a href="http://www.janineharrington.com/">Janine Harrington</a> (UK), <a href="https://joanachicau.com/">Joana Chicau</a> (PRT/NL), <a href="https://www.joostvanduppen.com/">Joost Van Duppen </a>(NL), <a href="https://www.larissaviaene.com/">Larissa Viaene</a> (BE), <a href="http://lisaevelyn.com/">Lisa Rombout </a>(NL), Lyndsey Housden (UK/NL), <a href="http://centuryofthecat.nl/portfolio/">Marcel Smit</a> (NL), <a href="https://vimeo.com/174162011">Marion Traenkle</a> (NL), <a href="https://melaniethewlis.com/">Melanie Thewlis</a> (AUS/DE), <a href="http://mikepelletier.net/">Mike Pelletier</a> (CAN/NL), <a href="https://vimeo.com/mihoo">Michaela Honauer</a> (DE), <a href="https://naotohieda.com/">Naoto Hieda</a> (JP/DE), <a href="https://lmanalysis.nl/">Roos van Berkel</a> (NL), Stacy Hsueh (FR), <a href="http://www.tatou-mdt.com/">Tatou-Angeliki Dede</a> (GR), T<a href="http://www.tobyk.com.au/">oby Knyvett</a> (AUS), <a href="http://www.sarahlevinsky.co.uk/Welcome.html">Sarah Levinsky</a> (UK).</p><h3><strong>Guests</strong></h3><p><a href="https://andreabozic.com/andrea_bozic">Andrea Božić</a> (HR), <a href="http://www.arnoschuitemaker.com/">Arno Schuitemaker</a> (NL), <a href="http://www.shonen.info/">Eric Minh Cuong Castaing</a> (FR), <a href="http://www.li-ma.nl/lima/about">Gaby Wijers</a> (NL), <a href="https://willmsworks.net/en/">Julia Wilms</a> (DE/NL), <a href="https://www.uu.nl/staff/MABleeker">Maaike Bleeker</a> (NL), <a href="http://www.ruairiglynn.co.uk/">Ruairi Glynn</a> (UK), <a href="https://www.universiteitleiden.nl/en/staffmembers/suzan-tunca#tab-1">Suzan Tunca</a> (DE/NL).</p><h3><strong>CCL Team</strong></h3><p>Anton Koch (DE), <a href="http://waltzbinaire.com/">Christian Loclair</a> (DE), <a href="https://www.uu.nl/staff/DKleida">Danae Kleida</a> (GR), <a href="https://www.fiber-space.nl/">Jarl Schulp</a> (NL), <a href="http://jeannevogt.de/">Jeanne Charlotte-Vogt</a> (DE), <a href="http://www.sdela.dds.nl/">Scott deLahunta</a> (UK/US).</p><h3>Links</h3><p>→ <a href="https://medium.com/motion-bank/the-choreographic-coding-lab-format-by-motion-bank-61d34fe28e82">The Choreographic Coding Lab Format by Motion Bank</a> by Danae Kleida &amp; Florian Jenett<br>→ <a href="https://vimeo.com/showcase/4593086">Video Library</a> by Chris Ziegler<br>→ <a href="https://medium.com/@naoto_hieda/nova-choreographic-coding-lab-pathfinder-f14fc1f81deb">NOVA: Choreographic Coding Lab</a> + Pathfinder by Naoto Hieda<br>→ <a href="http://choreographiccoding.org/">Choreographic Coding Labs</a><br>→ <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank</a> (at Hochschule Mainz — University of Applied Sciences)</p><p><em>CCL Amsterdam 2017 was supported by </em><a href="https://www.goethe.de/ins/nl/nl/sta/ams.html"><em>Goethe Institut Amsterdam</em></a><em>.</em></p><p><em>Many thanks to Suzan Tunca and Michaela Honauer for sharing their notes with me!</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c71c4052166e" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/choreographic-coding-lab-8-in-amsterdam-c71c4052166e">Choreographic Coding Lab #8 in Amsterdam</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Motion Bank Web Systems now offer Collaboration and Sharing]]></title>
            <link>https://medium.com/motion-bank/motion-bank-web-systems-now-offer-collaboration-and-sharing-4a411e742d0?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/4a411e742d0</guid>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[research]]></category>
            <category><![CDATA[software]]></category>
            <category><![CDATA[annotations]]></category>
            <category><![CDATA[collaboration]]></category>
            <dc:creator><![CDATA[David Rittershaus]]></dc:creator>
            <pubDate>Thu, 14 May 2020 09:45:29 GMT</pubDate>
            <atom:updated>2020-05-14T09:45:29.683Z</atom:updated>
            <content:encoded><![CDATA[<h4><a href="https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93">About a month ago Motion Bank has updated its Web Systems and opened them up to support dance education and dance practice during COVID-19.</a> Now, there is a second update.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*fae8E4pX7OxxZjzAHg1yrw.png" /><figcaption>Different users can contribute annotations to the same video in the updated version of the Motion Bank Web Systems.</figcaption></figure><p>The past weeks have not been easy for many and they have shown — not only in the field of dance and performing arts – how important it usually is to come together in the same place, to bodily assemble, to really look at each other, to touch, etc. Despite all the difficulties, it was and is also exciting to observe how many solutions were and still are developed in dance practice and education, which were not necessarily thought possible before. Of course, they are often (but not always) more short-term solutions than anything you would want to continue after the pandemic.</p><p>Our motivation for offering these systems is inspired partly, as we wrote before, by our wish to support our partners in dance education in shifting their courses on line. However, our research has always assumed bodies moving together in close proximity as the basis for the practical knowledge we seek to digitally document and explore. This living matter cannot be replaced digitally, something the current situation makes clear. This seems to call for a critical examination of networked technology. One that might take impetus from and continue beyond the current crisis.</p><p>At the same time we have seen some exciting and interesting use cases of video annotation by means of our systems in the last weeks. However, there was one thing that was missing in the updated systems, especially since it is one of the fundamental advantages of a web application: the ability to collaborate on the annotation of videos and to share the (annotated) content with others. It’s something that was already in place in the first versions of the software, but never before had it been technically implemented in a way that would have allowed for the ease of use we are used to from other tools. So we are all the more pleased to announce that it is now possible and properly implemented.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*6In-sSlNO51ri29Sl9Re_w.png" /><figcaption>To share content with others and to collaborate on annotating videos in Piecemaker or on the creation of grids in Mosys you create groups, invite members to the group and define access rights to your content.</figcaption></figure><p>The current, updated version of the Motion Bank Web Systems allows one to create groups, invite other users to join the groups and share selected content with these groups at different levels (“view”, “contribute”, “free editing”). The software update is now online: <a href="https://app.motionbank.org/">app.motionbank.org</a></p><p>A new video on our tutorial page offers detailed instructions: <a href="https://tutorials.motionbank.org/">tutorials.motionbank.org</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oi-NLmmGXwqi7qYStEujzA.png" /><figcaption>You can set the access rights for each Piecemaker timeline and Mosys grid in the Motion Bank web systems individually for each group (and thereby its members) you create.</figcaption></figure><p>We hope that by expanding the possibilities we can support even more people in the current situation. However, the size of our team has not changed since the opening of the systems about a month ago and we still can’t offer “a big green sign up button” on the start page, but if you are interested in using the systems, just drop us a line: <a href="/service/mailto:office@motionbank.org">office@motionbank.org</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yZW2KwxBFIV2h6ekX_u6aw.png" /><figcaption>The update does not only allow you to annotate videos together and share annotated videos with other users, but you can also work on Mosys grids (small “micro websites”) together or share a collection of material you put together using Mosys.</figcaption></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4a411e742d0" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/motion-bank-web-systems-now-offer-collaboration-and-sharing-4a411e742d0">Motion Bank Web Systems now offer Collaboration and Sharing</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Annotating YouTube Live Streams using the Motion Bank Web Systems]]></title>
            <link>https://medium.com/motion-bank/annotating-youtube-live-streams-using-the-motion-bank-web-systems-ba162bb4d202?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/ba162bb4d202</guid>
            <dc:creator><![CDATA[David Rittershaus]]></dc:creator>
            <pubDate>Fri, 03 Apr 2020 11:59:16 GMT</pubDate>
            <atom:updated>2020-04-03T11:59:16.011Z</atom:updated>
            <content:encoded><![CDATA[<p>In this article, I would like to briefly describe how you can use <a href="https://app.motionbank.org/">Motion Bank’s annotation tool</a> to annotate a (non-public) live video stream from YouTube in real time. The stream can be embedded into Motion Bank’s web application and annotated while it‘s being broadcasted. Once the live stream has ended, the annotated video is still available in Motion Bank’s web systems to edit the annotations, add more annotations and retrieve the annotated video at any time. <a href="https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93">In light of the current situation regarding COVID-19, Motion Bank has just released an update of their web application</a> and corresponding video tutorials. The option to annotate a live stream might be interesting for all those who are thinking about using the tool for digital education in dance or physical practice in the upcoming semester.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Er0FSvjUZKHtdnk--rbADg.jpeg" /></figure><p>Of course, the use of YouTube is associated with some data privacy concerns, since the data ends up on the servers of YouTube and the stream also runs through them. The concerns are more than justified, but there are currently no other providers known where this is possible so easily and free of charge. In the long term, other solutions are definitely to be envisaged. Institutions may need to check whether the use of YouTube services is permitted by their regulations. As of now the best option is to use the privacy settings of YouTube and choose “unlisted” instead of “public” for the live stream which also affects the recorded video (see below).</p><h4>1. Preparations</h4><p>First of all, you need a YouTube account. It must be verified in order to use live streaming. For this purpose you can visit the following page: <a href="https://www.youtube.com/verify">https://www.youtube.com/verify</a>. As soon as this is done, you should start a test stream immediately, because it won’t be possible on the first try. YouTube will indicate that the option is only available 24 hours after the first attempt.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*OmOvwN1c3FIGoaQLPxc4Fg.png" /></figure><h4>2. The steps on the side of the sender</h4><p>All the steps are demonstrated in the video below.</p><ul><li>Navigate to YouTube Studio and start a live stream there or immediately select the camera symbol in the upper right corner and choose “Go live”.</li><li>Enter a title for your stream (this will later be the title of your video within the Motion Bank Web Systems, but you can always change it).</li><li>Select “Unlisted” from the drop-down menu below if you don’t want the stream to show up on YouTube. Only people who have the stream’s URL can watch it. This setting is retained for the recorded video later.</li><li>You have to select if the content is specifically made for kids or not. Simply select that it isn’t. This won’t affect you.</li><li>After clicking “Next” you have to capture a thumbnail image (using your webcam) that is also shown until you start the live stream. After that, you have the possibility to replace it with an uploaded image, modify the title again and to share the URL of the stream even before you start it by clicking on “Share”. You can also “Go Live” immediately.</li><li>After you selected “Go Live” and started to stream live video, you can share the URL by clicking on the arrow symbol next to the red “End Stream” button below the video.</li><li>Share the URL with the receivers so they can use it to embed the live stream in the Motion Bank Web Systems to annotate it in real time.</li></ul><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F403294401%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F403294401%2F6e1d4bf3e5&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F872702794_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/f895903d357afde4cc0a5675117a361a/href">https://medium.com/media/f895903d357afde4cc0a5675117a361a/href</a></iframe><h4>3. The steps on the side of the receiver</h4><p>All the steps are demonstrated in the video below. At this point, it is assumed that you already know how to annotate videos with the annotation tool “Piecemaker” of the Motion Bank Web System. If you don’t, have a look at the tutorial: <a href="https://tutorials.motionbank.org/">https://tutorials.motionbank.org/</a></p><ul><li>If you don’t have a timeline to which you want to add the live stream, you need to create one.</li><li>Select the timeline you want to add the stream to.</li><li>Select “Add Media” like you would do it when you add a video (the process is the same).</li><li>Paste the URL you received from the sender to the input field (again like you would do it with a video from YouTube) and click on “Submit”.</li><li>Change the title of the stream if you want. This is only the title that shows up within the Motion Bank Web Systems. It won’t affect the YouTube stream. Keep the rest of the settings.</li><li>Select “Annotate” or click on the live stream item in your media list.</li><li>Click on the play button of the video player to watch the live stream. You’re now seeing the live stream and you can start adding annotations by simply starting to type. For each annotation, the moment you strike the first key sets the timestamp.</li><li>You can go back to the annotations you’ve added by clicking on the timestamp. That will also bring you back to the corresponding moment in the stream. To get back to what’s shown live, you can refresh the browser page.</li></ul><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F403294850%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F403294850%2F481f3e42eb&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F872703311_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/f2bdb976b69bff75fd24d0d5455cdb8d/href">https://medium.com/media/f2bdb976b69bff75fd24d0d5455cdb8d/href</a></iframe><p>After the live stream has been stopped (first part of the video below) the video is saved to YouTube keeping the same URL. That means the video will also still be available within Piecemaker. If you select it there (second part of the video below) you still see the annotations you added in real time. You can edit them now or add more annotations and use the annotated video within the Motion Bank Web Systems.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F403294953%3Fapp_id%3D122963&amp;dntp=1&amp;display_name=Vimeo&amp;url=https%3A%2F%2Fvimeo.com%2F403294953%2Fba7ec804b0&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F872703462_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/71e1c22be065660ebda41cd930265c4d/href">https://medium.com/media/71e1c22be065660ebda41cd930265c4d/href</a></iframe><h4>4. Annotating a Zoom meeting or presentation in real time</h4><p>Since a lot of people are using <a href="https://zoom.us/">Zoom</a> at the moment for meetings, conferences and presentations, it might be interesting to know that the Pro version of Zoom allows you to live stream a meeting or presentation via YouTube. <a href="https://support.zoom.us/hc/en-us/articles/360028478292-Streaming-a-Meeting-or-Webinar-on-YouTube-Live">You can find detailed instructions on how to set it up on the Zoom website.</a> To annotate the stream using Piecemaker you simply use the URL of the YouTube live stream as described above.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ba162bb4d202" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/annotating-youtube-live-streams-using-the-motion-bank-web-systems-ba162bb4d202">Annotating YouTube Live Streams using the Motion Bank Web Systems</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Supporting Dance Practice and Education during COVID-19]]></title>
            <link>https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/ca43e71eb93</guid>
            <category><![CDATA[annotation-tools]]></category>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[performing-arts]]></category>
            <category><![CDATA[coronavirus]]></category>
            <category><![CDATA[education]]></category>
            <dc:creator><![CDATA[Florian Jenett]]></dc:creator>
            <pubDate>Tue, 31 Mar 2020 13:57:32 GMT</pubDate>
            <atom:updated>2020-04-23T06:21:45.023Z</atom:updated>
            <content:encoded><![CDATA[<p>We are glad to see so many initiatives, both online and off, being developed to support venues and artists in this challenging time with its unknown future. Our research during the last 10 years at Motion Bank has focussed on the digital documentation of dance practices with the aim to open up and share these materials online with other artists, researchers and educators. One of our ongoing projects has been the development of a web-based software system (including previous Piecemaker and MoSys tools) for documenting, annotating and transmitting dance.</p><p>During our first week of #stayathome here in Germany we sat together … errr, met online and discussed what we can do to best support our collaboration partners and network during the upcoming weeks and even months. From these discussions, we decided to focus on supporting dance education, given that so many dance educators are rapidly having to shift their teaching and learning to entirely online platforms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qChC1CcxkY9I5goWt9IQAA.jpeg" /><figcaption>Introducing the Motion Bank tools in a dance class at Codarts Rotterdam</figcaption></figure><p>As mentioned above, Motion Bank is in its 10th year now. Prior to the COVID-19 outbreak in Europe, we were already preparing some celebrations. We were also working on plans for a more sustainable route into the future. As a part of this, we are planning to work on better supporting dance education through increasing the documentation and availability of our methods and tools. Given the urgency of the moment, the team has been super busy in the last days 🙏🏻 finishing and polishing our newest Motion Bank Systems version and documenting steps to create dance documents offline to share and discuss them online. Some of the new documentation and tutorials are available already <a href="https://tutorials.motionbank.org/">here</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*wq7nAa3Uw7t23s6ozGDwcg.png" /></figure><p>Although we’d love to offer a big green sign up button and go “open for all” this is not what we are able to support at the moment given the size of our team. We are sending out logins to current partners and network and if you also are interested in using our systems … please get in touch with us here: office@motionbank.org</p><p>Stay healthy!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Nd7nJlMvzmsnt1R7jQOZrQ.png" /><figcaption>Screenshot of the updated version of Motion Bank’s annotation tool</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ixF_aH0kELAZATw0K5qf_A.png" /><figcaption>Screenshot of the updated version of the publishing tool of the Motion Bank Web Systems</figcaption></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ca43e71eb93" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/supporting-dance-practice-and-education-during-covid-19-ca43e71eb93">Supporting Dance Practice and Education during COVID-19</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Introduction to Annotation as a Research Practice in Dance]]></title>
            <link>https://medium.com/motion-bank/introduction-to-annotation-as-a-research-practice-in-dance-3a0884c5d720?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/3a0884c5d720</guid>
            <category><![CDATA[methodology]]></category>
            <category><![CDATA[annotations]]></category>
            <category><![CDATA[research]]></category>
            <category><![CDATA[software]]></category>
            <category><![CDATA[dance]]></category>
            <dc:creator><![CDATA[David Rittershaus]]></dc:creator>
            <pubDate>Tue, 31 Mar 2020 11:13:40 GMT</pubDate>
            <atom:updated>2020-03-31T11:13:40.629Z</atom:updated>
            <content:encoded><![CDATA[<h4><strong>Since 2010, the </strong><a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643"><strong>Motion Bank</strong></a><strong> research project has been developing software and methods for the annotation of time-based media, primarily video, in the field of contemporary dance. This article introduces the specifics of Motion Bank’s annotation tool and some of the practical approaches I developed over the last three years working with it.</strong></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Nd7nJlMvzmsnt1R7jQOZrQ.png" /><figcaption>Screenshot of the current view of the Motion Bank Web Systems annotation tool. The annotations on the choreographic structure mark the sections of the piece “Effect” by Taneli Törmä and the tanzmainz company in this example.</figcaption></figure><h4><strong>Origins and specifics of Motion Bank’s annotation tool</strong></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cdFpyeBMZ5ZJlhstt5N7GA.jpeg" /><figcaption>Screenshot of Piecemaker 1, developed by David Kern within The Forsythe Company</figcaption></figure><p>Motion Bank’s web systems for annotating time-based media have their origins in dance practice. The first version was created by the renowned The Forsythe Company for internal use and named “Piecemaker”. It was developed by the long-time company member David Kern to support the rehearsal process through collaborative documentation. This focus on the necessities of a dance company and artistic creation processes distinguishes it from other video annotation tools to this day. From the very beginning, it had to be open to processes whose outcome is uncertain.</p><p>Furthermore, by the time of its creation choreographer William Forsythe had developed his own movement vocabulary, mostly cutting ties with classical and neoclassical ballet and its more or less “universal” terminology. A strictly systematic approach as it is known from linguistic annotation tools like <a href="https://archive.mpi.nl/tla/elan">ELAN</a> just wasn’t applicable and still isn’t for many practitioners from contemporary dance and qualitative dance research, where pre-given, universal categories do not really exist or are viewed suspiciously. Thus, a core principle of the tool has always been the possibility to annotate “freely”, descriptively. Last but not least, people do not want to fiddle with software that has a steep learning curve, keeping them from doing their actual work: dance, choreography, dramaturgy, teaching. Especially newer versions of the Piecemaker annotation tool thus aim to make the basic method of annotating videos as convenient and low-threshold as possible.</p><h4><strong>There is no software “product” by Motion Bank</strong></h4><p>However, the fact that the software development focuses on those specific needs doesn’t mean that similar things can’t be achieved with other tools and most of the approaches described below can be applied using other annotation software. It is also important to know that the Web Systems are not a (commercial) software product. Motion Bank is a research project with a small team and a core interest in methods, practices and theory around the documentation, analysis and transmission of dance and movement practices using digital media and technology. You can instead think of the Web Systems by Motion Bank as an offer to explore and research what annotation can add to your (artistic) research or teaching practice and develop your own methods, strategies, practices and theory. On the other hand, this also means that you should feel free to use any other annotation tool that might suit your or your institution’s needs. Yet, if you feel comfortable with it and you are working for an institution like a university, dance company, museum or an archive there are possibilities to adopt the software and to run it independently from Motion Bank’s infrastructure and development since <a href="https://gitlab.rlp.net/motionbank">the software itself is open source</a>.</p><blockquote>If you want to use the current Motion Bank Web Systems to explore annotation, just drop us a line: office@motionbank.org</blockquote><h4>Learning by doing</h4><p>I first encountered the possibilities of using annotation when I started working with Motion Bank in early 2017. Back then Motion Bank was established at Hochschule Mainz University of Applied Sciences by Florian Jenett and Scott deLahunta, three years after the first phase with the Forsythe Company ended. The tool that was available at that time was a second, rewritten version of David Kern’s original “Piecemaker”, developed during Motion Bank’s first working phase (2010–2014) to support the documentation of choreographies by renowned artists and the creation of <a href="http://scores.motionbank.org/">online publications</a> about the documented works.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*N2EExNOchJ492AhjiDuHFg.jpeg" /><figcaption>Screenshot of Piecemaker 2, <a href="http://scores.motionbank.org/dh">annotations for a recording of Deborah Hay’s “No Time to Fly”</a></figcaption></figure><p>While Piecemaker 2 opened up beyond the particular use of the Forsythe Company, it was put together in a rather quick way, and it was a bit bumpy to use. However, I was able to get into it pretty easily, and even though it didn’t do so much more than linking text comments to specific moments in a video, it opened up an entirely new approach to studying dance for me. Being a dance and theatre scholar with a humanities background, it helped me to look at the actual movement and to differentiate its qualities in much more detail. Until today typical movement analysis is not my primary interest, but annotation was and is a perfect way for me to study dance closely.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*RObVq8jfuO-JcfDTIxZ5Yg.jpeg" /><figcaption>Ballet class at Codarts Rotterdam in 2018 that was annotated using Piecemaker</figcaption></figure><p>I started giving Motion Bank workshops for people from the dance field quite soon, explaining to them how to use the software. A lot of exchange happened with educational programs, such as the Master’s program in dance education <a href="http://www.hfmdk-frankfurt.info/en/university/departments/department-3/contemporary-dance-education-master/">MACoDE</a> at HfMDK Frankfurt and the dance departments of <a href="https://medium.com/motion-bank/developing-vocabularies-for-dance-education-e4c4584950a8">Codarts Rotterdam</a>. In addition, I was introducing it to individuals who document the work and creation processes of choreographers. Recently, Scott deLahunta and I have given workshops for people from anthropology and ethnography at the <a href="https://www.emkp.org/">British Museum tasked with documenting endangered immaterial knowledge</a>, as well as the <a href="https://www.tate.org.uk/about-us/projects/documentation-conservation-performance">Tate London, where a team is collecting choreographic and performative works</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mzzsm4EzC-lEzecg1jSCMw.jpeg" /><figcaption>Workshop at the British Museum in 2019, annotating a video to document woodwork skills and techniques</figcaption></figure><h4><strong>Piecemaker today: there is not one “how to”, and the software does not impose anything on you either</strong></h4><p>The Piecemaker software was rewritten again from 2017 on and also merged with Motion Bank’s web publication tool into what is now called Motion Bank Web Systems (a standalone, “offline” version of the annotation tool is going to be released soon). The current version of it is stable and easy to use, as well as built on up-to-date tech and data standards. Its principal function remains simple: you add text comments to specific moments in a video or other time-based media.</p><blockquote>If you want to learn how to technically use the software, check our tutorials: <a href="https://tutorials.motionbank.org/">tutorials.motionbank.org</a></blockquote><p>As a result, in workshops and collaborations, our central purpose is increasingly achieved. We do not talk about technology and its challenges anymore, but about the methods and strategies of annotating dance or other bodily practices. Here the question of how to annotate comes up constantly, especially since the software is not suggesting any predefined application scheme. The answer to the question of “how to” is often the same: there is no one way, no right way, no singular method. It is learning by doing, developing your own method, depending on your project, objective and interest. However, through <a href="https://betweenus.motionbank.org/">my own use </a>and exposure to others using it in workshops and teaching situations, as well as being closely connected to the actual development of the software over time, I have come up with a few general approaches.</p><p>In the following section, I will share what I think might be <em>helpful for a first orientation and as a loose guideline</em>, especially if you haven’t used annotation before. The approaches in this article neither claim completeness, nor are they scientifically grounded. Additionally, they are not limited to dance, and I have tried to phrase them openly so they might be applied to other areas of bodily practice.</p><h3><strong>A Practical Introduction to Annotation — Starting points</strong></h3><p>In the following, I have divided the collection of approaches into five different sections. These can still be combined as required, as in the practice of annotation, they are often overlapping anyway:</p><p>1. Indexing and segmenting</p><p>2. Developing a research question, deciding for a central point of interest</p><p>3. Adding background information, feedback and (self-)reflections</p><p>4. Interview and “video recall”</p><p>5. Developing categories, terms or names and applying them</p><h4>1. Indexing and segmenting</h4><p>It can feel a bit awkward to write down what you can already see in a video, but you might want to consider that the information is locked in a container as long as it stays only within the video image. You can’t search for information or keywords the way you would in a digital text or on the web. If you look at the video player, you can see a visual representation of the start point and the endpoint, but you don’t have any indication for what’s in-between. Annotating the most significant events in the video can give you an overview. At the same time, you get to know the material better, especially in case you’re not familiar with it at all. It can also give you a visual overview of the structure of the content or the occurrence of events that seem notable to you. Later, even a rough segmentation makes it so much easier to find and come back to specific moments quickly.</p><p>Of course, you can continue to do this on a more and more granular level, describing “everything” to the smallest details, which can be a method of getting to know and to understand your material very well. Therefore, annotation can, above all, be an excellent training in close observation through repeated viewing. What is happening in dance and other bodily practices is not as obvious as it might first appear, and I think you’ll be surprised how quickly you go beyond simply describing what you first see in the video. This approach is also a lot about making things explicit by finding terms to name them and words to describe them. Suddenly, you’re in the heart of what annotating is about from my point of view. Furthermore, you might also recognise that you quickly go beyond naming and describing, but start differentiating qualities, interpreting and judging. It can be a good idea to remind yourself from time to time that even a simple segmentation is based on subjective perception and assessment anyway.</p><h4>2. <strong>Developing a research question, deciding for a central point of interest</strong></h4><p>It does not matter if you start with a general segmentation of a media file or not, it can be beneficial to be clear in advance what your primary interest or research question is. Since dance and bodily movement can contain so much information, you can easily get lost in the details, especially if you’re getting more and more granular. The more you know what you are looking for, the more focused your annotation process will be. You can then index or segment the video regarding your interest or immediately look for essential moments, qualities and details.</p><p>What to focus on depends on your research subject, your artistic project and your interest. This means that whether you are coming from academic, artistic or didactic areas, you probably know what you are looking for. In general, it can be anything: quality of arm movements, feet relation, use of verbal language, discursive references, use of music, costumes, skill-related aspects, nonverbal communication between choreographer/instructor and dancers/movers, etc. If you’re working on a video collaboratively, it can be interesting to bring together different perspectives. You might combine a dance scholar’s viewpoint and an anthropologist’s, or split the work, so one person can focus on the use of language, the other on the use of music. In a movement analysis, different people can look at different qualities or body parts.</p><h4>3. Adding background information, feedback and (self-)reflections</h4><p>The strategies I described so far assume, more or less, that you deal with recordings and videos of something you haven’t been part of and that you encounter more as an outside observer. But of course, it may well be the case, that you annotate video recordings of yourself or a practice where you are the expert, e.g. a choreography you created, a dance class you developed or a technique you teach. Then you’re probably the ideal person to mark the critical moments in a recording and to use annotations to add background information that cannot be obtained from the video. That is where a crucial aspect of annotation can come into play, namely adding a discursive, narrative, linguistic level to the visual information level of the video image. In dance, for example, you can also refer to somatic methods, mental images and numerous other aspects that are simply not visible in a video. They may not be relevant for watching a dance performance (or a recording of it), but they are relevant when it comes to knowledge transmission and education.</p><p>In training, you can use annotation to give feedback to students based on a video. The combination of video image and a concise written commentary can be very instructive and help to focus on the key points. Annotation can also be a useful tool for demonstrating how things should be done correctly, again with the possibility to point at the key moments and actions. For students or people who would like to educate themselves and improve their skills, this is also a possibility for self-reflection. The analytical way of working associated with annotation and the change of media can also be a helpful distancing.</p><h4>4. Interview and “video recall”</h4><p>Let’s consider the contrasting situation. If you have unfamiliar what you are dealing with, it can be a good idea to simply ask those who are familiar with or have direct involvement in what is documented on the video (as long as this is possible). You might just chat with the experts a little bit, and this can already have an impact on your understanding of what you encounter. Especially if you are pursuing a scholarly project, it makes sense to get information in a more targeted and systematic way. A good possibility is to watch a video together with an expert or an involved person and to immediately record their comments as annotations, whether in the context of a formal interview or in a more casual exchange.</p><p>Especially in dance and bodily practices it is possible to document, using the technique of ‘video recall’, some of the “inner view” of the event that has been recorded, what it felt like, what the decision-making processes were, etc, at least from the perspective and memory of the persons involved. It is important to indicate in the annotations who is making the statements (whether the annotator or interviewee). You can also invite the interviewee to annotate the video themselves, but this sets up a different situation, especially if they have no previous experience with video annotation. Asking several people to annotate the same material can nevertheless be an interesting option to document and later represent different perspectives. If people use separate accounts, it will always remain clear who wrote what.</p><p>As you might have recognised, there are parallels showing up to video-based ethnographic methods, and it is a good idea to do more reading on these methodologies if you are not familiar with it.</p><h4>5. Developing categories, terms or names and applying them</h4><p>This approach can begin with developing a research question (Nr. 2) which might give rise to a collection of terms to start with in the annotation process and to help index your video (Nr. 1). You might also just begin by describing and naming what you can see in the video, which can produce a terminology to use for further annotation. These terms may be useful for other videos of the same choreography, artist, company or practice. This way, you are developing a “bottom-up” vocabulary from within the material instead of imposing one on it, so you get a vocabulary emerging from and adapting to the recorded event. A good start could be to look for terms that show up in your descriptive (longer text form) annotations. If you are an outside observer of what is happening in the recording, it may well be best practice to simply pay attention to the use of the language of the people involved. Most bodily practices come along with some terminology or a way of naming things, even if it is often idiosyncratic and fragmentary. You might want to pick up and make use of these terms, because they take into account the perspective and knowledge of those involved. This can be achieved also through a video recall approach (Nr. 4). On the other side, if you are directly involved with what the video documents, you might already know about the terminology and as an expert, make use of it for annotating the video (Nr. 3). However, if you are part of a team, company or institution, it can be helpful to discuss the vocabulary you are using related to the particular practice. This way, you can make sure you have the same or a similar understanding before you start using it for a systematic way of annotating videos.</p><p>Although I have been critical of imposing a predefined scheme, this does not mean that any recourse to a pre-established vocabulary imposes something on the material in a wrong way. The structure of choreography or the order of scenes in a piece can, for example, form a stable and somehow unquestionable temporal scheme that can be recorded through annotation and help a lot in terms of indexing. Adapting systems like Laban Movement Analysis (LMA) can also work or labelling different aesthetic orders that come into effect. Just think about how you deal with it if the assignment of terms or categories is not clear, which is quite often the case within the arts, especially in bodily practices. At least from a humanities perspective, it does not make sense to favour one over another term if the core content is persistently ambiguous. One way to deal with it could be a combination of formalised annotations with descriptive and explanatory ones. A benefit from the use of formalised annotations is undoubtedly the computational processing that it enables and that allows for better indexing, filtering and searching.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3a0884c5d720" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/introduction-to-annotation-as-a-research-practice-in-dance-3a0884c5d720">Introduction to Annotation as a Research Practice in Dance</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Choreographic Coding Effect]]></title>
            <link>https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/b0ab5501c069</guid>
            <category><![CDATA[threejs]]></category>
            <category><![CDATA[creative-coding]]></category>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[processing]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Florian Jenett]]></dc:creator>
            <pubDate>Tue, 28 May 2019 16:23:32 GMT</pubDate>
            <atom:updated>2019-06-07T09:50:38.270Z</atom:updated>
            <content:encoded><![CDATA[<h3>Choreographic Coding with Effect</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1VkRjt51zOUkR4GMi2Yxyg.jpeg" /><figcaption>CCL Mainz 2019 at Kunsthalle Mainz; Photo: Vanessa Liebler</figcaption></figure><p><strong>TL;DR — </strong>While preparing for the recent <a href="http://choreographiccoding.org/labs/mainz-between-us-april-may-2019">Choreographic Coding Lab (CCL) in Mainz</a> we thought it would be nice to give the more code-oriented part of our audience an introduction into the “Effect data” and how they might want to go about exploring it.</p><h3>Effect by Taneli Törmä</h3><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F327450655%3Fapp_id%3D122963&amp;dntp=1&amp;url=https%3A%2F%2Fvimeo.com%2F327450655%2F59ca34c62c&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F771723426_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1280" height="720" frameborder="0" scrolling="no"><a href="https://medium.com/media/6dd2eac063942143b24fdee04307f1f5/href">https://medium.com/media/6dd2eac063942143b24fdee04307f1f5/href</a></iframe><p>As part of the 2nd Mainz CCL (April 28th — May 2nd, 2019) we were offering a data set that we collected as part of a larger project called <a href="http://kunsthalle-mainz.de/de/exhibitions/archive/16"><em>Between Us</em></a><em> </em>(with Staatstheater Mainz and Kunsthalle Mainz). The data stems from a new piece called <a href="http://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz18-19/effect"><em>Effect</em></a> by Finnish choreographer <a href="http://www.tanelitorma.com/">Taneli Törmä</a> and consists of multiple parts. Firstly it contains the documentation (videos and annotations) of the whole creation process of the piece. Secondly, sound, video, and full body motion capture data of one full run is included. And finally, we added interviews with the choreographer, dancers, Motion Bank staff and our project partners.</p><p>There is a lot more data and background information to offer about the <em>Between Us</em> project and also the piece itself. Since this is not the focus of this post we will instead just note that <a href="http://kunsthalle-mainz.de/de/exhibitions/archive/16">the exhibition</a> at Kunsthalle Mainz is still running until June 16th ’19 and that there is an <a href="https://betweenus.motionbank.org/"><em>Online Score</em> for <em>Effect</em></a> that you should visit.</p><h3>The process documentation</h3><p>The key to understanding the piece <em>Effect</em> was being able to visit and to document the creation of it. Our dance researcher David Rittershaus got to spend almost all studio days with the <a href="http://www.staatstheater-mainz.com/web/veranstaltungen/tanzmainz18-19/effect">tanzmainz</a> dancers Bojana Mitrović, Amber Pansters, Milena Wiese, Zachary Chant, Finn Lakeberg and choreographer Taneli Törmä during the rehearsals.</p><p>The documentation was done using methods and tools that we develop as part of our research at Motion Bank. The part of our system that was built to support process documentation is called <em>Piecemaker</em>. It was started by David Kern inside The Forsythe Company Frankfurt in ~2008 and has been in development since. It allows us to link time-based annotations with video materials.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*FfEnzIVnArsEQQUNdFsizA.png" /><figcaption><a href="https://assets.motionbank.org/bu-online-score/process-documentation/process_web/process_learning_triangle-steps_13-09-2018_UT_LQ.mp4">Video of rehearsal on September 13th 2018</a></figcaption></figure><p>The documentation of the rehearsal process consists of 61 videos with annotations captured during the rehearsals as part of the <a href="https://betweenus.motionbank.org/#/mosys/grids/3b99d756-aed4-4112-9fb5-e8362e349b6f">creation process</a> of <em>Effect</em> at <a href="http://www.staatstheater-mainz.com/">Staatstheater Mainz</a> between September 12th – November 19th 2018.</p><p>These videos not only capture the way that choreographer Taneli Törmä set up the creation process, but it also holds the language that arose between him and the dancers of tanzmainz. A lot of this language consists of names/labels that were invented to introduce, discuss and reference elements of <a href="https://betweenus.motionbank.org/#/mosys/grids/3a94f195-4d0d-4d92-81a8-fc0fcf266411">the choreography</a>. These are often not descriptive but rather point to shared memory or knowledge inside of the team. The videos and annotations also contain background information about all the details that are part of <em>Effect</em> and that are sometimes not even noticeable on stage.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HnWY2f0GnCh32gedD05t9g.png" /><figcaption>About 60 minutes of Effect (unfolded) on the walls of the tower of Kunsthalle Mainz</figcaption></figure><p>Motion Bank used this information to create an index into <em>Effect</em> inside the stairwell of the new tower of Kunsthalle Mainz. Over 2.5 turns one can walk along a timeline on the walls that represents the ~60 minutes of the piece. It consists of the times and names of the elements of the choreography with additional descriptions and visualisations. The index will not only allow the visitors of the exhibition to study the piece but also help establish a language and (mental) images for each part of the choreography to support communicating about the piece with others.</p><p>The player, which we are introducing below, will send the core elements names alongside the movement data as it plays. A full list of all elements with times can be <a href="https://seafile.rlp.net/f/8f0c45fdd76e4e929734/">found here</a>.</p><h3>The movement data</h3><p>In 2017 the <a href="https://www.hs-mainz.de/studium/studiengaenge/gestaltung/bachelor-kommunikationsdesign/uebersicht/">design department of the Hochschule Mainz</a>, where <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank is based</a> since 2016, decided to invest in technology that would allow students to explore and learn about spatial interaction. After some research, it opted for a marker-less motion capture system (see, <a href="http://thecaptury.com/">The Captury</a>). It has successfully been used in education settings at <a href="https://www.uni-weimar.de/en/media/institutes/digital-bauhaus-lab/research-labs/performance-platform/">Bauhaus University Weimar</a> and <a href="https://intraspace.akbild.ac.at/">Academy of Fine Arts Vienna.</a> The system uses state of the art <a href="https://medium.com/tag/machine-learning">machine learning</a> technology (y’know that AI/ML stuff) to calculate full body skeletons (29 joints) from up to 3 movers in real time.</p><iframe src="https://www.instagram.com/p/BprfLS0AZhv/embed/?cr=1&amp;amp;rd=https%3A%2F%2Fwww.instagram.com" width="658" height="882" frameborder="0" scrolling="no"><a href="https://medium.com/media/4997f17ce2e0ae7ce7fb6cba197bd199/href">https://medium.com/media/4997f17ce2e0ae7ce7fb6cba197bd199/href</a></iframe><p>Recoding <em>Effect</em> pushed the system to its limit though. Classic motion capture (“mocap”) is mostly set up to record small chunks of movement that then is used for CGI or as movement samples in computer games. When recording a full ~60 minute dance piece that, of course, is not a good strategy because there is no way of splitting it up into recordable chunks to put it back together afterwards. When explaining the difference to classic mocap we like to compare our situation to a video documentary where one would just set up a camera and let it record opposed to a film set where one would record single scenes. For <em>Effect, </em>we had to exceed the spatial assumptions of the system to match the 8 x 8 meter dance area plus some extra space around it to capture dancers entering and leaving. Also recording 5 dancers at once is beyond what the system is used to “see”. After two longer test recordings, we found a camera setup that allowed us to get good recognition results and spent an additional month after the recording manually improving and re-tracking some parts of the movement data. The final result can be seen below.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fplayer.vimeo.com%2Fvideo%2F327452181%3Fapp_id%3D122963&amp;dntp=1&amp;url=https%3A%2F%2Fvimeo.com%2F327452181%2Fa92bfcc1c3&amp;image=https%3A%2F%2Fi.vimeocdn.com%2Ffilter%2Foverlay%3Fsrc0%3Dhttps%253A%252F%252Fi.vimeocdn.com%252Fvideo%252F771724226_1280x720.jpg%26src1%3Dhttps%253A%252F%252Ff.vimeocdn.com%252Fimages_v6%252Fshare%252Fplay_icon_overlay.png&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=vimeo" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/a95c25f624cd788bd75127b84a8a1ee9/href">https://medium.com/media/a95c25f624cd788bd75127b84a8a1ee9/href</a></iframe><h3>Effect Player</h3><p>During our <a href="http://choreographiccoding.org/labs/mainz-between-us-september-2018">first CCL</a> in the context of the <em>Between Us</em> project (September 2018), we found that participants had a hard time understanding the shape of the movement data, coping with the formats (bvh / fbx) and the amount of data we offered. Further labs and the exhibition needed something else to allow for low threshold and direct access to get people started quickly.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VqnKtK7rLuzc5oVU-oM7lA.png" /><figcaption>Screenshot of the Effect Player</figcaption></figure><p>We created a data player that can be downloaded and that holds the movement data and core annotations of one full run recorded November 2019. The “Effect Player” allows one to play back the movement data — similar to a video player — and study it through a simple 3D representation. At the same time it streams the data through two very popular and standard protocols: Open Sound Control (OSC) and WebSockets on the local machine. A simple filter system allows one to select what will be streamed, for example limiting it to one performer or just a selection of joints.</p><p>The player and data can be downloaded here: <a href="http://effect.motionbank.org/"><strong>effect.motionbank.org</strong></a></p><p>To get people started quickly we compiled a collection of examples using popular frameworks like Processing/P5.js, Three.js, A-Frame and others. As a side note I’d like to mention that for our own work at Motion Bank we stopped using most of these since core web technology like SVG already offers most of the functionality we need and integrates a lot better with our tool stack.</p><h3>Getting started</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/944/1*eguDxcGcyRoyIzx_v8pqdA.png" /><figcaption>A simple P5.js sketch showing a dot and a line</figcaption></figure><p>To get you started, let us walk you through a simple beginners example based on <a href="https://p5js.org/">P5.js</a>. It draws one joint of one performer as a dot with a trail … Wooohoo! Feel free to <a href="https://github.com/motionbank/effect-player-examples/tree/master/p5-js/beginner/001-simple-dot-trail">download</a> and hack it. For starters, I recommend using <a href="http://brackets.io/">Brackets</a> as code editor. You should also go and <a href="http://effect.motionbank.org/">download</a>, unzip and start the Effect Player now if you have not done so already. Then also d’load the effect data (same site), unzip and load that into the player.</p><p>There are a couple of aspects that you need to grasp:</p><ul><li>the framing consisting of HTML, CSS and a basic “P5 sketch” (JavaScript)</li><li>the part of the code that receives the data through WebSockets</li><li>how the data is being drawn</li></ul><p><strong>The framing</strong> is a simple HTML page with a tiny amount of CSS to reset some browser defaults and center the drawing area. It also includes the basics of a P5 sketch.</p><pre>&lt;!DOCTYPE html&gt;<br>&lt;html&gt;<br>&lt;head&gt;<br>  &lt;title&gt;Simple Dot Trail in P5&lt;/title&gt;<br>  &lt;script src=&quot;<a href="https://unpkg.com/p5@0.7.3/lib/p5.min.js">js/p5.min.js</a>&quot; defer&gt;&lt;/script&gt;<br>  &lt;script src=&quot;<a href="https://unpkg.com/osc@2.2.4/dist/osc-browser.min.js">js/osc-browser.min.js</a>&quot; defer&gt;&lt;/script&gt;<br>  &lt;script&gt;<br>    // ...<br>    function setup () {<br>       createCanvas( 800, 800 )<br>    }<br>    // ...<br>    function draw() {<br>      background( 235 )<br>      translate( width/2, height/2 )<br>      // ...<br>    }<br>    // ...<br>  &lt;/script&gt;<br>  &lt;style&gt;<br>   body {<br>     width: 100vw;<br>     height: 100vh;<br>     margin: 0;<br>     padding: 0;<br>     display: flex;<br>     align-items: center;<br>     justify-content: center;<br>   }<br>  &lt;/style&gt;<br>&lt;/head&gt;<br>&lt;body&gt;&lt;!-- P5 sketch goes here --&gt;&lt;/body&gt;<br>&lt;/html&gt;</pre><p>Next, we need to set up the sketch to <strong>receive the OSC data</strong> through the WebSocket connection of the player. First, the player needs to be configured to do so. Make sure you check “Send OSC packets” and also “Use WebSockets”. Uncheck “Send annotations over OSC” as we are not using them.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*Wv_FVejsRqX0gahTDeO1Lw.png" /></figure><p>The <strong>motion data</strong> — which is contained inside the player — consists of 5 skeletons, one for each performer, with 29 joints each. The recording is ~60 minutes long and was recorded with 50 frames per second. When playing one OSC message per joint and performer will be sent by the player at set frame rate (see “Skip frames” option). Since we are only interested in one single point you should now set the filter in the player to only send that: pick one performer (Amber) and one joint (Hips). The message that you will now receive has the following address signature: /&lt;PerformerName&gt;/&lt;JointName&gt; (i.e. /Amber/Hips) and will contain 7 float values. The first 3 of these are an absolute coordinate [X,Y,Z] (right-handed system) and the last 4 are a quaternion (that we ignore for now).</p><p>We are using a JavaScript library called osc.js as a middleman between the normal <a href="https://www.html5rocks.com/en/tutorials/websockets/basics/">WebSocket API </a>of the browser and our sketch.</p><pre>// we need a variable to store our data in </pre><pre>let positions = []<br><br>// then we set up the port for the player</pre><pre>const oscPort = new osc.WebSocketPort({<br>  url: &quot;ws://127.0.0.1:8888&quot;,<br>  metadata: true<br>})</pre><pre>// next we define a function to handle incoming messages</pre><pre>const onWebSocketMessage = function(message) {<br>  <br>  // console.log(message) will give something like:<br>  // message { <br>  //   address: &#39;/&lt;Perfomer&gt;/&lt;Joint&gt;&#39;, <br>  //   args: [ x,y,z, x,y,z,w ]<br>  // }</pre><pre>  // store the x,y part of the message in two handy variables ...<br>  // note that we are using Z as Y here to look at the stage <br>  // from atop<br>  <br>  const x = message.args[0].value / 10<br>  const y = message.args[2].value / 10</pre><pre>  // clip our positions array if it has too many values<br>  <br>  if (positions.length &gt; maxPositions) {<br>    positions = positions.slice(1) // remove first item<br>  }</pre><pre>  // now add the new x,y values as object to our array<br>  <br>  positions.push({x,y})<br>}</pre><pre>// finally we register our callback function</pre><pre>oscPort.on(&#39;message&#39;, onWebSocketMessage)</pre><pre>// ... and start listening</pre><pre>oscPort.open()</pre><p>The final part of our sketch is <strong>drawing the data</strong>. The dance floor that the piece was recorded on was 8 x 8 meters. All incoming coordinates are in millimetres (8000 x 8000) and are centered to that stage (-4000 x 4000). As you can see above we set our sketch to be 800 x 800 pixels and hence here are dividing all incoming values by 10 to make them fit (4000mm→400px). Drawing the data now is pretty simple …</p><pre>// using Processing/P5 &quot;drawing loop&quot;</pre><pre>function draw() {<br>  background(235)</pre><pre>  // translate to the center<br>  translate( width/2, height/2)</pre><pre>  stroke(0)<br>  noFill()<br>  for (let i = 1, k = positions.length; i &lt; k; i++) {<br>    const p1 = positions[i-1]<br>    const p2 = positions[i]<br>    line(p1.x, p1.y, p2.x, p2.y)<br>  }</pre><pre>  noStroke()<br>  fill(0)<br>  const last = positions.length-1<br>  ellipse(positions[last].x, positions[last].y, 10, 10)<br>}</pre><p>That is pretty much it. There are examples using other frameworks <a href="https://github.com/motionbank/effect-player-examples">available on Github</a> (and we are still working on more).</p><h3>Links</h3><p>→ <em>Between Us</em> <a href="https://betweenus.motionbank.org/">Online Score</a> and <a href="http://kunsthalle-mainz.de/de/exhibitions/archive/16">exhibition</a><br>→ <a href="http://choreographiccoding.org/">Choreographic Coding Labs</a><br>→ <a href="https://medium.com/motion-bank/motion-bank-at-hochschule-mainz-c89ef4a61643">Motion Bank</a></p><p><em>Between Us </em>is funded by the German Federal Cultural Foundation.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b0ab5501c069" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/choreographic-coding-effect-b0ab5501c069">Choreographic Coding Effect</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Shanghai Theatre Academy Workshop, October 2014]]></title>
            <link>https://medium.com/motion-bank/shanghai-theatre-academy-workshop-october-2014-f666ceae9ed3?source=rss----6079129e5f73---4</link>
            <guid isPermaLink="false">https://medium.com/p/f666ceae9ed3</guid>
            <category><![CDATA[dance]]></category>
            <category><![CDATA[annotations]]></category>
            <category><![CDATA[chinese-opera]]></category>
            <category><![CDATA[cultural-heritage]]></category>
            <category><![CDATA[education]]></category>
            <dc:creator><![CDATA[Scott deLahunta]]></dc:creator>
            <pubDate>Tue, 04 Dec 2018 05:29:46 GMT</pubDate>
            <atom:updated>2018-12-04T05:29:46.816Z</atom:updated>
            <content:encoded><![CDATA[<p><em>On 30–31 October 2014 Scott deLahunta and Florian Jenett, Co-Directors of Motion Bank, conducted an annotation workshop at the </em><a href="http://en.sta.edu.cn/"><em>Shanghai Theatre Academy</em></a><em>. The following is the report on this project.</em></p><p>Building on two previous dance digitisation projects of the choreographer William Forsythe<a href="#_ftn1">[1]</a>, Motion Bank completed its first research phase early 2014 with a diverse range of contemporary European and American choreographers including Deborah Hay, Jonathan Burrows &amp; Matteo Fargion, Bebe Miller and Thomas Hauert.<a href="#_ftn2">[2]</a></p><p>While this required Motion Bank to develop specific approaches corresponding to each of these individual artists, the project also created basic methods and systems that can be applied to any kind of dance or movement-based performing art. It was on this basis that Prof. Dr. Hans-Georg Knopp for the Shanghai Theatre Academy (STA) approached us in September 2013, with the proposal of applying these methods to Xiqu or Classical Chinese Opera, specifically to conduct an analysis of the movements of Xiqu taking into account the individual styles of the Masters.</p><p>Motion Bank research embraced computer-based technologies, but a key methodological development can be found in the form of an evolving understanding of the potential uses of annotation in dance, specifically how annotation can enhance the study and understanding of time based events. This understanding takes into account such components as time, sequence, marking, materials and publishing. Equally important is the preparation for annotation, which involves observing performance material (live or pre-recorded) and interviewing the artists to determine the appropriate categories, names and descriptions for key movement principles or events (e.g. use of the breath, eye movements, using the costume, etc.) to be annotated and commented on. This provides the beginnings of a shared vocabulary for the research process.</p><p>The hardware and software set up for the Motion Bank workshop was a lightweight video recording and annotation system that used 1 webcam, 3 static cameras (on tripods) and 1 following (close up) video camera. Live video annotation would be accomplished by using Piecemaker2 (PM2) based on software created by David Kern of The Forsythe Company for use during the company’s creations. PM2 is network based, meaning that several people can work together to annotate the same video material.</p><p>Our workshop was scheduled for 30–31 October 2014 to take place in the frame of the <em>Mediating Cultural Heritage Symposium</em> at the STA scheduled from 27 October through 1 November 2014. During planning sessions in August 2014, we agreed to arrive earlier to set up the recording space and observe the STA classes in Kunqu (one of the oldest forms of Xiqu and the one taught at the STA). Together with Tian Mansha, a renowned Xiqu performer and teacher at the STA, we would observe and select the performance material to be recorded and annotating during the two-day Motion Bank workshop. The goal of the <em>Mediating Cultural Heritage Symposium</em> was to explore “preservation, inheritance and innovative practice of culture heritage in the new era of technology”. The Motion Bank workshop was envisioned to provide a practical working scenario that could stimulate discussion on topics ranging from cultural heritage (Kunqu belongs to the world heritage programme of UNESCO) to new forms of creative work involving dancers and new media artists, to how these same artists might work together toward an educational goal.</p><p>During our visits to the Kunqu teaching sessions at the STA we observed teachers and students practicing the Xiqu roles they study at the STA including Sheng (male roles), Dan (female roles) and Jing (painted face male role). Based on these visits with the important support and advise of Tian Mansha, we were able to invite the Master/ Teacher Zhu Yufeng and one of his students, Guo Kaining to take part in the Motion Bank workshop. They would separately perform the Jing role of an outlaw or rebel in a horse-stealing scene, which they referred to as the “start of the second journey”. In addition, Tian Mansha gave us a lecture developed during her fellowship with the Berlin-based International research Center <em>Interweaving Cultures in Performance</em><a href="#_ftn3">[3]</a> that focused on “breath and mindfulness” in performance. Based on this lecture and in further discussions with Tian Mansha, we started to develop a shared vocabulary around the performance forms of Kunqu, and we came up with a number of key questions to ask during the recording and live annotation session, e.g. Is there an opening gesture? What are the eyes doing? Is this a movement convention? What is its name? etc.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*1EySzO44s9uJRrE4GwqO6A.jpeg" /><figcaption><em>Tian Mansha clarifying movement conventions at the STA workshop space. Credit: Chris Ziegler</em></figcaption></figure><p>The plan for the two days workshop involved using the Thursday morning to record the Jing material as performed by Zhu Yufeng and Guo Kaining. The Motion Bank workshop was attended by not only the STA professors and students involved in the <em>Mediating Cultural Heritage Symposium</em>; but also the foreign speakers specialising in interactive digital media, heritage and dance education research (Jeffrey Shaw, Ingo Diehl, Chris Ziegler and Henning Lobin). Each performance of the material took between 4 and 5 minutes, so it could be recorded several times. In the afternoon, we reviewed this recorded material with Zhu Yufeng, Guo Kaining and Tian Mansha (and with the invited public watching and commenting), interviewing all three drawing on the key questions and beginning to add markers to the material at significant points with short descriptions, e.g. 00:05 fast spinning of the belt in the 2nd Journey to show the character is speeding up, 00:33 using the eyes to search in the dark, etc.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*7rIqBBNjc8YgGYSyHJsjdQ.jpeg" /><figcaption><em>Student Guo Kaining performing Jing role at the STA workshop space. Credit: Chris Ziegler</em></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*B6JX7pqvwtEoIbM-IHz-RA.jpeg" /><figcaption><em>Teacher Zhu Yufeng performing Jing role at the STA workshop space. Credit: Chris Ziegler</em></figcaption></figure><p>That evening the Motion Bank team and two translators retired to the hotel rooms to review the interviews (which had been recorded) and continue adding markers and comments to the video material. Reviewing material repeatedly and refining annotations, building up layers of new information, is an important part of the Motion Bank approach. Through this process of study and adding annotations to the video time line, new insights emerge about the recorded material. Additionally, the material from the other four video cameras (3 static and 1 following) was uploaded to the network and prepared for the next day. The Chinese keyboard (Pinyin simplified) was installed in all computers to enable easy switching between languages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*gh0w_7z5r4wqcPI4H7Np1A.jpeg" /><figcaption><em>Piecemaker2 (PM2) annotation interface showing both English and Chinese annotations</em></figcaption></figure><p>On Friday morning, we presented the results from the evening before for discussion, debate and clarification and corrections from Zhu Yufeng, Guo Kaining and Tian Mansha, with comments and questions from the invited public. Following this process, we divided the whole workshop into three groups; each was assigned a computer to continue the analysis and annotation process (in Chinese). Each computer was accessing PM2 via the network, which meant the annotations of the three groups could be viewed on the same time-line, another important principle for the Motion Bank system enabling collective and collaborative annotation work to be done. This session was followed by an evaluation of the 1.5 days, during which the Master/ Teacher Zhu Yufeng confirmed he found this method extremely useful as a way of sharing and clarifying his teaching ideas. Reviewing video material is often done in class, but this method of reviewing specific moments, to be able to do this on-line and collectively seemed to offer a new way of studying and discussing this material.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*WszUdeDY19cQ7yhMowehww.jpeg" /><figcaption><em>Collaborative annotation session Friday morning at the STA workshop space. Credit: Chris Ziegler</em></figcaption></figure><p>At the end of the Motion Bank workshop on Friday afternoon, we showed results of projects completed with European choreographers that demonstrated the possibility of sharing dance knowledge with the public, but also included new forms of creation using digital media inspired by dance. Motion Bank was joined for this presentation by the digital artist and dance researcher, Chris Ziegler, who has been centrally involved in several dance digitisation projects, including the first project of the choreographer William Forsythe, <em>Improvisation Technologies</em>. Following this, the workshop moved to the Shanghai Virtual Performing Art Lab to start the <em>Mediating Cultural Heritage Symposium. </em>It was summarised here by the Lab Directors, Liu Zhixin and Zhang Jingping, that the experience of the Motion Bank workshop had opened up four areas of potential for them: 1. documentation, analysis and representation of a Kunqu opera for the public as an on-line resource; 2. development and use of Kunqu teaching tools; 3. development of creative work and creative collaborations between dance and digital media; 4. preservation of Kunqu as intangible cultural heritage.</p><p>In summary, Motion Bank successfully engaged the Chinese participants, students, teachers and specialists in Kunqu in a process of documentation and analysis supported by our lightweight technical set up. The participants themselves concluded that this process can be of benefit to Classical Chinese Opera education, but can also show the different approaches of the Masters. The workshop also stimulated the discussions and debates that would take place during the Symposium to follow. The two-day Motion Bank workshop had given us the opportunity to explore how much we could extend the discoveries made within the context of Western contemporary dance, to traditional dance forms from other cultures. It was an extremely rich experience and we thank all who made it possible.</p><p><a href="#_ftnref1">[1]</a> Improvisation Technologies: a tool for the analytical eye (Multimedia DVD) &amp; Synchronous Objects for One Flat Thing, reproduced (Interactive Website <a href="http://synchronousobjects.osu.edu)/">http://synchronousobjects.osu.edu)</a></p><p><a href="#_ftnref2">[2]</a> <a href="http://motionbank.org/">http://motionbank.org</a></p><p><a href="#_ftnref3">[3]</a> <a href="http://www.geisteswissenschaften.fu-berlin.de/en/v/interweaving-performance-cultures/">http://www.geisteswissenschaften.fu-berlin.de/en/v/interweaving-performance-cultures/</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f666ceae9ed3" width="1" height="1" alt=""><hr><p><a href="https://medium.com/motion-bank/shanghai-theatre-academy-workshop-october-2014-f666ceae9ed3">Shanghai Theatre Academy Workshop, October 2014</a> was originally published in <a href="https://medium.com/motion-bank">Motion Bank</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>