<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Liam Ferris on Medium]]></title>
        <description><![CDATA[Stories by Liam Ferris on Medium]]></description>
        <link>https://medium.com/@liamkferris?source=rss-472054ef2bcf------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*tUP7Ht0V_Xc9Ms-ZvoNGiw.png</url>
            <title>Stories by Liam Ferris on Medium</title>
            <link>https://medium.com/@liamkferris?source=rss-472054ef2bcf------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sun, 22 Nov 2026 01:04:39 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@liamkferris/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Kainos Sponsored Final Year Projects ]]></title>
            <link>https://medium.com/kainos-applied-innovation/kainos-sponsored-final-year-projects-2a1da9324233?source=rss-472054ef2bcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/2a1da9324233</guid>
            <category><![CDATA[software-development]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[innovation]]></category>
            <category><![CDATA[students]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <dc:creator><![CDATA[Liam Ferris]]></dc:creator>
            <pubDate>Wed, 19 Sep 2018 15:06:44 GMT</pubDate>
            <atom:updated>2018-09-27T10:04:40.217Z</atom:updated>
            <content:encoded><![CDATA[<p>I’m a software engineer working at <a href="https://www.kainos.com/">Kainos</a> in the <a href="https://medium.com/kainos-applied-innovation">Applied Innovation team</a>, we work with customers to use and develop tools beyond the immediate horizon to discover their business value. This involves researching emerging technologies, such as Artificial Intelligence, and their applications.</p><p>As part of our work we also work with universities &amp; ambitious students to push boundaries and to engage in interesting research, and interesting projects.</p><p>During the 17/18 academic year, myself and <a href="https://medium.com/u/abdae9593f6e">Jordan McDonald</a> mentored 4 students with 4 exciting <strong>final year projects</strong>. Find out about their work below!</p><h3>The Students 👨‍🎓👩‍🎓</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HsU5q7nry1JxWzzqm5nfvw.png" /><figcaption>Andrew Taylor | Claire Houston | Conor Murray | Brian Hamill</figcaption></figure><p>Each student completed a final year project with Kainos mentorship. All students involved received a first for their hard work — congrats all! 🎉🎉🎉</p><h3>The Projects 🎒📚</h3><h4>Project 1: 🚗 Virtual Reality — Hazard Perception Test</h4><blockquote><strong>Tech: </strong>Unity3D | Virtual Reality | Eye Tracking</blockquote><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgiphy.com%2Fembed%2F5n5QId0UCocN2Ekx4l%2Ftwitter%2Fiframe&amp;url=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2F5n5QId0UCocN2Ekx4l%2Fgiphy.gif&amp;image=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2F5n5QId0UCocN2Ekx4l%2Fgiphy-downsized-large.gif&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=giphy" width="435" height="244" frameborder="0" scrolling="no"><a href="https://medium.com/media/0ba61875476cee1ba4815ee78d3a0c9f/href">https://medium.com/media/0ba61875476cee1ba4815ee78d3a0c9f/href</a></iframe><p>One of <a href="https://www.kainos.com/kainos-dvsa-modernising-the-mot-testing-service/">Kainos’ biggest customers is the DVSA</a>. This project explored the use of simulations as a means to understand the real world. This is becoming a cost effective way to train AI-for example, <a href="https://www.technologyreview.com/s/602317/self-driving-cars-can-learn-a-lot-by-playing-grand-theft-auto/">teaching self driving cars using grand theft auto</a>.</p><p>Andrew’s project was a demonstration of how Virtual Reality (VR) could be used to simulate, record, and understand the current Hazard Perception test as well as the behaviour of a subject during a test.</p><h4>Project 2: 📑 Document Processing using Machine Learning</h4><blockquote><strong>Tech: </strong>Machine Learning | Natural Language Processing</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VoUUmGvakI0ssy4jTTr2xw.png" /><figcaption>Output for document analysis</figcaption></figure><p>Maturing AI tools and techniques are <a href="https://www.forbes.com/sites/bernardmarr/2018/05/23/how-ai-and-machine-learning-are-transforming-law-firms-and-the-legal-sector/#3d759ba032c3">transforming the legal industry</a>.</p><p>Claire’s project was a web application that performs file categorisation using Machine Learning and Natural Language Processing. A legal document is analysed and assigned a category, a summary and a mood description. These are all created using Machine Learning. Allowing for the document to be intelligently stored.</p><h4>Project 3: 🚁 Autonomous vehicle navigation planning using simulation tools</h4><blockquote><strong>Tech: </strong>Unity3D | Artificial Intelligence</blockquote><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgiphy.com%2Fembed%2Ft7DJstKHERWTVTqyfQ%2Ftwitter%2Fiframe&amp;url=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2Ft7DJstKHERWTVTqyfQ%2Fgiphy.gif&amp;image=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2Ft7DJstKHERWTVTqyfQ%2Fgiphy-downsized-large.gif&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=giphy" width="435" height="326" frameborder="0" scrolling="no"><a href="https://medium.com/media/0a9fc0b5a42fda5e5a08c848364fe8e3/href">https://medium.com/media/0a9fc0b5a42fda5e5a08c848364fe8e3/href</a></iframe><p><a href="https://ai.googleblog.com/2017/10/closing-simulation-to-reality-gap-for.html">Simulated training of AI systems</a> can be cost effective and used to train AI for real world scenarios.</p><p>Conor’s project was a simulation of a drone, it’s environment, and its visual input (lower half of the screen).</p><p>He developed data structures and algorithms to allow a simulated, or — theoretically — a real drone , to navigate autonomously.</p><h4>Project 4: 🔍 Using computer vision and object detection to achieve product placement in videos as a post effect.</h4><blockquote><strong>Tech: </strong>Artificial Intelligence | Computer Vision</blockquote><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgiphy.com%2Fembed%2F5ROlwjWJsc8DKxhC5R%2Ftwitter%2Fiframe&amp;url=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2F5ROlwjWJsc8DKxhC5R%2Fgiphy.gif&amp;image=https%3A%2F%2Fmedia.giphy.com%2Fmedia%2F5ROlwjWJsc8DKxhC5R%2Fgiphy-downsized-large.gif&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=giphy" width="435" height="244" frameborder="0" scrolling="no"><a href="https://medium.com/media/113bf145af9615169ea97e1cb30e4628/href">https://medium.com/media/113bf145af9615169ea97e1cb30e4628/href</a></iframe><p><a href="https://medium.com/kainos-applied-innovation/from-doodle-to-digital-extracting-features-from-hand-drawn-maps-131240e78bea">Video and image intelligence is becoming a commodity</a> and enabling a new generation of AI driven tools.</p><p>Brian’s project was to build a web application that could replace objects in pre-recorded videos with a different object, or the same object of a different brand.</p><h3>The Impact 🤜</h3><p>Outside of producing great final year projects, the student’s work has made even more of an impact. Andrew’s work has been the foundation for some collaborative innovation work between Kainos, Ulster University, and DVSA. Find out more about that <a href="https://twitter.com/KainosSoftware/status/1011236410496516101">here</a>. Claire and Brian took the opportunity to speak to the local Artificial Intelligence community about their work at a <a href="https://www.meetup.com/Artificial-Intelligence-Northern-Ireland/">Artificial Intelligence Northern Ireland Meetup</a>:</p><h3>iotanetwork on Twitter</h3><p>Students Claire and Brian @ai_ni_community</p><p>All of these projects have provided valuable insights for Kainos into emerging technologies, their value, and their applications. Additionally, these projects will all hopefully benefit the students as they bring their learning forward to their respective future employers.</p><h3>Get in touch 📩</h3><p>If you are a student interested in a project with Kainos, or generally interested in any of the above projects — get in touch at <a href="/service/mailto:FYP@kainos.com">FYP@kainos.com</a>. Looking forward to another set of exciting projects this year!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2a1da9324233" width="1" height="1" alt=""><hr><p><a href="https://medium.com/kainos-applied-innovation/kainos-sponsored-final-year-projects-2a1da9324233">Kainos Sponsored Final Year Projects 🎓</a> was originally published in <a href="https://medium.com/kainos-applied-innovation">Kainos Applied Innovation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Windows Mixed Reality: Building for World Scale?]]></title>
            <link>https://medium.com/kainos-applied-innovation/windows-mixed-reality-building-for-world-scale-eca57d875117?source=rss-472054ef2bcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/eca57d875117</guid>
            <category><![CDATA[innovation]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[vr]]></category>
            <category><![CDATA[tech]]></category>
            <dc:creator><![CDATA[Liam Ferris]]></dc:creator>
            <pubDate>Wed, 21 Feb 2018 12:01:18 GMT</pubDate>
            <atom:updated>2018-02-25T15:47:05.943Z</atom:updated>
            <content:encoded><![CDATA[<p>Can the Windows Mixed Reality platform support <a href="https://www.youtube.com/watch?v=67yLuiSfMWM">World Scale</a> tracking? If so, how do you build for it? Is it good? Is it simple?</p><p>Let’s find out.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgfycat.com%2Fifr%2FThirdGivingAzurevasesponge&amp;url=https%3A%2F%2Fgfycat.com%2FThirdGivingAzurevasesponge&amp;image=https%3A%2F%2Fthumbs.gfycat.com%2FThirdGivingAzurevasesponge-size_restricted.gif&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=gfycat" width="1184" height="1120" frameborder="0" scrolling="no"><a href="https://medium.com/media/0e6b05cbf40ad7f4984af9cfae89ad9c/href">https://medium.com/media/0e6b05cbf40ad7f4984af9cfae89ad9c/href</a></iframe><h3>Mixed Reality</h3><p>There’s been a lot of buzz about the new <a href="https://www.microsoft.com/en-us/store/collections/vrandmixedrealityheadsets">Windows MR headsets</a>, the <a href="https://developer.microsoft.com/en-us/windows/mixed-reality">Windows Mixed Reality Platform</a>, and their <a href="https://docs.microsoft.com/en-us/windows/mixed-reality/enthusiast-guide/tracking-system">Inside-Out Tracking</a>.</p><p>We’re looking to push the platform to its limits. We want to know what conditions allow for the best tracking. We want to know the maximum space we can successfully track. We want to know which headset does it best.</p><p>Onto the first question — Which headset is best?</p><h3>Headsets</h3><p>In <a href="https://kainos.com/">Kainos</a>, and with the <a href="https://www.digitalcatapultcentre.org.uk/project/immersive-lab/">DigiCat Immersive Lab</a>, we have access to three different WindowsMR headsets; <a href="https://www.microsoft.com/en-us/store/d/hp-windows-mixed-reality-headset-with-motion-controllers/8n5g0j1qf74b/5jp3?activetab=pivot%3aoverviewtab">HP’s</a>, <a href="https://www.microsoft.com/en-us/store/d/lenovo-explorer-windows-mixed-reality-headset-with-motion-controllers/8n5sn73q2xvg/0j0z?activetab=pivot%3aoverviewtab">Lenovo’s</a>, and Samsung’s <a href="https://www.microsoft.com/en-us/store/d/samsung-hmd-odyssey-windows-mixed-reality-headset-with-motion-controllers/8w91r774pdkk/9swg?activetab=pivot%3aoverviewtab">Odyssey</a>. The HP and Lenovo headsets feature a <strong>front hinged display</strong>, so you can flip the headset up while working. The Odyssey sports <strong>built in headphones</strong>, which means one less cable.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/892/1*Js72CcvAJMuIiz05NJtqqw.png" /><figcaption>HP // Lenovo // Samsung Odyssey</figcaption></figure><h4>Specs</h4><p><strong>Display: </strong>HP &amp; Lenovo - LCD. Odyssey - OLED.<br><strong>Resolution: </strong>HP &amp; Lenovo - 1440 x 1440. Odyssey - 2880 x 1600.<br><strong>FOV: </strong>HP &amp; Lenovo - 105°. Odyssey - 110°.<br><strong>Cost: </strong>HP - $449. Lenovo - $399. Odyssey - $499</p><p>The Odyssey out-specs the headsets in all aspects but cost, so it makes sense to use it for our testing.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DWvsde9Lfi2v0DyqbcBfKA.jpeg" /><figcaption>Samsung Odyssey</figcaption></figure><p>The term World Scale refers to tracking that isn’t limited. Where Room Scale is limited to a single room, World Scale should track anywhere in the world. If you still don’t quite get it <a href="https://www.youtube.com/watch?v=67yLuiSfMWM">here’s a video</a> that explains it well.</p><p>Now we’ve picked a headset, we need to figure out how to build for World Scale. No better place to start than the documentation.</p><h3>To the Docs!</h3><p>So microsoft.com, how do we do it?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/727/1*WbeCQ93g5i-lJSGFKfh7Pg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/661/1*_jaSKWpBKXIP5AnBPY_L3A.png" /><figcaption><a href="https://developer.microsoft.com/en-us/windows/mixed-reality/coordinate_systems">source</a></figcaption></figure><p><strong>On the left</strong>, the feature separating Room Scale and World Scale is something called spatial anchors. <strong>On the right</strong>, the feature separating Room Scale and World Scale again is spatial anchors but also “typically spatial mapping”. Whatever <em>typically</em> means.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/508/1*ewtHS7v9JIHSd-IUSmw4xw.png" /><figcaption><a href="https://developer.microsoft.com/en-us/windows/mixed-reality/coordinate_systems">source</a></figcaption></figure><p>This table show us that Immersive headsets support spatial anchors but don’t support spatial mapping. It’s hard to know what to make of this without understanding what those two terms mean.</p><h4>Spatial anchors</h4><p>According to the <a href="https://developer.microsoft.com/en-us/windows/mixed-reality/Coordinate_systems.html#spatial_anchors">docs</a> spatial anchors allow you to “<strong>mark important points in the world… that the system should keep track of over time</strong>”. Another <a href="https://developer.microsoft.com/en-us/windows/mixed-reality/spatial_anchors">page</a> talks about how “<strong>each anchor has a coordinate system</strong>”.</p><p>A spatial anchor acts as a point of reference in the real world. Which can be used to create virtual content that stays static in its position relative to the real world.</p><h4>Spatial mapping</h4><p>Spatial mapping provides a “<strong>detailed representation of real-world surfaces in the environment</strong>” according to the <a href="https://developer.microsoft.com/en-us/windows/mixed-reality/spatial_mapping">docs</a>. Only available on HoloLens, it turns the environment into a mesh which you can use to calculate collisions and perform surface detection among other things.</p><p>The above definitions, docs and diagrams don’t explain much. Especially how to use any of this. We’re going to need to find out for ourselves.</p><h3>Platforms</h3><p>Using Unity, there is two separate ways to build for the WindowsMR platform; using <a href="http://store.steampowered.com/steamvr"><strong>SteamVR</strong></a> or <strong>Windows Universal Platform</strong>…</p><p>Let’s do Pros &amp; Cons.</p><p><strong>SteamVR</strong><br>👍: Hardware agnostic. Built for Steam. Community support.<br>👎: Requires you to run Windows Mixed Reality portal anyway.</p><p><strong>Windows</strong><br>👍: Direct access to WindowsMR APIs.<br>👎: Windows headsets only.</p><p>I’m sticking with SteamVR. This means when running my application I will have Windows Mixed Reality Portal running as well as <a href="http://store.steampowered.com/app/719950/Windows_Mixed_Reality_for_SteamVR/">SteamVR for Windows</a>.</p><h3>Boundaries</h3><p>You can set up a boundary with the Mixed Reality Portal, you can also set up a chaperone with SteamVR. If we’re running both, what’s the best choice?</p><ul><li><a href="https://steamcommunity.com/games/250820/announcements/detail/1451710752575118590">SteamVR update</a> from 14/11/17 — “SteamVR’s Chaperone no longer renders when drivers provide their own (to avoid double rendering bounds).”</li><li><a href="https://steamcommunity.com/games/250820/announcements/detail/1455089183393702935">SteamVR update</a> from 22/11/17 — “Re-enabled ‘Floor bounds always on’ option for drivers which render their own bounds (e.g. Oculus, Windows MR).”</li></ul><p>Easy answer. WindowsMR boundary should take priority.</p><h4>How big a boundary?</h4><p>The boundary max size is given as 13ft x 13ft (~4m x ~4m for us civilised folk). Is that maximum given for each side? Is it based on area? Lets find out.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/320/1*2Z0uidkAxvDh8oKPHiU69w.png" /></figure><p><strong>Test 1: <br></strong>Make a boundary with a bigger area than 169ft².<br><strong>Result:</strong> ❌<br><strong>Observation:<br></strong>There is some size restriction being enforced.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/320/1*urIcLO5AFR23WbTECQyjBw.png" /></figure><p><strong>Test 2: <br></strong>Make a boundary with an area smaller than 169ft², but one side longer than 13ft.<br><strong>Result:</strong> ✅<br><strong>Observation:<br></strong>Maximum boundary is based off area.</p><h4>Do I really need a boundary?</h4><p>Good question. Why would you set up a boundary for World Scale that you plan to ignore? Without a boundary you still have 6DoF (6 degrees of freedom) and the differences in tracking with or without a boundary are unclear. I generally found tracking was better with a boundary, although that could be due to other factors.</p><p>It seems logical to at the very least assume setting up a boundary won’t make tracking <em>worse</em>, so lets do it.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgfycat.com%2Fifr%2FPoliteGlassBluefintuna&amp;url=https%3A%2F%2Fgfycat.com%2FPoliteGlassBluefintuna&amp;image=https%3A%2F%2Fthumbs.gfycat.com%2FPoliteGlassBluefintuna-size_restricted.gif&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=gfycat" width="1920" height="1080" frameborder="0" scrolling="no"><a href="https://medium.com/media/92a51c55db27c05fed3b2ecd51967781/href">https://medium.com/media/92a51c55db27c05fed3b2ecd51967781/href</a></iframe><h3>Tracking</h3><p>We need a large open space to properly put the tracking to the test. For this, we took our Odyssey to a warehouse (pictured above).</p><h4>Testing</h4><p>Our tests were conducted using an MSI laptop (1060, 16Gb RAM, i5). The laptop moved with the user on a rolling chair, and it remained plugged in with a extension cable daisy chain.</p><blockquote>➡️ <a href="https://gist.github.com/liamFerris/18720a9c6f8d0bd8af6ad6d024a226c2">Find our tests, measurements and results here</a>. ⬅️</blockquote><p>We tried different combinations of boundary placements and adding physical objects throughout the space to try and improve tracking quality.</p><h4>Results TL;DR</h4><ul><li>Moving the boundary (either close to the wall or further away) didn’t improve tracking.</li><li>Adding physical objects improved tracking.</li><li>Generally, tracking was consistent &amp; good enough to be used.</li></ul><p>The most interesting of the above points is that <strong>physical objects improve tracking</strong>.<strong> </strong>It makes sense, too. Physical objects give the cameras more points of reference to understand their environment. After numerous more tests (time lapsed at the top) we couldn’t find a way to optimise this or further understand how WindowsMR interprets the world. All we know is generally, <strong>more is better</strong>.</p><p>So we’ve learned some things. Although mostly, what we’ve learned is specifically what we don’t know…</p><h3>Unanswered Questions</h3><p>Here’s a list of the questions we were unable to answer. If anyone reading this blog knows the answer to any of the following, or could give advice on what to do or where to look,<strong> </strong>please <strong>comment below</strong>, <strong>message</strong>, or <strong>tweet</strong>! Any insight at all will be very much appreciated!</p><ol><li>Do different headsets have different tracking quality?</li><li>How exactly do you use spatial anchors for World Scale?</li><li>Is there a tracking advantage for either Windows platform or SteamVR?</li><li>Is a boundary advantageous to World Scale tracking? If so, can it be optimised?</li><li>How can we use physical objects to optimise tracking?</li></ol><p>Thanks for reading.<br><a href="https://twitter.com/liamkferris">@liamkferris</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=eca57d875117" width="1" height="1" alt=""><hr><p><a href="https://medium.com/kainos-applied-innovation/windows-mixed-reality-building-for-world-scale-eca57d875117">Windows Mixed Reality: Building for World Scale?</a> was originally published in <a href="https://medium.com/kainos-applied-innovation">Kainos Applied Innovation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Vive Tracker Overlay Project.]]></title>
            <link>https://medium.com/kainos-applied-innovation/vive-tracker-overlay-project-3ebc6a5e995b?source=rss-472054ef2bcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/3ebc6a5e995b</guid>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[unity]]></category>
            <category><![CDATA[htc-vive]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[vr]]></category>
            <dc:creator><![CDATA[Liam Ferris]]></dc:creator>
            <pubDate>Mon, 22 May 2017 13:10:32 GMT</pubDate>
            <atom:updated>2017-05-22T14:58:25.184Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*n4Ag1B7UOjN25j-t1Wx9uw.png" /></figure><p>In March 2017 I was lucky enough to get my hands on one of the first Vive Trackers.</p><p>Using the Tracker with <a href="https://www.leapmotion.com/">Leap Motion</a>, <a href="https://github.com/ValveSoftware/openvr/wiki/IVROverlay_Overview">OpenVR_Overlays</a> and a wireless microphone I built a tracked avatar.</p><p><strong>The problem</strong> is that when people are in VR they can’t see you, can’t hear you and can’t interact with you. <strong>The goal</strong> was to build a solution using the Vive Tracker to give demonstrators presence.</p><p>The first challenge was getting something to persist across any SteamVR experience. I knew this was definitely possible from resources like <a href="http://store.steampowered.com/app/586210/OVRdrop/">OVRDrop</a> - a pretty cool app that mirrors your desktop within SteamVR.</p><p>The <a href="https://github.com/ValveSoftware/openvr/wiki/IVROverlay_Overview">OpenVR Overlay</a> interface provides access to draw 2D images over the 3D scene no matter which application is running, this was used to build the first attempt:</p><h3>lukemcneicevr on Twitter</h3><p>So @SteamVR (Via openVR) supports @htcvive tracked objects from steam lobby right through *any* experience @liamkferris @KainosSoftware https://t.co/sUkSvvwYjF</p><blockquote>This demo was created with the following steps<br>1. Setup non-VR unity scene.<br>2. Use SteamVR scripts to track Tracker.<br>3. Build a cube using 6 2D planes around the Tracker<br>4. Directional audio from the location of the Tracker<br>5. Use OpenVR to overlay the planes</blockquote><p>This was pretty cool, although it was still 2D which seemed to be a limitation of the OpenVR Overlay API. Still, it was time to get creative…</p><p>I wanted a 3D overlay, and I knew that it was <em>possible</em>, I had seen <a href="http://www.triangularpixels.net/cms/development/worlds-first-vr-tracked-cat-vive-tracker-vr-pet-hacking/">Triangular Pixel</a>’s <a href="https://www.youtube.com/watch?v=6-VSvsqODBI">Tracker Cat video</a>. I just didn’t understand <em>how</em>.</p><p>After spending some time failing to use or understand the <a href="https://github.com/ValveSoftware/openvr/wiki/IVRCompositor_Overview">Compositor</a>, I thought of a w̶o̶r̶k̶a̶r̶o̶u̶n̶d solution. Instead of rendering a plane to world space, render it to screen space. Essentially cover the entire screen with a plane that renders a camera feed from another unity scene. Think of it like wearing an AR headset… in VR. Here’s a demo using the <a href="https://www.leapmotion.com/">Leap Motion</a>:</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fgfycat.com%2Fifr%2FDeliriousFluidConch&amp;url=https%3A%2F%2Fgfycat.com%2Fgifs%2Fdetail%2FDeliriousFluidConch&amp;image=https%3A%2F%2Fthumbs.gfycat.com%2FDeliriousFluidConch-size_restricted.gif&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=gfycat" width="1897" height="934" frameborder="0" scrolling="no"><a href="https://medium.com/media/19e7214828d7b7d789712c6bbb641d9b/href">https://medium.com/media/19e7214828d7b7d789712c6bbb641d9b/href</a></iframe><blockquote>This demo was created with the following steps<br>1. Setup non-VR unity scene<br>2. Use SteamVR script to track HMD<br>3. Attach camera to HMD<br>4. Incorporate Leap Motion asset, as a child of the HMD<br>5. Set the HMD camera’s target texture to a render texture<br>6. Use OpenVR to overlay the render texture<br>HMD* (head-mounted-display)</blockquote><p>This irony was that the second attempt was actually much simpler than the original, it was also much better. It felt really good.</p><p>Now that I understood how to do get a ‘3D overlay’ it was time to reincorporate the Tracker. I stuck the Tracker and the Leap Motion onto a headset, and built in some directional audio:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/480/1*i1IykBgkLQAEhlI3s18zCg.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-hGOpF5dNjUb5bUWm8nAZQ.jpeg" /><figcaption>Tracker &amp; Leap Motion overlaid in Tilt Brush // Physical Setup</figcaption></figure><blockquote>This demo was created with the following steps<br>1. Setup non-VR unity scene<br>2. Use SteamVR script to track HMD attached to a camera<br>3. Use SteamVR script to track Tracker attached to gameobject with hat model<br>4. Directional audio from the location of the Tracker<br>5. Incorporate Leap Motion asset, as a child of the Tracker<br>6. Set the HMD camera’s target texture to a render texture<br>7. Use OpenVR to overlay the render texture</blockquote><p>This setup has vastly improved giving <strong>demos</strong>, as it’s much easier to be heard and seen. The setup also helps when <strong>introducing</strong> people to VR by mitigating <em>“VR-shyness” -</em> where people are reluctant to move, look around or engage with the environment at all.</p><p>I’ve put the project on Github. <a href="https://github.com/KainosSoftwareLtd/VRSceneOverlay">Check it out here</a>.</p><p>So there we have it. A solution that can integrate into <strong>any VR experience</strong>, creating an avatar with a <strong>tracked head</strong>, <strong>tracked hands </strong>and <strong>directional audio</strong>.</p><p>Hopefully people will stop bumping into me now.</p><p><a href="https://github.com/KainosSoftwareLtd/VRSceneOverlay">Project on Github</a> // <a href="https://medium.com/@liamkferris/prototyping-in-vr-4-things-ive-learned-f1d7e979d2ec">Previous blog</a> // <a href="https://twitter.com/liamkferris">@liamkferris</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3ebc6a5e995b" width="1" height="1" alt=""><hr><p><a href="https://medium.com/kainos-applied-innovation/vive-tracker-overlay-project-3ebc6a5e995b">Vive Tracker Overlay Project.</a> was originally published in <a href="https://medium.com/kainos-applied-innovation">Kainos Applied Innovation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Prototyping in VR: 4 things I’ve learned.]]></title>
            <link>https://medium.com/kainos-applied-innovation/prototyping-in-vr-4-things-ive-learned-f1d7e979d2ec?source=rss-472054ef2bcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/f1d7e979d2ec</guid>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[htc-vive]]></category>
            <category><![CDATA[design]]></category>
            <category><![CDATA[vr]]></category>
            <dc:creator><![CDATA[Liam Ferris]]></dc:creator>
            <pubDate>Mon, 10 Apr 2017 10:48:01 GMT</pubDate>
            <atom:updated>2017-04-10T18:13:28.975Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5LZGWSbfLZdSWqcnKwjm5g.jpeg" /></figure><blockquote>I’m Liam Ferris, a software engineer working in Virtual Reality <a href="https://twitter.com/KainosSoftware">@</a>K<a href="https://twitter.com/KainosSoftware">ainosSoftware</a>. At SXSW this year we launched “<a href="http://vrni.org.uk/">retne</a>”, a VR experience built for the HTC Vive. <a href="https://www.kainos.com/appliedinnovation">Retne</a> is an immersive adventure produced by artist <a href="https://twitter.com/deepamann_kler">@deepamann_kler</a>.</blockquote><p>Designing for VR is hard. Our intuition can’t be trusted. Our intuition is built from things like film, UX and games design; which are all very different than VR. There’s only one way to know if an idea <em>works</em> in VR — you have to try it.</p><p>So, try stuff. Learn what works and what doesn’t. It’ll make your VR application better, and it will improve your VR intuition. Here are 4 things I’ve learned about VR prototyping.</p><h3>1. Stand on the shoulders of giants</h3><blockquote>Lots of smart people are building stuff, and lots already have. If it’s available to you, why not use it?</blockquote><p><strong>Look for VR UX research<br></strong>For example Owlchemy Labs, creators of Job Simulator coined the term ‘Tomato presence’ in their <a href="https://www.youtube.com/watch?v=hjc7AJwZ4DI">research</a>. It’s the process of making the controller/hand disappear when you pick something up. This feels natural in VR, it reinforces that the controller is currently tracking an object. We used this principle in retne.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vOoIHXFGHIBs980LT5HCEA.jpeg" /><figcaption>Tomato presence in action</figcaption></figure><p><strong>Play good VR, </strong>try to identify what makes it good. <br>‘Henry’, the Oculus VR movie <a href="https://www.engadget.com/2015/07/29/henry-oculus-story-studio-vr/">uses</a> <a href="http://www.thedailybeast.com/articles/2015/07/30/watching-the-first-oculus-rift-virtual-reality-movie-henry.html">eyes</a> <a href="http://www.vrinflux.com/the-basics-of-virtual-reality-ux/">to</a> create an emotional connection with a character. This fed into our decisions while designing Lil’ Mo, retne’s main character.</p><p>During SXSW, the best VR experience I saw was Chocolate; a fantastic, incredibly weird cat-themed music experience. During Chocolate, to the rhythm of the techno music, flying cats turn and make eye contact with you… and it felt awesome. This was nice validation that eye contact in VR is effective.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/780/1*Gaiho05btmKBKg7toVjJEg.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*67H2ZhHF1OskhDTPNHNG7w.jpeg" /><figcaption>Eye contact in VR</figcaption></figure><p>Try to<strong> find open source projects</strong>, check the asset store. Use anything that could speed up prototyping.</p><p><a href="https://github.com/keijiro">Keijiro takahashi</a> is a unity developer, he also has more open source github projects than there are atoms in the universe. He’s built really cool <a href="https://github.com/keijiro/Skinner">motion effects</a>, <a href="https://github.com/keijiro/KvantSpray">particle effects</a> and <a href="https://github.com/keijiro/PostProcessing">post processing effects</a>. We used a bunch of these to prototype in VR.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/320/1*6gJLaQVBpkapOxutcUvD3A.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/320/1*0UJ2s-D1Lyc07azC98j7xA.gif" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/320/1*3tyqx6WfG7fZLDDzjdltbQ.gif" /><figcaption>The legend also answered our questions</figcaption></figure><h3>2. Criticise</h3><blockquote>After trying stuff the next step is feedback.</blockquote><p>VR is so novel that feedback from anyone not saturated in it will give <strong>false positives</strong>. If you get feedback from a VR noob, they are going to tell you it’s awesome. But what they really mean is <em>VR is awesome</em>.</p><p><strong>Tunnel vision</strong> is also a problem. Sometimes you can be so in love with an idea that you can’t see that it doesn’t work. For example, in retne there’s a level where you are in space on an asteroid.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/980/1*0x2aqdzK6y_86KTLuWSS8A.jpeg" /><figcaption>Mario galaxy planet</figcaption></figure><p>When we were prototyping this we came up with an idea we all loved; a Mario Galaxy style playing space, where the player could walk freely around the asteroid.</p><p>We built it and thought it was excellent, you can even do some really cool non-euclidean geometry puzzles. Although when we got play-testers to try it out the feedback was that it made everyone feel sick. So we cut it. ¯\_(ツ)_/¯</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/399/1*rS7aeklS-8YWY1_xWQ6PnA.gif" /><figcaption>Triangle with three right angles</figcaption></figure><p>A good VR play-tester has the following characteristics:</p><ul><li>Has VR experience. If no one like this is available to you, find some people and show them good VR.</li><li>They have to be outside of the day-to-day team.</li><li>They have to be ready to hurt your feelings.</li></ul><h3>3. Affordance</h3><blockquote>Clues about how objects can be used.</blockquote><p>From watching people in VR it’s surprising how goal driven we are. People won’t explore unless you explicitly or contextually make it their goal. So the challenge for VR design is that at any moment you have to be able to answer the question “What do I do to move forward?”. Confusion is the enemy.</p><p>You are in control of the player’s sight, sound and touch (still waiting on you, Smell-O-Vision) and because of this you are obligated to use <strong>all of them</strong>.</p><p><strong>Visual affordance</strong><br>Making objects glow, sparkle and vibrate will attract the users attention.</p><p><strong>Audio affordance<br></strong>Sound effects show the user that something is going on. Or after an interaction it confirms that they have done something. 3D audio helps users spatialise and can direct them to something outside of their field of view.</p><p><strong>Haptic affordance<br></strong>Make objects tactile. It confirms to the user that they can do something with an object.</p><h3>4. The fidelity contract</h3><blockquote>Meeting natural and set expectations.</blockquote><p><a href="http://zanytomato.tumblr.com/post/140725769440/the-fidelity-contract-in-vr">The fidelity contract</a> is a set of unspoken rules that defines how every interaction works. This doesn’t necessarily mean we have to only design realistic interactions, we can still create engaging experiences that are unnatural as long as it’s perceived to be consistent in the world we’ve created.</p><p><strong>An example of a natural expectation</strong><br>When the user drops an object it should fall to the floor.<br><strong>An example of creating a new expectation</strong><br>When the player drops an object it <em>falls up</em>.</p><p>Both examples are perfectly good ideas for a VR experience. However, if some objects <em>fall down</em> and some <em>fall up</em>, in a way the user couldn’t determine you would be in violation of the fidelity contract. <a href="https://i.imgflip.com/1mztij.jpg">That’s how you get confused users</a>.</p><p>You need to consider if you are honouring this contract in every decision. This extends to creating an interactivity base line. For example if you only want the player to interact with a single object, preventing interaction with everything else would break the contract.</p><p>If you are watching someone play-test your VR experience and you find yourself thinking “They are doing this wrong”, what you should be thinking is “I designed this wrong”.</p><h3><strong>Conclusion</strong></h3><p>VR design is hard. You’re going to be wrong more than you’re right. But that’s okay — be clever, be creative, be curious.</p><p>More about <a href="https://www.kainos.com/appliedinnovation">retne</a> // <a href="https://twitter.com/liamkferris">@liamkferris</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f1d7e979d2ec" width="1" height="1" alt=""><hr><p><a href="https://medium.com/kainos-applied-innovation/prototyping-in-vr-4-things-ive-learned-f1d7e979d2ec">Prototyping in VR: 4 things I’ve learned.</a> was originally published in <a href="https://medium.com/kainos-applied-innovation">Kainos Applied Innovation</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>