<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Jon Wade on Medium]]></title>
        <description><![CDATA[Stories by Jon Wade on Medium]]></description>
        <link>https://medium.com/@asjonish?source=rss-21fedb79bb41------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*oV0N9o6nE2teEtK8.</url>
            <title>Stories by Jon Wade on Medium</title>
            <link>https://medium.com/@asjonish?source=rss-21fedb79bb41------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 00:16:34 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@asjonish/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Expo: Towards Rapid VR Prototyping]]></title>
            <link>https://medium.com/shopify-vr/expo-towards-rapid-vr-prototyping-15356d53ea71?source=rss-21fedb79bb41------2</link>
            <guid isPermaLink="false">https://medium.com/p/15356d53ea71</guid>
            <category><![CDATA[vr]]></category>
            <category><![CDATA[design]]></category>
            <category><![CDATA[ux]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[shopify]]></category>
            <dc:creator><![CDATA[Jon Wade]]></dc:creator>
            <pubDate>Tue, 31 Oct 2017 16:07:21 GMT</pubDate>
            <atom:updated>2024-07-11T16:52:53.448Z</atom:updated>
            <content:encoded><![CDATA[<p>VR development is exciting, in part because of the immense, unexplored territory for creating usable, engaging, and delightful experiences. However, in these early days our ability to predict which ideas will turn into great experiences is still maturing and can often be wrong.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*zEKQSELPrC7alwlyDm8J4A.png" /><figcaption>Whiteboard during <a href="https://medium.com/shopify-vr/introducing-thread-studio-shopifys-first-vr-app-73cc0a181205">Thread Studio </a>production. Not ideal for VR!</figcaption></figure><p>Our team has experienced this faulty forecasting first-hand. We brainstorm, whiteboard and pantomime many intriguing ideas. We filter them down to what we think is most promising and invest time into building usable prototypes. The outcomes can take us by surprise. What was imagined as a sure-fire idea reared unexpected problems, while minor or gimmicky sounding features provided delights worth keeping.</p><h3>Enter Expo 🎪</h3><p>After several cycles of development, it became clear that getting our process into VR as early as possible was essential. This was difficult to do within the landscape of VR tooling. So, at the beginning of 2017, we began developing features for early-stage VR prototyping in a tool named “Expo.”</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*eqyed6A_wfzMo045eNejHg.png" /><figcaption>A standard, leg-free work day for the <a href="https://medium.com/shopify-vr">VR team</a> at Shopify</figcaption></figure><p>Expo is an <a href="https://www.unrealengine.com/">Unreal</a> template containing starter code and assets that allows us to jump into VR within minutes of creating a new project. We can quickly produce visual representations of our ideas and perform standard VR interactions, all within a collaborative setting.</p><h3>Expo Features</h3><h4>Marker</h4><p>The core brainstorming tool in Expo is the marker. The marker affords 3-D drawing with basic customization of size and color. Once a drawing is completed it becomes a physical object in the world that can be picked up, moved, duplicated, and pinned to a player avatar.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FmBW3Zc6%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FmBW3Zc6&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="674" frameborder="0" scrolling="no"><a href="https://medium.com/media/d26eb16296f803b1e87749a193bff789/href">https://medium.com/media/d26eb16296f803b1e87749a193bff789/href</a></iframe><h4>Rich avatars</h4><p>To explore the nuances of social VR and to express our identity, each of our team members has an avatar in Expo. The avatars support a number of expressive features. The faces include voice-driven lips and synthesized, but believable, eyebrow movement and blinking. Hands support the vocabulary of gestures provided by the Oculus Touch and we are extremely excited to incorporate the finger tracking supported by <a href="https://www.youtube.com/watch?v=FCkD5aM3AwQ">Valve’s “Knuckles”</a> controllers when we get them.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FSOYE4CJ%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FSOYE4CJ&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="834" frameborder="0" scrolling="no"><a href="https://medium.com/media/9a0d5fcea6535c8a394ece90e01aa07e/href">https://medium.com/media/9a0d5fcea6535c8a394ece90e01aa07e/href</a></iframe><h4>Wizards of Oz</h4><p>Avatars can choose to turn invisible at any time while retaining the ability to manipulate objects and talk. This serves as great way to do “Wizard of Oz” prototyping. When testers interact with elements that would require logic and animation, one or more invisible agents can act out that behaviour instead.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FEgquprR%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FEgquprR&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="674" frameborder="0" scrolling="no"><a href="https://medium.com/media/f2658c9b69e8538d0fdb9bd278cbe1e7/href">https://medium.com/media/f2658c9b69e8538d0fdb9bd278cbe1e7/href</a></iframe><p>Similar to paper prototyping and other techniques, this allows usability testers to interact with an experience closer to our intended output, but before significant development effort is spent.</p><h4>Scaling</h4><p>A more recent addition to Expo is the ability to dynamically scale the size of our avatars. It has a been a surprisingly useful feature for creativity. At a large scale a user can draw full rooms and spaces in an ergonomically friendly way. At a miniaturized scale small objects can be produced in fine detail. For example, one team member created a jewelry store for a brainstorming session with highly detailed rings.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FlaFJRqZ%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FlaFJRqZ&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="674" frameborder="0" scrolling="no"><a href="https://medium.com/media/1a1f238883049bf007aa626098580349/href">https://medium.com/media/1a1f238883049bf007aa626098580349/href</a></iframe><h4>The Web in VR</h4><p>We have incorporated the awesome <a href="https://github.com/AaronShea/BLUI">BLUI Plugin</a> into Expo. With it we can display HTML content and browse the web from within VR. A huge benefit is the ability to bring external docs into VR, be it an issue tracker from GitHub or a user-flow script from Google Docs. The browser preserves the real-time collaboration features of these tools, allowing people outside of VR to make changes that are immediately reflected in VR.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2F5WvdTWO%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D640&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2F5WvdTWO&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="640" height="554" frameborder="0" scrolling="no"><a href="https://medium.com/media/904873a0f73068996001bab77b3b87ab/href">https://medium.com/media/904873a0f73068996001bab77b3b87ab/href</a></iframe><p>We expect the bridge between the 2-D web and VR to create other magical results in the near future.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FGxNtH38%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FGxNtH38&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="674" frameborder="0" scrolling="no"><a href="https://medium.com/media/43b649bcaf4af2727050f12462ce2a4c/href">https://medium.com/media/43b649bcaf4af2727050f12462ce2a4c/href</a></iframe><p>In our experience, anything that keeps us from having to remove the VR headset is a win for development speed. We are looking forward to the recently announced <a href="https://www.oculus.com/blog/introducing-rift-core/">Oculus Dash</a> platform that will allow us to debug code and perform other 2-D desktop-bound tasks within the VR headset.</p><h4>Session Recording</h4><p>Expo’s components are built with multi-user networking in mind and leverage Unreal Engine’s network replication. As a tremendously useful by-product, we are able to take advantage of <a href="https://docs.unrealengine.com/latest/INT/Engine/Replay/">Unreal’s replay recording &amp; playback</a> functionality. More powerful than mere video recording, replay recording allows us replay a scene from any angle, whether from an interactive camera or from the perspective an any person (or thing!) that was a part of the scene.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2Fqq63I6D%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2Fqq63I6D&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="674" frameborder="0" scrolling="no"><a href="https://medium.com/media/ae77b63703304a41c2656cf2bd18f223/href">https://medium.com/media/ae77b63703304a41c2656cf2bd18f223/href</a></iframe><p>Further, we can touch-up art and sounds post-recording and replay the performance. This has been a tremendous help in creating videos, GIFs, and exemplary content to share with others, while also documenting our explorations. Because Unreal engine is a multi-platform engine, these replays can be viewed in numerous ways: in VR, in a regular 2-D window or even on mobile devices. This functionality was used to produce all the videos/images for this post!</p><h3>How We Use Expo</h3><p>We use Expo both as a starting point for projects and as a tool for ideation and prototyping of new ideas. The tools organically support the entire project life-time, from being the first-step creative tool during brainstorming, to annotating and communicating required changes in the final stages of a project.</p><p>For ideation, the team will often jump in a half-hour session and ponder a single aspect of the VR commerce experience. For example, “What are different ways to manage a ‘shopping cart’ in VR?” Each team member gets their own semi-private space where they can explore and build ideas in the quantity or depth they choose. When time is up, we work our way down the row letting each member of the team show-and-tell.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2F2zxZKZr%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D640&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2F2zxZKZr&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="640" height="366" frameborder="0" scrolling="no"><a href="https://medium.com/media/cbf5d6e0ddc4e70fe884ec3d7bc3953a/href">https://medium.com/media/cbf5d6e0ddc4e70fe884ec3d7bc3953a/href</a></iframe><p>This process in Expo has provided benefits beyond its use as a tool. The rapid expression and exploration of ideas in VR has allowed us to more effectively communicate.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FxNW9AFd%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D640&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FxNW9AFd&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="640" height="554" frameborder="0" scrolling="no"><a href="https://medium.com/media/9b282e68d50b0d3050b85d92fa7f0095/href">https://medium.com/media/9b282e68d50b0d3050b85d92fa7f0095/href</a></iframe><p>Our explorations in Expo has lead to meaningful team bonding. Similar to ice-breaker exercises for sprints, it’s not uncommon to start a week with a VR warm-up where we goof on silly scenarios or doodle outlandish outfits and scenes for each other.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZJzBR_6CplJP7c3LbSwDDQ.png" /><figcaption>Some ideas can only be communicated using the power of VR</figcaption></figure><h3>Start Prototyping in VR Now</h3><p>We developed Expo because the tools for collaborative prototyping did not exist at the start of this year. Since then, the landscape has dramatically improved and there are many tools providing prototyping workflows with no requirement to do your own development:</p><ul><li><a href="https://www.facebook.com/spaces">Facebook Spaces</a> and <a href="https://steamcommunity.com/games/250820/announcements/detail/1256913672017157095">SteamVR Home</a> allow teams to create quick doodles and play with props together.</li><li><a href="https://www.masterpiecevr.com/">MasterpieceVR</a> has professional-grade sculpting tools and the critical feature of multi-user interaction.</li><li><a href="https://mindshow.com/">Mindshow</a> allows a single user to pantomime and record avatars and objects interacting to create shareable vignettes.</li></ul><p>In addition to these released tools, the development of tools aimed at VR UX professionals is well under way and should surface with time and industry growth.</p><p>Our team has already experienced a great return on investment from VR prototyping that is simple, sociable, and shareable. We encourage everyone to find tools to accelerate their prototyping and make team communication faster and more fun.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fimgur.com%2FDpHnHFj%2Fembed%3Fpub%3Dtrue%26ref%3Dhttps%253A%252F%252Fembed.ly%26w%3D854&amp;display_name=Imgur&amp;url=https%3A%2F%2Fimgur.com%2FDpHnHFj&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=imgur" width="854" height="834" frameborder="0" scrolling="no"><a href="https://medium.com/media/ff50c61644edd41a420f28318d2b1ea2/href">https://medium.com/media/ff50c61644edd41a420f28318d2b1ea2/href</a></iframe><p><em>Have your own great prototyping and brainstorming workflows in VR? Let us know in the comments below!</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=15356d53ea71" width="1" height="1" alt=""><hr><p><a href="https://medium.com/shopify-vr/expo-towards-rapid-vr-prototyping-15356d53ea71">Expo: Towards Rapid VR Prototyping</a> was originally published in <a href="https://medium.com/shopify-vr">Shopify AR/VR</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A Year’s Journey in Motion Controls]]></title>
            <link>https://medium.com/shopify-vr/a-years-journey-in-motion-controls-4d6a5398ecfb?source=rss-21fedb79bb41------2</link>
            <guid isPermaLink="false">https://medium.com/p/4d6a5398ecfb</guid>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[steamvr]]></category>
            <category><![CDATA[oculus-rift]]></category>
            <category><![CDATA[htc-vive]]></category>
            <category><![CDATA[ux]]></category>
            <dc:creator><![CDATA[Jon Wade]]></dc:creator>
            <pubDate>Fri, 23 Dec 2016 20:15:32 GMT</pubDate>
            <atom:updated>2016-12-23T20:15:32.308Z</atom:updated>
            <content:encoded><![CDATA[<p>From necessities like eating to recreational tasks like playing games, we depend on our hands to grip, point, push, pinch and tap everyday objects. It’s the duty of VR motion controllers to simulate our most fundamental manipulations of the world around us. They have a lot to get right.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Erw4bwx257jgKtfzzNfChQ.png" /></figure><p>Earlier this month the Oculus Touch controllers launched for the Rift. Their launch provides an opportunity to recap our journey working with both the Touch and Vive motion controllers over the past year and to discuss some directions in our thinking about manipulation and interaction in VR.</p><h3>The Vive Arrives</h3><p>It’s hard for me to believe it was only a year ago that I had my first long stretch of time with a Vive DK1. In the year since, the Shopify VR team has logged hundreds of hours on the Vive experimenting, running usability tests, and enjoying community content.</p><p>A rapid-fire snapshot of our experiences with the Vive motion controllers:</p><ul><li>Lighthouse is a stable and robust tracking system. We’ve used it in a wide variety of environments and rarely had troubles.</li><li>The trackpad is versatile, but rarely exercises its full capabilities. We like that it affords swiping, directional movement, and four unique buttons, but it regularly becomes, “The big teleport button.”</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1010/1*8yXj90tk1LgJONdOoKZPCQ.png" /><figcaption>Track pad use in Tilt Brush, Google Earth, and Thread Studio</figcaption></figure><ul><li>The finger trigger is the most logical pickup/grab input. Unfortunately, many new users tend to squeeze the whole controller to pick things up, leading to the trackpad and the side grips being pressed. If an experience uses the trackpad for teleportation, like in <a href="https://medium.com/shopify-vr/introducing-thread-studio-shopifys-first-vr-app-73cc0a181205#.6c0t42y43">Thread Studio</a> or <a href="http://store.steampowered.com/app/450390/">The Lab</a>, this can lead to the user unintentionally teleporting all over the place.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*K9HFOw2pgcGbFxOyp_JBEg.png" /><figcaption>Some grips involve applying pressure from the fingers and thumb</figcaption></figure><ul><li>The top menu button is inconveniently located if you have to use it often, especially for users with small hands.</li><li>The side grip buttons are essentially useless for gripping. Holding them down while trying to use other inputs tends to strain your hand. They also get pressed or released by accident during quick movements. They can work well for non-grip actions, like rotating the world in <a href="http://store.steampowered.com/app/269170">SportsbarVR </a>or enabling swing-to-walk in <a href="http://store.steampowered.com/app/520010/">Climbey</a>.</li><li>User testing revealed that trying to use one input while holding down another was difficult for many people.</li></ul><h4>Picking Up is Paramount</h4><p>VR from Shopify is designed for a wide audience. Our audience may not be familiar with game controllers and is probably new to VR. In our experiments, the more controller inputs we assigned functionality to, the more difficult it became to learn and enjoy those experiences.</p><p>After numerous rounds of user testing, we made a radical pivot in our design philosophy. We challenged ourselves to start with an extremely minimalist control scheme: could we build our apps using only the trigger? Working from that starting point we ended up with:</p><ol><li>Grabbing is the core action. The finger trigger only picks up and releases objects and is <em>never</em> used for anything else.</li><li>Movement mechanics, like teleport, are handled using a different input.</li></ol><p>We were able to create a huge amount of content using two inputs. Though it partially went against the first guideline, the trigger/pickup input was also used to interact with floating UI elements.</p><p>However, with time we found ourselves creating objects that required being activated once held. Spray paint cans and power drills belong to this category. In attempting to keep control mappings approachable for a wide audience, these objects became surprisingly difficult to implement:</p><ul><li>The trackpad was our teleport button and we didn’t want to map it to a second role.</li><li>Testers routinely let go of the finger trigger when trying to press the menu button.</li><li>Using the side grip button to activate an object often flipped real world conventions. You hold a spray bottle with your palm and use your pointer finger to pull the trigger, not the other way around.</li></ul><p>We quickly found ourselves having to constantly debate input layout. I felt our lives as developers would have been much easier had the Vive’s side grips been usable for holding on to objects…</p><h3>Enter the Oculus Touch</h3><p>In the summer, just as we were making the above conclusions, our first Touch developer kit arrived. Having spent so much time with the Vive, the Touch took getting used to, but I now prefer the Touch layout and ergonomics:</p><ul><li>The buttons are more accessible than the Vive’s menu button. Distinguishing between the physical buttons is more natural than distinguishing between regions of the Vive trackpad.</li><li>The separate grip and use triggers easily affords the hold-then-use objects we had difficulty implementing on the Vive. Pressing the use trigger while holding down the grip is effortless.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PUACQHJsebG0GvGgYGdHmw.jpeg" /><figcaption>The Oculus Touch</figcaption></figure><p>That’s not to say the touch is universally the better motion controller:</p><ul><li>Throwing objects, one of the most entertaining things to do in VR, is awkward on the Touch. I often hesitate to let go of the grip trigger because I fear I’ll send the Touch flying.</li><li>It’s yet to be seen if the joystick can fill as many roles as the Vive track pad. While better for directional movement, gestures for swiping or clock-rotation motions are less satisfying.</li><li>The Oculus Constellation tracking system can work really well, but I still give the edge to the Vive’s lighthouse system in both consistency and robustness. As a developer I also prefer the floor-origin coordinate system of SteamVR.</li></ul><h4>The Capacity for So Much More</h4><p>It took me too many months to really discover the Oculus Touch’s killer differentiator. It’s the capacitive touch sensors embedded into most of the inputs on the controller. These sensors provide a simple, but powerful piece of information: is the user physically resting on a particular input surface?</p><p>I knew these capacitive sensors were responsible for the social gestures in the Oculus “<a href="https://www.oculus.com/experiences/rift/1083042371786607/">Toybox</a>” demo, but <a href="https://medium.com/shopify-vr/introducing-thread-studio-shopifys-first-vr-app-73cc0a181205#.iebcacez0">Thread Studio</a> didn’t have social functionality so I didn’t experiment with them.</p><p>That was a mistake.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*3tZ0TNLcnNc8NDC1vz4dOQ.jpeg" /><figcaption>Oculus Toybox</figcaption></figure><p>The gestures may have initially been created for social communication, but they provided me an additional sense of immersion in my solo experiences. Allowing me to point and gesture in VR, even if only for my own amusement, enhanced my sense of agency in the virtual world. Surprisingly, seeing disembodied hands mimicking my gestures didn’t feel strange at all.</p><p>The hand poses can also enhance usability. For example, I’ve avoided physical UI push buttons in VR due to the many ways they can accidentally be engaged. On the Touch, I can constrain these UI buttons to only depress when the user is pointing. This is powerful. The user acts on the UI button the same way they do in the real-world: point a finger and press the thing. No building muscle memory for a controller, no learning what input is “press,” and far fewer unintended button activations.</p><p>How much further can these poses be leveraged to create “just act natural” interactions? Can we more accurately emulate the ways we grip, point, push, pinch and tap in the real world?</p><h3>Where do we go from here?</h3><p>The long-term dream for hand interaction in VR is to achieve error-free tracking and provide haptic cues indistinguishable from reality. Such a system would require room-scale finger tracking, matching an individual’s hand size and the simulation of rich texture, force and temperature cues. A solution with these capabilities is years off.</p><p>Many next-generation VR predictions include controller-free hand tracking, but for a number of reasons I think motion controllers can and should stick around. Controllers are likely to provide more accurate and reliable position data for some time to come. Physical buttons and axes will continue to provide more decisive commanding than the interpretation of hand postures. I also expect some users to react to the cognitive dissonance of holding a virtual object without any sense of touch or weight in the hand.</p><p>I began 2016 delighted with merely having positionally tracked manipulation in VR. This year’s motion controllers allow us to spatially designate the “where” for our actions to take place. Innovative design continues to progress on this core component and Valve’s Dev Days prototype showed the big players are still coming up with fresh ideas.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*q1VXSBXAKW1SpPHnZMagtA.jpeg" /><figcaption>One of Valve’s prototype designs for future controllers (<a href="https://twitter.com/shawncwhiting/status/786350329356886016">Image via @shawncwhiting on twitter</a>)</figcaption></figure><p>However, as the year ends, the capacitive sensors of the Oculus Touch leave me day-dreaming of additional design problems. With the general “where” of the hands solved by current controllers, is the next step to better emulate the many grips and poses we use to perform more intricate interactions?</p><p>One goal is to provide richer interfaces while minimizing the concept of button mapping. It’s desirable that new users spend time focused on learning the utility of virtual objects, not how to perform basic interactions with them.</p><p>So after a great year filled with learning, I enter 2017 with a fresh batch of ideas for existing controllers and an increased desire to try new, radical controller designs. I retain the belief that there are still so many fundamentals yet to be explored in VR. Finally, I hold an elevated appreciation for the nuance and complexity our seemingly simple, day-to-day interactions contain.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4d6a5398ecfb" width="1" height="1" alt=""><hr><p><a href="https://medium.com/shopify-vr/a-years-journey-in-motion-controls-4d6a5398ecfb">A Year’s Journey in Motion Controls</a> was originally published in <a href="https://medium.com/shopify-vr">Shopify AR/VR</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Oculus Connect and Steam Dev Days Wrap-up]]></title>
            <link>https://medium.com/shopify-vr/oculus-connect-and-steam-dev-days-wrap-up-93f3cca92baf?source=rss-21fedb79bb41------2</link>
            <guid isPermaLink="false">https://medium.com/p/93f3cca92baf</guid>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[htc-vive]]></category>
            <category><![CDATA[oculus-rift]]></category>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[steam]]></category>
            <dc:creator><![CDATA[Jon Wade]]></dc:creator>
            <pubDate>Mon, 07 Nov 2016 21:39:06 GMT</pubDate>
            <atom:updated>2016-12-26T04:26:50.728Z</atom:updated>
            <content:encoded><![CDATA[<p>Daniel and I recently attended <a href="https://www.oculusconnect.com/">Oculus Connect 3</a> and <a href="http://steamcommunity.com/devdays">Steam Dev Days</a> and wanted to share some high-level thoughts on the events and their themes.</p><p>2016 was a formative year for VR: the major headsets shipped to consumers, the first apps and games have been polished and sold, and developing for VR became even more accessible. This year the VR industry also faced the reality that it won’t become the next computing platform overnight.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hqeu8crV3MBagBNZuXVZ1g.png" /></figure><p>The enthusiasm and revolutionary spirit I felt at the first Oculus Connect, while still present, was expressed in a more mature acknowledgement of reality this year. A lot of hard, interesting work stands between the present and mainstream adoption for VR and how people approach their work has subtly shifted to reflect the required effort. The single enthusiast with her back of the envelope ideas and radical visions has grown into a start-up or a studio with a list of present challenges and a roadmap to delivery. The wild visions of the grand, yet-unseen metaverse are <a href="https://youtu.be/xG9-6k3RYIU?t=29m50s">still on the minds of even the biggest players in VR</a>, but effort to construct those visions is backed by more pragmatic thinking.</p><h3>Oculus Connect 3</h3><p>The year for Oculus <a href="http://www.theverge.com/2016/4/12/11413274/oculus-rift-vr-headset-preorders-delayed-months">wasn’t</a> <a href="http://fortune.com/2016/09/24/palmer-lucky-backlash-oculus/">as smooth</a> <a href="http://www.polygon.com/2015/12/31/10696070/oculus-touch-controller-release-date-delayed">as they would have wished</a>. In addition to difficulties executing their launch, the Vive presented strong external competition with room-scale, hand-controllers and aggressive distribution of dev kits . While I’ve remained a fan of Oculus’ people and products, I admittedly went to Connect with an attitude of Oculus needing to win me back. In this regard Connect succeeded at its key purpose: Daniel and I walked away excited about the development opportunities the Oculus stack provides.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/780/1*aDgu3zmyAgrakLzMfdYIOg.jpeg" /></figure><p>There was something for everyone in Oculus’ announcements: social, WebVR, room-scale, mobile, dev grants, and <a href="https://youtu.be/AtyE5qOB4gw">Abrash’s trademark visions of near future hardware</a>. Despite how early or staged some demos may have seemed, we were happy to see them sharing concepts and listening for feedback. Many of the demos were also backed with a promise to get concrete SDKs in our hands very soon.</p><h3>Steam Dev Days</h3><p>Steam Dev Days’ audience was entirely developers and the lack of press or VCs gave the event a more idealistic, scrappier atmosphere. Connect felt like it was a gathering to build an industry, but Dev Days felt like a gathering to reinforce a culture. <a href="https://youtu.be/plRjxIclou8">Valve believes no single entity will solve all of VR’s challenges and only by being open to many contributing parties will VR build a long-term future</a>. Openness and symbiotic development ran deep in all of Valve’s presentations. It felt like all of Valve’s staff, regardless of role, could be found in the hallways to provide insight or to listen to feedback.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*E4-Nmkvz8rLJTMslFd-t8g.png" /></figure><p>Having had a generally positive experience with the Vive and SteamVR, my main feeling going into Dev Days was, “What’s next? What will broaden this platform?” While the conference instilled me with a lot trust in Valve as a partner, I didn’t leave with many concrete roadmaps or usable artifacts for some core layers in the VR stack. While they talked about SDK additions, refined lighthouses and input research, absent were mentions of WebVR, persistent identity, next-gen hardware, and social VR that extends across experiences.</p><h3>Two Approaches, One Happy Developer</h3><p>Oculus Connect promised working foundations for most core VR services with the stipulation that you work inside their semi-closed platform. Steam Dev Days promised an open, gatekeeper-free community where many flavours of core service can begin to develop and interact. It’s natural to desire siding with one approach over the other, but at this point in VR’s development I’m actually quite glad both co-exist.</p><p>As a developer, consumer and end-user I want the open dream that Valve advocates. The model has supported innovation on the web where individuals and teams can cultivate new ideas, designs and libraries. Their output can have wide applicability, influence, and even commercial success without ever having to answer to a gatekeeper. It’s energizing to imagine a scenario where VR content can sandwich together technologies as web developers do today, but we have a long way to go. On top of the presentation and interaction already dealt with on the web, VR content has to deal with interoperability around rigged avatars, model formats, shaders, physics, 3D audio and complex two-handed user interactions. <a href="https://youtu.be/xG9-6k3RYIU">Tim Sweeney’s Dev Days keynote</a> framed these challenges and resonated with us, both in its potential visions of the future and in the dangers of letting closed infrastructure ruin the potential of the metaverse.</p><p>Today, we don’t live in the future where such an open stack exists and we have experiences we want to bring to users now. The stack of Oculus SDK’s streamlines many of the foundational services for us in a performant and cohesively integrated way. Whether thinking about social VR at scale (Facebook demo), identity across experiences (Avatars/Rooms), or WebVR that doesn’t kick you back to the desktop between transitions, Oculus has provided tools for building more complete experiences now. Using their tools isn’t without trade-offs. We are initially unsettled by the idea of another browser (Carmel) and we also have criticisms of the aesthetic choices in the Oculus avatars, but they are a readily available and will get us digging deeper into VR UX sooner rather than later.</p><p>Above all else, we have returned from our travels with two key feelings. Firstly, we are as excited as ever to be developing for VR/AR. There were interesting announcements made at both conferences and we remain confident in VR’s eventual role as a key computing platform. Secondly, we are as excited as ever by the people we are developing amongst. We had great conversations with people from Oculus, Valve, Facebook, HTC, Epic and many game &amp; app developers. Everyone was filled with enthusiasm, great ideas, and a roll-up our sleeves attitude towards making VR’s future bright. There is little doubt in our minds that amazing content and innovation will come from this community by the time these conferences come around next year.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=93f3cca92baf" width="1" height="1" alt=""><hr><p><a href="https://medium.com/shopify-vr/oculus-connect-and-steam-dev-days-wrap-up-93f3cca92baf">Oculus Connect and Steam Dev Days Wrap-up</a> was originally published in <a href="https://medium.com/shopify-vr">Shopify AR/VR</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Meet us at Oculus Connect & Steam Dev Days]]></title>
            <link>https://medium.com/shopify-vr/meet-us-at-oculus-connect-steam-dev-days-1abfef58733?source=rss-21fedb79bb41------2</link>
            <guid isPermaLink="false">https://medium.com/p/1abfef58733</guid>
            <category><![CDATA[shopify]]></category>
            <category><![CDATA[htc-vive]]></category>
            <category><![CDATA[oculus-rift]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[steamvr]]></category>
            <dc:creator><![CDATA[Jon Wade]]></dc:creator>
            <pubDate>Mon, 03 Oct 2016 23:55:02 GMT</pubDate>
            <atom:updated>2016-10-03T23:55:02.431Z</atom:updated>
            <content:encoded><![CDATA[<p>Hi Everyone!</p><p>My name is Jon and I’m a part of the VR team here at Shopify. Day-to-day you’ll find me working on many VR tasks including coding in Unreal Engine, designing VR interactions, running usability studies, and staring out the window imagining the long-term potentials of VR &amp; AR.</p><p>I’ll have more to say on all those topics in future posts, but today I want to let everyone know that <a href="https://medium.com/u/52db02a2d06f">Daniel Beauchamp</a> and I will be attending both Oculus Connect 3 and Steam Dev Days over the next two weeks.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*0SiNAJq8npQSXId5jufGgw.png" /><figcaption>Daniel is on the left; normally he is not a cartoon. Jon is on the right; normally he is wearing a silly hat.</figcaption></figure><p>If you see us, feel free to come up and say, “Hello!” We are interested in so many facets of VR. How’s WebVR going for you? How have users surprised you? What’s your golden rule(s) for UX design in VR? What’s the landscape going to look like in 5, 10, 20 years time? We’re eager to share and hear what everyone is learning on the path to making VR great.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1abfef58733" width="1" height="1" alt=""><hr><p><a href="https://medium.com/shopify-vr/meet-us-at-oculus-connect-steam-dev-days-1abfef58733">Meet us at Oculus Connect &amp; Steam Dev Days</a> was originally published in <a href="https://medium.com/shopify-vr">Shopify AR/VR</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>