<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Rémi Rousseau on Medium]]></title>
        <description><![CDATA[Stories by Rémi Rousseau on Medium]]></description>
        <link>https://medium.com/@Goetz?source=rss-f14cea1e225d------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*X8PzY6BkLvNqmPU_.jpeg</url>
            <title>Stories by Rémi Rousseau on Medium</title>
            <link>https://medium.com/@Goetz?source=rss-f14cea1e225d------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 17:58:25 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@Goetz/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Holographic communication gets a boost]]></title>
            <link>https://medium.com/mimesys/holographic-communication-gets-a-boost-2c7777cad566?source=rss-f14cea1e225d------2</link>
            <guid isPermaLink="false">https://medium.com/p/2c7777cad566</guid>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[augmented-reality]]></category>
            <dc:creator><![CDATA[Rémi Rousseau]]></dc:creator>
            <pubDate>Fri, 16 Sep 2016 08:58:59 GMT</pubDate>
            <atom:updated>2016-09-16T10:23:52.607Z</atom:updated>
            <content:encoded><![CDATA[<p>LRM and a group of angels invest 1M€ in Mimesys</p><p>You know how Hollywood is pretty good at predicting the future of communication? 2001, a space Odissey <a href="https://www.youtube.com/watch?v=vWwo6JpMceg">predicted</a> Facetime, and Star Wars predicted Holographic communication.</p><p>At Mimesys, we want to make this future happen. Because we’re convinced that the future of telecommunication, business collaboration and social media can’t be just emojis, but a shared feeling of physical presence, empathy and engagement.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-4MiUbLuAlRUlSeQubZQeQ.jpeg" /><figcaption>The remote meeting of the future (virtual doughnuts not included)</figcaption></figure><p>We announce today that we raised 1M€ from <a href="http://www.lrm.be/home">LRM</a> and a group of business angels lead by Koen Desmedt and Frank Bekkers to help us succeed and make holocom a reality for the world.</p><p>These funds will help us accelerate the development of our first product, Mimesys Connect, a VR and AR collaboration app for enterprise that reimagines how remote collaboration is done.</p><p>If you’re interested by our technology or want to join this great adventure (I’m looking at you, CUDA expert!) , please contact us at contact@mimesysvr.com</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Klqbgx_K1-wg33N-xRRmRQ.png" /><figcaption>because commuting from galaxy to galaxy is such a waste of time</figcaption></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2c7777cad566" width="1" height="1" alt=""><hr><p><a href="https://medium.com/mimesys/holographic-communication-gets-a-boost-2c7777cad566">Holographic communication gets a boost</a> was originally published in <a href="https://medium.com/mimesys">Mimesys</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Holographic memories : how the future will remember the past]]></title>
            <link>https://medium.com/@Goetz/volumetric-memories-how-the-future-will-remember-the-past-eb5b1cf33cf1?source=rss-f14cea1e225d------2</link>
            <guid isPermaLink="false">https://medium.com/p/eb5b1cf33cf1</guid>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[augmented-reality]]></category>
            <category><![CDATA[tech]]></category>
            <dc:creator><![CDATA[Rémi Rousseau]]></dc:creator>
            <pubDate>Fri, 22 Apr 2016 17:01:50 GMT</pubDate>
            <atom:updated>2016-05-10T09:26:16.713Z</atom:updated>
            <content:encoded><![CDATA[<p>Remember the scene in Minority Report where Tom Cruise is visualizing memories from his family? First, the holographic recording of his son running, then his wife, appearing majestically in the room, in full scale in front of him.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-MWU6IVlh59W-2mmtzGn8g.png" /><figcaption>Yep, that’s the one</figcaption></figure><p>The scene is effective and beautiful, as you can feel the nostalgia. As with an incredible number of other technologies used in the film, it was also prescient in imagining what would happen next. The 3D depiction of the hero’s wife looks really similar to what would be possible to render with today’s technology. We’re pretty sure about that because we did it, and you can download today the first beta of Mimesys <a href="http://www.mimesysvr.com/">here</a>.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fsketchfab.com%2Fmodels%2Fd4216d72e179456c9e35bad9af091188%2Fembed&amp;url=https%3A%2F%2Fsketchfab.com%2Fmodels%2Fd4216d72e179456c9e35bad9af091188&amp;image=https%3A%2F%2Fd35krx4ujqgbcr.cloudfront.net%2Furls%2Fd4216d72e179456c9e35bad9af091188%2Fdist%2Fthumbnails%2Fb96081ae853c497c88a36256ce15ec48%2F640x360.jpeg&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=sketchfab" width="640" height="360" frameborder="0" scrolling="no"><a href="https://medium.com/media/4d2deffeb62feee41a3737511bc3fcb9/href">https://medium.com/media/4d2deffeb62feee41a3737511bc3fcb9/href</a></iframe><h4>Bringing depth to memories</h4><p>Mimesys software uses depthcams to capture the image and the depth from reality, and reconstruct a 3D model in real-time. This makes a lot of difference when the model is seen in a VR or AR headset : when facing a human recorded in 3D, you will recover a lot of the social cues that rule social interactions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*zqOKRBwZDBCvy52c_KBDLw.jpeg" /><figcaption>Mimesys mesh, as seen in Unity</figcaption></figure><p>It made me realize that a few things control this feeling of being in front of a person : <a href="http://doc-ok.org/?p=1172">the depth cues</a> are indeed very important to have the impression to be in the same place. The second most important thing is probably movement. As many people have noted with the Toybox demo, having just a head and hands can be sometimes enough to convey the impression of being with someone if their movement is consistent with reality. What Mimesys captures show is that movement is crucial, and even if the quality is far from perfect (but constantly improving!), the conservation of movement makes human beings feel like human beings, in a much more convincing way than the most expensive rigged videogame character for instance.</p><h4>Ghosts of the past</h4><p>Science-fiction has played a lot with this idea of holographic memories. It is often used to represent <em>ghosts, </em>scary memories of things that don’t exist anymore, haunting forever empty places.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iVbwrS36ZE7knVAlSQhupA.png" /><figcaption>Prometheus holograms</figcaption></figure><p>Take for instance the troubling creatures of <a href="http://www.imdb.com/title/tt1446714/?ref_=fn_al_tt_1">Prometheus</a> that left their holograms as a cautionary tale that you probably won’t want to mess with aliens. MEssy pointclouds telling you to go away.</p><p>Or the most nostalgic ghosts of <a href="http://www.imdb.com/title/tt0435651/">The Giver</a> interpreted by… Taylor Swift.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FsyxQk83n2V4%3Ffeature%3Doembed&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DsyxQk83n2V4&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FsyxQk83n2V4%2Fhqdefault.jpg&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/b30fe6b569126f86f54f7269017111e4/href">https://medium.com/media/b30fe6b569126f86f54f7269017111e4/href</a></iframe><p>Or maybe the first idea of the technology was in a small spanish book called “<a href="https://www.wikiwand.com/en/The_Invention_of_Morel">The Invention Of Morel</a>”, published in 1940, that describes an island haunted by holographic memories of a past that doesn’t exist anymore.</p><p>Somehow the idea of capturing a fragment of time on a support has always been linked to the fear of time and death : didn’t Native Americans first believe that photographies steal the soul? But with the support being more and more popular, it became a way to capture the ones you love (“Kodak moments”) and then to communicate and share the world (Instagram).</p><p>This is what is just getting started with volumetric capture and Mimesys.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ahnosty_xFY4tqm-1IwR3Q.jpeg" /><figcaption>Capturing my family with Mimesys (Kinect 2 setup)</figcaption></figure><h4>The past of the future starts now</h4><p>We think “holographic capture” is a wonderful way to record people you know and love, and to share it with others. We just announce a Sketchfab integration that allows you to embed volumetric snippets of your captures in Sketchfab and thus in major social networks (facebook, twitter, LinkedIn, etc.).</p><p>With depthcams coming to mobile, we think the medium will become more and more popular and a new way to remember the world. We can’t wait to see what you’ll be doing with it, so if you have a Kinect V2 and a PC, please <a href="http://www.mimesysvr.com/#download">try it </a>and tell us what you think!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=eb5b1cf33cf1" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Holograms and the the future of meetings]]></title>
            <link>https://medium.com/mimesys/holograms-and-the-the-future-of-meetings-a258eb777630?source=rss-f14cea1e225d------2</link>
            <guid isPermaLink="false">https://medium.com/p/a258eb777630</guid>
            <category><![CDATA[augmented-reality]]></category>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[hologram]]></category>
            <dc:creator><![CDATA[Rémi Rousseau]]></dc:creator>
            <pubDate>Fri, 05 Feb 2016 12:02:59 GMT</pubDate>
            <atom:updated>2016-02-05T16:16:53.762Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*aNBaGUCUs1PRsimnOaci5w.jpeg" /></figure><p>You don’t have to look very far to find inspiration about what would future meetings look like. Decades of Sci Fi, whether in cinematographic or written from, have explored the question. It’s interesting to see that it used to be the case for technologies that are nowadays omnipresent in the meeting room. Videoconferencing was introduced in movies as soon as the 50s before being a reality in the 90s, the most famous sequence probably being the videophone sequence in “2001 : a space odissey”, that become an iconic view of the future.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FvWwo6JpMceg%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DvWwo6JpMceg&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FvWwo6JpMceg%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/90e553b88381d5c575f0103e2747007d/href">https://medium.com/media/90e553b88381d5c575f0103e2747007d/href</a></iframe><p>A more recent trend explored in many pieces of SF is the concept of holographic communication, communication with a full-scale person as if you were face-to-face. The most obvious reference here is probably Star wars with the blue transparent hologram introduced in “A New Hope” and consistently used in the rest of the episodes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/492/1*LaLcUiyJ8zO-TqRcukJrpQ.jpeg" /><figcaption>Apparently there’s a technical trade-off between transmitting 3D data from a different galaxy and having a full color palette</figcaption></figure><p><a href="https://www.wikiwand.com/en/Holography_in_fiction">Many other works</a> have used what has become a <a href="http://tvtropes.org/pmwiki/pmwiki.php/Main/Hologram">SciFi cliché</a>, especially when they come with glitches and visual static. It has become a very visual and easy way to display futuristic-looking conversations in the future.</p><p>As often, SciFi drives technical progress. These holographic meetings could soon be a reality : check what we’ve being doing at Mimesys.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FCApMyhxbkrs%3Ffeature%3Doembed&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DCApMyhxbkrs&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FCApMyhxbkrs%2Fhqdefault.jpg&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/87a39f40da0a71c7dd6d5972b06197e5/href">https://medium.com/media/87a39f40da0a71c7dd6d5972b06197e5/href</a></iframe><p>What kind of sorcery is this? Well, a combination of three different technological advances allowed us to build the software behind this video :</p><ul><li><strong>volumetric capture </strong>: the “3D” aspect is possible thanks to the data we get from a depth camera (here the Microsoft Kinect v2). Depth sensors are promised to a fantastic future because they will be soon the center of a big competition race in the mobile world. Prepare for such a sensor in your next iPhone.</li></ul><h3>Benedict Evans on Twitter</h3><p>When phone cameras shift to multi-sensor it&#39;ll kick off a whole new specs race. We&#39;re going to need a 3D image capture/share format, though</p><ul><li><strong>Live streaming : </strong>the internet has turned into a great infrastructure for streaming high resolution 2D content. We use that, yeah.</li><li><strong>AR and VR headsets : </strong>The most important brick ; don’t expect hologram technology in the next years (though we’re already compatible with <a href="http://edition.cnn.com/videos/tech/2015/05/08/3d-light-printing-voxiebox-star-wars-orig.cnn">one of the most promising ones</a>). Our holograms aren’t holograms, there are 3D meshes projected through AR (Augmented Reality) or VR (Virtual Relaity) devices. Incorporating real people in virtual environments (VR) or in real ones (AR) becomes then much more feasible than having to deal with physical constraints. On the video, Davy is looking at me through a VR headset, the Vive. The VR headsets such as the Vive Pre or the Oculus Rift are already at a very high performance stage, whereas we’re not sure yet of the performances of AR headsets such as Magic Leap and Hololens.</li></ul><p>Our promise is the following : tomorrow you’ll have holographic communications while being recorded by a depth camera and while wearing a VR headset/AR glasses or lenses. That is what we’re exploring with Mimesys. We’re closer than ever to perform remote face-to-face meetings.</p><h3>VR remote meetings</h3><p>The problem with VR meetings is obvious : you have a headset on, so you’ll look like this to your colleagues. Sexy.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3s7hmDsxIwZFJCboa65Wbg.jpeg" /></figure><p>But for a lot of usecases, this will be good enough! There are still thousands of applications that value spatial positioning, body langage more than facial emotions (think of training applications for instance).</p><h3>AR Remote meetings</h3><p>Where remote meetings will thrive is with AR. With AR lenses, you’ll be able to see your partners face and integrate their bodies in your current world. This has been more than well described in the book Rainbows End, where every meeting is an AR one.</p><h3>Prototyping the future</h3><p>In parallel to our development, we’re exploring and prototyping what could Augmented Reality meetings look like, with an advanced platform with 68 cameras. We’ll share the results very soon.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*NM6yCAlQttwhdh8fHgGdgQ.jpeg" /></figure><p>There are indeed still a lot of stuff to explore around this concept that Hollywood hasn’t, especially :</p><ul><li><strong>how to adapt the space and furniture to get a perfect experience?</strong> Holographic communication is complicated to achieve. As in the early days of videoconferencing, you’ll need a fixed setup and perfect conditions. The limited FOV on the current AR headsets will also imply some additional constraints : don’t be too close to the person you’re talking with. This setup could be an interesting challenge for furniture companies : how do you design a chair with discrete markers for careful hologram positioning? how do you design a chair for virtual people only? Could you reconfigure a room to host different meetings at the same time?</li><li><strong>What’s the User Experience for holographic communication? </strong>The Star Wars experience is just the beginning. When you bring the virtual in the real world, there’s much more you can do in terms of inputs and commands. How would you share a virtual document with a holographic colleague? With real sheets of paper with markers on? Is it polite to change the environment during the meeting like in<a href="https://www.youtube.com/watch?v=SsQT3mbvVWY"> Heavy Rain</a>? Is it polite to turn into an avatar during a conversation?</li></ul><p>There are still a few years before requesting Obi Wan’s Kenobi’s help in 3D, but count on us to be among the first to try.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a258eb777630" width="1" height="1" alt=""><hr><p><a href="https://medium.com/mimesys/holograms-and-the-the-future-of-meetings-a258eb777630">Holograms and the the future of meetings</a> was originally published in <a href="https://medium.com/mimesys">Mimesys</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Turn up the volume]]></title>
            <link>https://medium.com/@Goetz/turn-up-the-volume-a77bd2e80586?source=rss-f14cea1e225d------2</link>
            <guid isPermaLink="false">https://medium.com/p/a77bd2e80586</guid>
            <category><![CDATA[virtual-reality]]></category>
            <category><![CDATA[oculus-rift]]></category>
            <category><![CDATA[storytelling]]></category>
            <dc:creator><![CDATA[Rémi Rousseau]]></dc:creator>
            <pubDate>Thu, 08 Oct 2015 23:02:27 GMT</pubDate>
            <atom:updated>2015-10-09T08:38:11.776Z</atom:updated>
            <content:encoded><![CDATA[<h4>Henry, theater, volumetric capture and the future of VR stories</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_P-bzfCcB7IQyxSKCeWNvQ.jpeg" /><figcaption>All the world’s a stage… at least in VR</figcaption></figure><p>My last emotional relation with a Hedgehog is one of rage and frustration. It goes back to Sonic 2 and my desperate attempts to finish the game, but when Henry glanced at me, I know something would happen between us. I had the chance to be present at the Oculus Connect conference and to attend an Oculus “premiere”, <em>Henry. Henry</em> is the second movie produced by Oculus Studios, for lack of better word, and one of the first VR stories to be told in the right way. It’s quite difficult to qualify it as the experience is really different from the Hollywood movies we know and love, and even from the many 360 videos coming to VR. “VR story” would be my preferred wording. I’ve consumed my fair share of VR scripted experiences, and it was the first one that felt really right.</p><h3>360 shades of “meh”…</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/1*CecXDAXNwOKfZft4DfV3Cw.jpeg" /><figcaption>Even Reese is bored</figcaption></figure><p>I’ve worked on S180 and 360 video content for more than a year now with my project <a href="http://www.surgevry.com/">Surgevry</a> : it’s an effective medium to capture reality in a quick and efficient way, which has been really practical for surgical training. It is also very powerful to transport you somewhere else : I’ve been to Syria with VRSE’s “Clouds over Syria” and transported into “the Wild” with Paul &amp; Felix, but I haven’t felt a strong empathy towards my fellow humans presented in these environments. They seemed far away, strangely scaled, and somewhat distorted. They seemed 2D.</p><p>The lack of positional tracking is quite disturbing in 360 video : you’re inside a sphere and can’t change your point of view, since the cameras capture only the light at a central point. I’ve always had the strange claustrophobic feeling of being trapped inside a snow globe. It doesn’t help that, given the origins of 360 video from 360 photo (which require a static environment), the captures we see most often are dull animated panoramas, that quickly become as fun in VR as your dentist’s screensaver. There have been <a href="http://vrfocus.com/archives/21801/valves-yates-spherical-photos-and-video-are-not-vr/">heated debates</a> about the fact that spherical videos are VR or not, but it’s clear it’s not the climax of what can be achievable in VR. It lacks those precious 3 degrees of translation that convey that deep sense of presence.</p><h3>…versus six degrees of freedom</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*zqzwA31MXGGQZPbMTRqe9g.jpeg" /><figcaption>The camera that allow 6 DOF tracking in the CV1</figcaption></figure><p>Henry was different. The three degrees of translation offered by the positional tracking and the generous coverage of the Oculus Constellation system allowed for natural movement within a scene rendered in real-time (with the UE4 engine). Natural movement doesn’t mean you want to walk freely in the scene : the wire from the headset wouldn’t let you do that and if the director has done his job right, it’s not something that you will want to do. This a problem that will be familiar with any VR developper : locomotion hasn’t been solved yet in VR and there is no way to move naturally in a big environment without experiencing motion-sickness. Henry has a pragmatic answer to that :</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*TBcQXuS2mygAIti4yCnxsA.jpeg" /><figcaption>The carpet is the unsung hero of the Henry experience</figcaption></figure><h3>“Please take a seat on the carpet”</h3><p>This where the only indications that the Oculus hostess gave me while putting the headset on my head. The famous “So now, what do I do?” that I got from so many people I made try the headset has a simple answer when it comes to VR stories : “take a seat and enjoy”. This is a story, not a videogame, this is a passive experience that is cripted, something to contemplate and observe. The Henry environment is made for this kind of passivity : all the action is out of reach (happening beyond the tracking cam). One nice addition to the demo : you are standing in real-life on a carpet that’s a 1:1 replica of Henry’s house carpet. That contributes to the immersion and shows you clearly in which area you’re free to move . You won’t leave it for the 5 minutes of the experience.</p><p>So why is position tracking useful if I can’t really move around? One word : immersion. Research has stated numerous times that without 6 degrees of freedom, you can’t reach the mythical <em>presence</em> in VR and feel like you’re there. This experience made it crystal clear. The tracking volume is pretty good in the CV1, at least it lets you experience the carpet very closely. Having the correct parallax effects, even if your head isn’t moving much, is very important so that you let your conscience flow away and enjoy suspension of disbelief. You’re with Henry, in his home, and you don’t particularly feel compelled to test the limits of the tracking system and try to find out what’s on the other side of the home, as you wouldn’t get up on the stage during a play.</p><h3>Oculus sets the scenes for VR stories</h3><p>And it’s fine, really! Because the story is simple, compelling and emotional. The connexion to the characters is particularly interesting ; Chris Milk defines VR as the “<a href="https://www.ted.com/talks/chris_milk_how_virtual_reality_can_create_the_ultimate_empathy_machine">ultimate empathy machine</a>” and you can really feel an emotional connexion for this friendless hedgehog. The story itself doesn’t have anything to do with the codes of cinema, it’s more of a play, a very classical play, with its <a href="https://en.wikipedia.org/wiki/Classical_unities?oldformat=true">classical unities</a> : unicity of action (one plot), unicity of time (real-time), unicity of place (Henry’s house). The best analogy might be the emerging field of immersive theater, with examples as the<a href="http://www.sleepnomore.com/#share"> Sleep No More </a>show in NY, when spectators move freely around actors who don’t seem to see them.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*SyWwDBlJ727cdf-_Vr9asg.jpeg" /><figcaption>Sleep no more, an immersive theater experience where you belong to the stage</figcaption></figure><h3>Video killed the theater stars</h3><p>As in a play, the emphasis is on the actors. In VR, there are no clever shots, no nice editing, no fancy FX, you are alone with the characters. They’d better be good.</p><p>Henry copes with that nicely with a Pixar touch : the hero is an anthropomorphous creature you can relate with. Animators at Oculus Studios did an amazing job on Henry, but they must have spent months on this. Every story in VR can’t be as polished, and we will need a way to display in VR the creatures we most easily connect with, <em>humans</em>.</p><p>Video games traditionally use avatars, rigged models, to display characters. You can’t really do that for VR stories. Despite the marvels of technicality deployed in the latest videogames (for instance the latest MGS), avatars don’t embrace roles, avatars don’t feel human, avatars are acceptable on a small screen but creepy when you get them in your face, real scale, in a VR headset.</p><p>The only way to capture characters correctly is though “volumetric capture”, a way to record someone in full 3D -not only stereoscopic 3D-, a technology we’re exploring at my company <a href="http://www.mimesysvr.com/">Mimesys</a>. We use depth cameras such as the Microsoft Kinect 2 to record humans as fully animated 3D meshes and not simply 2D pictures or rigged 3D meshes. We will release very soon a free SDK <a href="http://www.mimesysvr.com/">here</a>, so that anyone with a Kinect 2 and a PC adapter can try : because the structure of compelling VR content hasn’t been discovered yet, we want everyone to come and try with low-cost solutions.</p><p>Even if our current quality is far from perfect, the results of Mimesys human captures are really surprising in VR : in front of a “holographic human”, you quickly recover all the subconscious social cues you didn’t know you had. You have to cope with the confort zones and bear with the fact you won’t have any social feedback from the recorded actor over there, which is something difficult to handle first! Of course it’s very different with live-streaming, which is something we’re also exploring for the moment.</p><h3>The future of stories in VR</h3><p>Stories will evolve with VR. In a <a href="https://vimeo.com/30448271">great interview</a> back in 2012, John Gaeta (Academy award FX winner, famously known for the Matrix and now working at LucasFilm) described the future of stories as passive experiences you’ll be catching in these gigantic immersive universes. You just run into them and can choose to stop by and see them or to go elsewhere. The man is working on Star wars now, so imagine the whole Star Wars universe as a passive MMORPG where you could connect to various plots whenever you’d like and see them happen in front of your eyes, possibly with other people of your choice. Immersion would be there for suspension of disbelief, not for interaction. And we are pretty that, at the center of these universes, there will be humans, holographic humans, waiting for their stories to be told.</p><p>We can’t wait for this to happen.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a77bd2e80586" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Virtual surgery gets real]]></title>
            <link>https://medium.com/@Goetz/virtual-surgery-gets-real-221beeac65ea?source=rss-f14cea1e225d------2</link>
            <guid isPermaLink="false">https://medium.com/p/221beeac65ea</guid>
            <dc:creator><![CDATA[Rémi Rousseau]]></dc:creator>
            <pubDate>Wed, 13 Aug 2014 14:03:18 GMT</pubDate>
            <atom:updated>2014-08-17T09:38:21.639Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ez_09a-qT1G4lSjLEasBbw.jpeg" /><figcaption>Dr Thomas Gregory, the french surgeon who performed the first “Oculus Rift Surgery”</figcaption></figure><h4>What the Oculus Rift could mean for the future of medicine</h4><p>Technological innovation takes time : virtual reality has been a thing in the medical field for more than three decades, and despite great promises it isn’t widely available yet. Things could change quickly, and the innovation won’t come from the usual suspects in medicine, but the gaming world.</p><h3>Virtual reality and medicine : a platonic love story</h3><p>Virtual reality-simulated environments have been used for the training of personnel, most notably for military applications, for more than 35 years. The advantages conferred by being able to train novice personnel in a low- to no-risk simulated environment have long been appreciated by the medical community. The vision of high-quality VR surgery training is quite obvious but the use hasn’t been adopted on a wide scale. The main reasons are it’s costly and far from perfect. In the meantime, the use of screens during surgery itself has become very frequent with the expansion of <a href="http://en.wikipedia.org/wiki/Laparoscopic_surgery">minimally invasive surgery</a> : the surgeon uses a basic screen for that, which means a short field of view and poor depth perception for him. But virtual reality for surgery has been a very demanding niche market for the last decades ; it could be different in the next years.</p><h3>Enters the Oculus Rift</h3><p>The Oculus Rift is a virtual reality headset (in its second iteration) made possible by smartphone technologies, developed by <a href="http://www.oculusvr.com/">Oculus VR</a>, a 2 year-old company recently acquired 2 billions by facebook. The main target for the Oculus Rift (and commercial focus of Oculus VR) is to provide whole new videogame experiences by building immersive worlds. Being a medical device isn’t and probably won’t ever be one of their objective ; they want to be the next platform, as popular as the smartphone. And as Apple probably hadn’t anticipated that the iPhone would have so many ramifications in the medical world, prepare yourself for medical applications with the Oculus Rift</p><h3>Our experiment</h3><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FpKT7zZ7Lo6w%3Ffeature%3Doembed&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DpKT7zZ7Lo6w&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FpKT7zZ7Lo6w%2Fhqdefault.jpg&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/bd7c4be181440ff2e0512164f4c52725/href">https://medium.com/media/bd7c4be181440ff2e0512164f4c52725/href</a></iframe><p>I conducted a project for the <a href="http://www.fondation-moveo.com/">Moveo fundation</a> with Dr Thomas Gregory, Professor of Surgery and Medicine, at the Paris Descartes University and surgeon at the European Hospital Georges Pompidou. We used consumer technology to provide a new way to capture a surgery. Two synchronized GoPros cameras were placed on the Dr Gregory’s head while he was performing a total hip replacement.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qIGh5xZrG-h2paaZg2TvcA.jpeg" /><figcaption>The surgery</figcaption></figure><p>The footage is great : you get a Hi-res 3D version of the surgery with a great field of view. Watching the scene with the Oculus Rift is a great experience : you are as close as you’ll ever be of being a surgeon.</p><p>You can try it <a href="http://www.fondation-moveo.com/projects/virtual-reality">there</a> if you have a Rift.</p><h3>What‘s the point?</h3><p>The principal aim of this experiment was to provide a great way for students to see a whole surgery through the eyes of a surgeon. When you’re a surgeon in training (for instance, the student on the left of the picture), you always have a task to do during the surgery ; it becomes thendifficult to see what the main surgeon is doing. Being able to live a surgery in the surgeon’s shoes thanks to the Rift is very useful to replay the surgery in detail, pause, fast forward or backwards. It can also be an inspiring way to share and learn new techniques among surgeons.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QT9-xLDcLDajuP5C9-ZBCA.jpeg" /></figure><p>This is just the beginning : the next objective is interaction, being able to experience a real simulation with real instruments, a complex challenge for the future of VR.</p><h3>Is the future of surgery owned by facebook?</h3><p>It depends.<br>The Rift won’t be a medical device : facebook probably doesn’t want to deal with FDA issues and the medical market is a small niche compared to their usual audiences. But it’s clear that the technical advances of the Oculus team (in latency reduction for instance), the systematic sharing of their research and the emergence of skilled VR developpers among game developpers will boost the field of medical VR for the next decades. There will be surely be other medical companies standing on the shoulders of Oculus that will provide more specific medical VR hardware for micro-invasive surgery for instance.</p><p>But the Rift, if it’s widely adopted, could be a precious tool for physicians. As the iPhone, they won’t buy it as a medical tool, but as the iPhone, they will use it as a medical tool. They will use it to share cases, surgeries, 3D imagery, and visualize complex data. The resolution of the screen isn’t sufficient enough for the Rift to be amajor radiological interpretation tool right now but it sure could be in the next future, and a very cheap one too! (350$ for the current model when radiology screens can easily cost more than 15 000$). There are some other interesting uses to imagine : think about the use of <a href="http://doc-ok.org/?p=965">3D video capture</a> in teleconsultation for instance… getting new ways to watch people undress has always been a great driver for technology…</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=221beeac65ea" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>