Earlier, with our patented AppSpace method, we enabled rendering a phone’s 2D apps in 3D on smart glasses. But we found a gap — there was no direct way for a 2D app (like Chrome) to interact with 3D spatial content.

🏅 Thrilled to share that our solution to this is now recognized with a U.S. Patent!

Patent No : US 12,373,174 B2

This patent, titled _“IDENTIFICATION OF CALLBACK FROM 2D APP TO RENDER 3D MODEL USING 3D APP” granted to Lenovo.

This invention enables seamless interaction between 2D apps and 3D models — for example, opening a Google AR Animal directly from Chrome into a smart glass environment.

🚀 Originally developed for Lenovo’s ThinkReality A3 smart glasses, this technology bridges the gap between flat screens and immersive spatial computing.

🚀This originally developed for Lenovo’s award-winning ThinkReality A3 smart glasses,

Detailed Guide on 3D Model Viewer here

👨‍💻 Honored to be one of the inventors alongside Raju Kandaswamy

🙏 Thank you to everyone who contributed to shaping this innovation and to Lenovo for the opportunity to bring meaningful technology to life.

☞ USPTO #17/820,017 ☞ JUSTIA #20240061657 ☞ Granted #12323679 ☞ More Details

Also covered by NIT Kurukshetra Alumni Association

Refer here for my more patents

Patent Granted: Spatially interact with 3D Model from a 2D app in the smart glasses was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

In our daily work, we regularly develop methods, processes, features, or approaches to address specific challenges. While these may initially seem like routine solutions, some of them quietly evolve into true innovations — often without us realizing it at the time.

🏅 I’m excited to share that one such innovation has now been recognized with a U.S. Patent!

Patent No : US 12,323,679 B2

This patent, titled _“Streaming of Composite Alpha Blended AR/MR Video” granted to Lenovo, introduces a novel method for web-based AR and MR streaming — allowing mixed reality experiences from a headset to be cast directly to a web browser, along with the phone screen. It also includes the ability to record and share these experiences, making it an incredibly useful tool for demos, remote collaboration, and enterprise training.

🚀 Originally developed for Lenovo’s award-winning ThinkReality A3 smart glasses,

Video

this invention blends:

• Headset display
• Camera feed
• Phone screen

…into a seamless composite stream, rendered right inside the web browser — bringing the immersive MR experience to virtually any viewer. Parts of this innovation are also now part of the ThinkReality VRX, which includes enterprise features like Device Enrollment with Intune and VMware.

Detailed Guide on ARCast here

👨‍💻 Honored to be one of the inventors alongside:

Serhii Pryvalov, Deepak Chirammel, Cole Heiner, Mayan Shay and Raju K

🙏 Thank you to everyone who contributed to shaping this innovation and to Lenovo for the opportunity to bring meaningful technology to life.

☞ USPTO #17/820,033 ☞ JUSTIA #20240064387 ☞ Granted #12323679

Refer here for my more patents

Patent Granted: Streaming of Composite Alpha Blended AR/MR Video was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

I got to experience the brand-new Apple Vision Pro firsthand and developed an unbounded mixed reality (MR) application that seamlessly integrates both augmented reality (AR) and virtual reality (VR) capabilities on the Vision Pro using Unity.

In earlier article, my colleague Manindra Krishna Motukuri has shared quick steps to develop, build and deploy apps.

Getting started with Apple Vision Pro: How to develop, build and deploy apps for Apple Vision Pro?

However we found, for a practical app development, we had to research, find hacks to implement features and understand Vision OS environment better to deliver the seamless experience.

In this article, we’ll explore why the AVP development is comparatively more challenging than other XR platforms and how these restrictions impact developers.

The Apple Vision Pro (AVP) has been positioned as a game-changer in the XR industry, with its high-resolution displays, advanced spatial computing capabilities, and seamless integration into Apple’s ecosystem.

A UX Designer’s take on the Apple Vision Pro: Part 1- The Beginning

While AVP boasts advanced hardware and seamless integration within Apple’s ecosystem, developers must navigate certain limitations compared to other XR platforms like Quest , HoloLens, etc .

Apple Vision Pro vs. Meta Quest 3: The XR Battle Heats Up

Development on AVP is challenging for beginners. There is lot of reading involved , there is a lot of confusion on the bounded , unbounded spaces, which interactions are supported etc.

1. Limited Support for Industry-Standard XR Features

A significant hurdle in AVP development is its deviation from widely adopted XR development standards. Apple’s emphasis on its proprietary ecosystem necessitates the use of visionOS, RealityKit, and ARKit, diverging from frameworks like OpenXR or Unity’s XR Interaction Toolkit.​

• Lack of OpenXR Support: Unlike platforms such as Meta Quest and HoloLens that embrace OpenXR — a standard facilitating cross-platform XR development — AVP does not offer native support. This absence complicates the porting of applications from other XR platforms, often requiring substantial codebase revisions using Apple’s tools.​
• Interaction Limitations: AVP’s interaction methods are primarily limited to gaze-and-pinch or 2D UI elements, lacking native support for hand tracking interactions. This constraint poses challenges for developers aiming to create natural and immersive AR and VR experiences.​
• Controller Support: Unlike many XR devices supporting six degrees of freedom (6DoF) controllers, AVP does not natively support tracked controllers. Instead, it relies on eye tracking and hand gestures, which, while innovative, can present challenges for gaming and interaction-intensive applications.​

2. Shader Restrictions and Graphics Limitations

One of the most critical aspects of creating immersive XR experiences is the ability to render stunning visuals. However, AVP devices impose significant restrictions on shaders and image-based lighting, both of which are foundational to the realistic rendering of virtual worlds.

• Custom Shader Support:Shaders are essential for rendering special effects like reflections, refractions, and lighting. AVP does not support traditional shader languages like GLSL or HLSL. Developers are encouraged to use Shader Graph for creating custom shaders which is not beginner friendly. Certain ShaderLab shaders and advanced rendering techniques may not be fully supported, limiting the implementation of complex visual effects.
• Material Control: While RealityKit provides basic material properties, the level of customization available is less extensive than in other XR development environments. This limitation affects the ability to achieve effects like real-time reflections and advanced lighting models.​
• GPU Access: Direct access to GPU pipelines is restricted, reducing developers’ ability to create optimized, high-fidelity graphics compared to platforms that offer more granular control over rendering processes.​

3. Image-Based Lighting (IBL) Challenges

Achieving realistic lighting effects through Image-Based Lighting (IBL) presents challenges on AVP due to certain platform constraints.​

• Lighting Limitations: AVP supports up to four dynamic lights, requiring each affected material to include a PolySpatial Lighting Node in its Shader Graph. However, features like real-time global illumination and advanced reflection probes are limited or unsupported, impacting the realism of dynamic lighting scenarios.

Platforms like Meta Quest 3 and VR systems support more advanced lighting models, including real-time reflections and dynamic lighting, enabling higher levels of realism in XR applications.​

4. Performance Constraints and GPU Bottlenecks

Despite AVP’s powerful M2 and R1 chips, developers may encounter performance bottlenecks due to the platform’s optimized rendering pipeline.​

• Rendering Optimisations: While RealityKit’s optimisations favor power efficiency, they can limit the performance of resource-intensive applications. Developers must carefully manage assets and rendering techniques to maintain performance.​
• Memory Allocation: AVP imposes constraints on memory allocation for real-time rendering, necessitating efficient use of resources to accommodate high-polygon models and large textures.​
• GPU Resource Access: Limited direct access to GPU features restricts the implementation of advanced rendering techniques such as ray tracing, which are more readily available on other XR platforms.​

5. Development Ecosystem and Learning Curve

Transitioning to AVP development involves adapting to a new set of tools and workflows within Apple’s ecosystem.​

• Programming Languages and Frameworks: Developers accustomed to environments like Unity (C#) or Unreal Engine (C++) must shift to using Swift and SwiftUI for AVP development, which may require additional learning.​
• Unity Integration: Unity’s support for visionOS through the PolySpatial package enables developers to build for AVP. However, certain features and components may have limited support or require adaptation. For instance, while many Unity components function without modification, rendering components may need adjustments due to platform-specific constraints.

For Unity developers, PolySpatial Kit is a blessing as it is a bridge between Unity and visionOS, allowing them to bring their existing Unity-based XR applications to Apple Vision Pro without completely rewriting them. It simplifies the process of creating spatial, immersive, and MR experiences, making AVP development much more accessible.

In a nutshell, Apple Vision Pro introduces innovative capabilities to the XR landscape, it also presents distinct challenges for developers, particularly concerning industry-standard feature support, graphics customization, and performance optimization. Leveraging resources like Unity’s PolySpatial package can aid in navigating these challenges, but developers must carefully consider these factors when embarking on AVP development.

AVP is still in its early stages, and developers should stay open to ongoing improvements that may enhance its flexibility and ease of use.

Next up, we will discuss on what we need to consider while developing on AVP. I will try to capture snapshots from my development with bits of GenAI usages and share my learning.

Until then, Its always good to read up and understand more on Vision OS environment https://docs.unity3d.com/Packages/com.unity.polyspatial.visionos@1.1/manual/visionOSPlatformOverview.html

Getting started on AVP -> https://medium.com/xrpractices/getting-started-with-apple-vision-pro-how-to-develop-build-and-deploy-apps-for-apple-vision-pro-f75f2bf492a2

Happy Coding !

XR App Development Challenges on Apple Vision Pro was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

Metaverse: The Next Internet

The Metaverse represents the next evolution of the internet, a digital realm where the physical and virtual worlds converge. In my book, 📕 Exploring the Metaverse, I delve into the current state of the Metaverse and how advancements in AI, IoT, networking, and cloud technologies are accelerating its development at an unprecedented pace.

As a call to action, I emphasize the importance of collaboration among industry leaders, academia, and individuals to establish standards and practices for the responsible use of the Metaverse. It is imperative that we all contribute to shaping this emerging space to ensure it benefits society as a whole.

As an industry expert from Thoughtworks, I am an active contributor at Metaverse India Standards and Practices (MIPS), an initiative by XTIC, IIT Madras. Under the guidance of Prof. M. Manivannan, our team at MIPS collaborated with the Telecommunication Engineering Centre (TEC), Department of Telecommunications (DOT) to provide recommendations for the ITU-T Study Group 20. Let’s explore this in greater detail.

ITU-T Study Group 20 Meeting

The International Telecommunication Union Telecommunication Standardization Sector (ITU-T) is a global body responsible for coordinating standards in telecommunications and Information Communication Technology (ICT). It brings together Member States, private sector entities, and academic institutions to develop standards like X.509,Y.3172, H.236 and more.

Study Group 20 (SG20) focuses on the Internet of Things (IoT), digital twins, and smart sustainable cities and communities. Representing the Republic of India, the Department of Telecommunications (DOT) plays a pivotal role in these discussions. It was an honor to participate in the recent SG20 meeting on behalf of the DOT and the Ministry of Telecommunications.

The event was a resounding success, with over 150 contributions submitted globally. Esteemed panelists reviewed these submissions in detail, approving 12 recommendations and accepting 31 new work items. For a comprehensive executive summary of the meeting, visit this link.

Contributions from India

India made significant contributions to the discussions, with inputs from MIPS, TEC, and other leading institutions and individuals. These contributions focused on standardizing IoT, the Metaverse, and smart cities and communities.

XTIC at IIT Madras on LinkedIn: #tec #dot_india #xtic #iitmadras #yoga #neerajmittalias...

During the meeting, I presented two key recommendations:

1. Requirements for IoT based food safety compliance
2. Framework and requirements for identity visualization in and across the Metaverse

I am thrilled to share that second recommendation on metaverse identity visualization is accepted as a new work item for the study period of 2025–2028. This recommendation aims to build trust in the Metaverse by ensuring users have the “right to know the reality” of what they encounter. Over the coming years, I hope to see this work item evolve into actionable recommendations and standards, helping to prevent the misuse of AI-generated fake identities and fostering trust and safety in digital interactions.

Exploring the Metaverse

My contributions to the ITU-T Study Group 20 are deeply rooted in the concepts I explore in Chapter 12 and 15 of my book, 📕 Exploring the Metaverse. If you’re interested in learning more about the Metaverse and its potential, I encourage you to grab a copy of the book.

☞ Click here to check availability and discounts in your region

☞ Read: Exploring the Metaverse — Synopsis

Acknowledgments

None of this would have been possible without the strong leadership of Mr. R. S. Singh, Dy. Director General (IoT), TEC, DOT, Ministry of Communications, India, and his dedicated team, who provided continuous guidance throughout the process. I am also deeply grateful to Prof. M. Manivannan and MIPS members, and Thoughtworks for unwavering encouragement and support, which inspires me to contribute more to the community and to India’s technological advancement.

Final Thoughts

The Metaverse is no longer a distant dream — it is rapidly becoming a reality. As we navigate this exciting new frontier, let’s commit to learning, sharing, and collaborating to ensure it evolves responsibly and inclusively.

Keep in touch, keep learning, and keep sharing!

Contributions to ITU-T SG-20 on IoT and Metaverse was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

🚀 My Book, Exploring the Metaverse, is available in stores worldwide, including Amazon and BPB Online. It features forewords and testimonials from industry pioneers, and it aims to uncover the concept of the Metaverse, offering insights into its technological and business implications.

A notable endorsement came from Mayan Shay— Principal Product, Amazon, who has great sense of user centric product designs, I have privilege working closely with her on Lenovo’s ThinkReality product like. We have filed number of patents together for our innovative work, some are granted .

Patent Granted: Manage multiple 2D apps in a 3D layout

🙏 A heartfelt thank to Mayan Shay, for her invaluable feedback on the early drafts and her thoughtful foreword. Her insights have truly enriched the book.

📖 Explore the Metaverse and redefine your understanding of the digital future!

We are standing at the cusp of a revolutionary era where the digital and physical will be intertwined and interchangeable. For decades, we’ve been making strides, unlocking different use cases with immersive experiences. For example, we help customers be more productive in enterprise, shop with confidence in retail, and have a more enjoyable gaming experience through overlaying the digital layer over the physical.

Through his book, “Exploring the Metaverse”, Kuldeep brilliantly lays out all the milestones that had led us to this point in time, where all the dots are connecting to a multifaceted and multi-layered phygital (physical and digital)world. He walks the readers through a thorough breakdown of the different use cases and gives actionable advice to those interested in actively participating in this field. This comprehensive guide is a must read for anyone interested in diving deep into the virtual vast ocean that is the Metaverse.

– Mayan Shay May Raz
Principal Product, Amazon

🛍️ Grab Your Copy Today!

Exploring the Metaverse is available on Amazon and BPB Online in both paperback and eBook formats. Get a sneak peek of the book and explore a free preview here.

☞ Click here for availability and discounts in your region

☞ Read: Exploring the Metaverse — Synopsis

Discover more about my books here.

Thoughtworks BPB Online Raju K

🙏 Exploring the Metaverse | Testimonial 11 was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

As we bid farewell to 2024 and welcome 2025, it’s a perfect moment to reflect on the lessons this year has offered — both rewarding and challenging — and to prepare for the opportunities ahead.

This year marked a significant milestone as I celebrated 20 years in the industry. Along this journey, I shared my experiences by publishing a book, contributing over 30 articles and whitepapers on topics like the AI-powered metaverse, IoT, D&Iand product management. I also engaged in 15 impactful events on platforms such as XTIC, XConf, Gatherverse, XROM, VRARA, and AWE. This journey was further enriched by the achievement of two patents.

Not everything went as planned, but each experience has been a stepping stone toward growth. True intelligence evolves through adaptation, and 2024 was undoubtedly the year when Artificial Intelligence (AI) took center stage, shaping industries and pushing boundaries.

Looking ahead, 2025 promises to bring more focused implementations — balancing AI advancements with broader efforts in digital modernization. Here are my top five observations on foundational shifts from 2024 and their anticipated evolution in 2025:

🤖 Benchmarking AI: A Year of Reality Checks

2024 marked the rise and scale of Generative AI (GenAI), bringing an abundance of AI-generated content across mediums like text, video, audio, apps, and games. While this wave will continue, 2025 will focus on testing AI’s real-world applicability, and making AI ready for production.

• Benchmarking and Specialization: Expect increased efforts to benchmark AI tools, refine their applications, and develop domain-specific solutions. Ref: Thoughtworks LLM EVal, SLM
• Smarter AI Layers: The loosely defined AI architectures of today will evolve into more adaptable, layered frameworks catering to diverse needs.
• Beyond Code Generation: The year will demystify the promise of “AI-first” software development, paving the way for tangible, scalable practices. Ref : Haiven™ team assistant

🤖 Humanizing AI-Generated Content

With AI content generation becoming ubiquitous, its value has diminished. In 2024, we began detecting and distinguishing AI content, creating a demand for human-like authenticity.

• Trust and Security: In 2025, the focus will shift toward ensuring trust in AI-generated outputs, especially in critical applications like code and design.
• Human-Like Outputs: Video, audio, and software will see advancements aimed at blending the precision of AI with the relatability of human-generated content. Ref : Writehuman, undetectable.ai

💰 Refocusing on Holistic Technology Modernization

While 2024’s AI hype consumed much of the attention, 2025 will also see investments redirected toward proven technologies like IoT, XR, and industrial automation.

• Balanced Investments: The AI dust will settle, leading to a pragmatic focus on real-world use cases and long-overdue modernization of legacy systems.
• Workforce Upskilling: The software services industry will experience renewed growth as organizations upskill employees to harness AI-enhanced tools effectively.

👩‍💻 Redefining Ways of Working

The hybrid work model matured in 2024, emphasizing the importance of working methods over mere locations, while keeping importance of location.

• Remote and Async-First Practices: As organizations find balance, asynchronous communication, written mediums, and AI-assisted tools will become essential for collaboration beyond time zones.
• Co-Location as a Tool: Strategic in-person connections will play a vital role in fostering team culture and collaboration.

🌐 Standardization and Generalization in Emerging Technologies

2024 reignited interest in emerging technologies like spatial computing, digital twins, volumetric apps with major announcements such as the Apple Vision Pro and Meta Orion. The computing would continue to evolve beyond cloud, and go from quantum to space.

• Grassroots Innovation: Expect foundational developments in XR operating systems, network protocols, and core technological frameworks, brining new ways of interactions. Ref Android XR, and unified OS like HarmonyOS
• Collaborative Standardization: Academia, industry, and governments will come together to establish standards and practices, echoing efforts like those of ITU-T and other global organizations. Ref: MIPS

📚 Carrying Forward the Vision of the Metaverse

As the term “Metaverse” evolves, alternative names like Physical Internet, 3D Internet, Semantic Web, and Web 3 are emerging. In my book “Exploring the Metaverse,” I delve into this transformative journey toward the next iteration of the internet. The metaverse, powered by immersive AI technologies, has the potential to revolutionize industries, and 2025 promises further adoption and refinement of these concepts. My patents achieved in 2024 reflect significant advancements in this space.

📖 “Exploring the Metaverse” is available globally on Amazon and BPB Online in both paperback and eBook formats. You can also access a free preview.

☞ Click here for availability and discounts in your region

🌟 Conclusion: Embrace Change, Seek Growth

2024 was a year of challenges and revelations, shattering myths and urging us to rethink traditional norms. It was a year of testing the waters, setting the stage for what’s to come. As we step into 2025, the focus shifts to realizing the impact of these foundational shifts, aligning with evolving needs, and navigating the transformative potential ahead.

Let’s move forward with adaptability, innovation, and an unwavering commitment to continuous improvement. 🚀

Testing the Ground: Reflections on 2024 and the Road Ahead for 2025 was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

Hosted alongside the Digitalization & Automation Technology Summit and Expo (DATs 2024) by the Institute of Technological Excellence (ITEx), this summit brought together downstream industry leaders and technologists to exchange knowledge and ideas.

It was a privilege to be invited as a speaker and to share my insights on emerging technologies alongside prominent industry leaders. I also had the opportunity to discuss my book 📚 Exploring the Metaverse with experts working in these transformative sectors.

Reimagining Downstream Efficiency and Safety with Immersive AI Technologies

As part of the technical track on Advanced Automation: Key Developments in AI/ML and Digital Twin Initiatives in the Process Sector, I delivered a talk focused on how Immersive AI can redefine efficiency and safety in downstream operations.

Highlights of My Talk:

• Understanding Immersive AI
  I introduced the concept of Immersive AI, a term derived from my book Exploring the Metaverse, to clarify myths and realities about this transformative technology.
• Making Artificial Sense of the World
  I explained how humans naturally sense and interact with their environment, drawing parallels to how digital technologies — such as cameras, sensors, and actuators — mimic and enhance these capabilities. This includes advancements in digital twins, spatial computing, eXtended Reality (XR), and metaverse solutions.
• Applications of Artificial Sensing
  From space-aware solutions and advanced training programs to remote monitoring, virtual assistants, and predictive simulations, I highlighted real-world use cases that demonstrate the transformative potential of Immersive AI.
• Considerations and Way Forward
  I concluded by emphasizing the importance of collaboration among industry, academia, and policymakers to address ethical, technical, and societal implications of these advancements.

The session presentation

Notable Contributions in the Track:

• Sourabh Gupta (Honeywell UOP): Highlighted the role of remote monitoring, exception-based alerts, and benchmarking in process optimization.
• Prabhas Mishri (BPCL): Delivered a compelling session on optimizing pigging frequency in delayed coking units using machine learning for predictive maintenance.
• Moderator: The session was skillfully moderated by Mr. Kiran Khannas, an industry veteran at Honeywell and former nuclear scientist.

📚 My Book: Exploring the Metaverse

I was delighted to present my book Exploring the Metaverse at the event and engage in thought-provoking discussions on the future of the internet and AI-powered technologies. The book delves into the emerging metaverse and its applications, offering a unique perspective for technologists and industry professionals.

📖 Available on Amazon and BPB Online in paperback and eBook formats, with a free preview available.

☞ Click here for availability and discounts in your region

Acknowledgments

A big thanks to the organizers and participants for making IPOS 2024 a remarkable experience. Such forums are vital for sharing knowledge and driving innovation.

Keep Learning, Keep Sharing!

Immersive AI at IPOS 2024: Transforming the Process Sector was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

November was a month filled with learning and sharing! After the inspiring XR Summit 2024 at IIT Madras, I had the privilege of attending another fantastic event — XConf 2024 by Thoughtworks India. Here are my key takeaways from this incredible gathering of technologists.

About XConf

XConf is Thoughtworks’ annual technology event, designed by technologists for technologists. Sponsored this year by AWS and CockroachDB, it celebrates innovation and the transformative power of software in the real world.

Having spoken at XConf 2021, 2022, 2023, this year was extra special for me. I proudly showcased my book 📕 Exploring the Metaverse, at the Author’s Corner.

I also supported the Emerging Tech Track and contributed to the Experience Zone, which featured hands-on demonstrations of cutting-edge tech.

Here’s a glimpse into the highlights of the event:

Top Tech Trends

Bharani Subramaniam and Vanya Seth shared this year’s top 8 tech trends, including:

• Generative AI Beyond Coding: Moving from “10x developers” to “10x teams” with AI-assisted collaboration tools like Thoughtworks Heaven.
• RAG (Retrieval-Augmented Generation) and SLM: Highlighting the shift toward lightweight, efficient AI.
• LLM Evaluations and Local-First Software: Building reliable systems that are user-centric and scalable.

Keynote Highlights

Innovation at Scale: Agentic AI

Kiran Jagannath and Satinder Singh from AWS shared Amazon’s vision for powering India’s growth as a global tech leader. AWS’s contributions to projects like CoWIN, DigiYatra, and UPI demonstrate technology’s transformative role in democratizing talent and driving India toward becoming the 3rd largest economy.

They also talked about how AWS’s in-house AI chips will be making LLM compute accessible to masses, with Amazon Bedrock Agent pushing boundaries in Agentic AI.

🇮🇳 Astrophysics: A Technological Marvel

Hearing from Annapurni Subramaniam, Director of the Indian Institute of Astrophysics, was an awe-inspiring experience. She shared the cutting-edge tech behind varius observatory telescopes in India, India’s astrophysical exploration and contributions to the Thirty Meter Telescope (TMT) project.

For me, space exploration feels like the ultimate metaverse — a new world waiting to be discovered. Seeing the tech behind controlling observatories and telescopes remotely for years is truly remarkable.

Tech Tracks

XConf offered insightful tracks Data & AI, Distributed Systems and Emerging Tech

The Emerging Tech Track, where I supported to bring up following interesting talks to the audience:

• The evolution of XR
• Continuous compliance
• Engineering practices for machines

I also snuck into some sessions from other tracks, and most were packed with fascinating insights!

Experience Zones

The Experience Zone showcased cutting-edge tech, including Apple Vision Pro, industrial AR/VR applications, and GenAI demonstrations. Our GenAI Booth, along with partner booths from AWS and CockroachDB, attracted enthusiastic crowds.

Author’s Corner

The Author’s Corner, introduced last year, continued to shine as a unique highlight. This year, I proudly displayed my book 📕 Exploring the Metaverse, alongside Unmesh Joshi’s Patterns of Distributed Systems. Visitors could engage with us directly, ask questions, and even get their copies signed!

Unmesh also led a workshop, leaving participants with valuable hands-on learning experiences.

The event was filled with knowledge-sharing, collaboration, and inspiration, all complemented by amazing food and great conversations.

Wishing everyone continued success on their tech journeys! Let’s keep innovating and exploring. 🚀

XConf-2024 — Thoughtworks India — Takeaways was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.

My takeaways from XR Summit and AWE Nite at IIT Madras

I recently had the privilege of attending XR Summit 2024 at the eXperiential Technology Innovation Center (XTIC), IIT Madras. My heartfelt thanks to Prof. Mani and his team for the kind invitation and to Thoughtworks for making all the arrangements seamless.

The event was nothing short of extraordinary — a world-class summit showcasing groundbreaking advancements, with an exciting lineup of sessions led by industry pioneers and academics. The topics covered were diverse, thought-provoking, and visionary. In this article, I’m sharing some of my key takeaways from this incredible experience.

🥽 Oculus: A Marvel of Engineering

It was inspiring to hear directly from Steve LaVelle (Founder of Oculus) about the engineering brilliance behind Oculus. This revolutionary device created such a buzz that it was acquired by Facebook (now Meta) for $3 billion within just a few years of its inception.

Steve shared insights into how AI, estimation techniques, and human perception engineering have been considered into the development of Oculus. He focus on designing human-centric experiences that go beyond technology resonated deeply with me.

While the XR industry still faces challenges like battery life, device weight, and ergonomics, the advancements so far are awe-inspiring, and the field continues to evolve. For instance, using XR to train AI agents — similar to scenarios I wrote earlier like virtual car parking — highlights the profound potential of merging perception engineering with immersive tech.

It’s clear that XR will remain a significant focus area, continuing to amaze us despite the ups and downs of the industry hype cycles.

🤝 Government, Academia, and Law: Collaboration in Action

The event emphasized the critical collaboration between government, academia, and law in advancing XR. I was amazed by the various initiatives aimed at skill development, supported by state and central governments. Representatives from Media and Entertainment Skills Council (MESC) highlighted numerous certification programs and training initiatives under Skill India and PMKVY. Similarly, the NPTEL courses by IITs and othersare playing a significant role in upskilling talent in this domain.

Mr. Ashish Kulkarni, Chairman of AVGC-XR Forum, FICCI, opportunities in AVGC XR, discussed ongoing work on defining standards and policies for the AVGC sector, sharing initiatives with both state and central government in India 🇮🇳.

Ms. N.S. Nappinai, Sr. Advocate, Supreme Court, provided crucial insights on the legal aspects of XR, emphasizing the importance of creating a safe, inclusive digital ecosystem. Her discussion on cyber misogyny and gender justice underscored the need for responsible technological advancements.

The collaboration at Metaverse India Policies and Standards (MIPS), of which I am a proud member, also aligns here. All this with the themes of my book, 📕 Exploring the Metaverse. It reflects the need for a collective effort from governing bodies, academia, industry, and individuals.

👁️ Lensless Camera: A Game-Changing Innovation

One of the most jaw-dropping sessions was on the lensless camera, presented by Dr. Kowshik Mitra. The concept of a camera without a lens seems unimaginable, yet this innovation uses sensors to generate image masks and reverse-engineer actual pictures through algorithms.

This breakthrough could significantly reduce the weight and bulk of XR devices, paving the way for applications in edible devices, endoscopy, and more. While still in its early stages, the potential is immense.

⌛️ Extending Reality: A Long-Term Vision

Renowned academics such as Prof. Marimuthu Palanisamy(University of Melbourne), Prof. Mel Slater(University of Barcelona), Dr. Anna Yershova LaVelle(University of Oulu), and Prof. Mandayam Srinivasan(MIT Touchlab) shared insights into the evolutionary nature of XR technologies.

Their discussions reinforced that extending reality is a long-term vision, requiring continuous innovation and investment. It is not a trend tied to the hype cycle but an ongoing journey that demands perseverance and creativity.

🗣️ Ethics, Security, and Responsible Technology

I joined the panel Mr. Anumukonda Ramesh, Mr. Prem Balachandran, Mr. Aditya Raut, Dr. Pravin Nair, Mr. Alagarsamy Mayan and discussed “Convergence of XR with AI, Gaming, and AVGC”.

There were number of inspiring sessions covering pressing issues like ethics, trust, and security in the XR space, spanning industries such as healthcare, education, cybersecurity, manufacturing, and retail. I wish I could attend all of them, but they were in parellel tracks. The discussions were rich with insights and reflected a shared commitment to building a responsible, trustworthy future for XR, Web3 and Metaverse by industry leaders from TCS, HCL Tech, Samsung, Ericsson, Markel Haptics and more.

🧠 Aligning XR Design with Neuroscience

One of the highlight of the summit was Mohsin Memon’s workshop on how neuroscience informs XR design. He presented the AFERR model — Activation, Forecasting, Experimentation, Realization, and Reflection, this model emphasizes the importance of designing XR experiences that align with human brain functioning.

I have often stressed in my book 📕 Exploring the Metaverse that XR is about changing beliefs, and design plays a critical role in achieving this transformation. Mohsin’s research further reinforced this perspective.

🎭The Convergence of Art, Science, and Technology

One of the most inspiring moments of the summit was witnessing the convergence of art, science, and technology. The VR movie Le Musk, created by the legendary Dr. A.R. Rahman, is a testament to this synergy.

Dr. Rahman was honored with the XTIC Award 2024 for Innovation.

XTIC on LinkedIn: #xticaward2024 #arrahman #lemusk #xrsummit #iitmadras #innovationintech...

and he facilited startup awards also unveiled the XTIC Chronicle’s Special Edition, which features an my article and book. This convergence of creativity and innovation encapsulates the essence of XR.

🤔Reflections and Closing Thoughts

The XR Summit 2024 was a perfect blend of innovation, collaboration, and inspiration. From exploring cutting-edge technologies to discussing ethical and legal frameworks, the event provided a 360-degree view of the XR landscape. Overall it fit well with the theme of my book.

📕 I am delighted to have shared my Exploring the Metaverse, with the audience and to see its relevance reflected in the discussions.

The summit also featured fascinating booths from companies like Sony, Qualcomm, StoriXR, Merkel Haptic and more. My engaging conversations with Qualcomm executives on Spaces SDK and OpenXR were a fitting reminder of the work my team and I have done with Lenovo’s ThinkReality.

It was great in-person meeting with leaders Mr. Anumukonda Ramesh, Keyur Bhalavat, Navin Manaswi, Rabindra Sah, Thriveni and many more. This event also clubbed with AWE nite, with series of discussions, fire-side chat and delicious dinner.

Let’s continue to learn, share, and innovate as we extend the boundaries of reality!

XR Summit 2024, IIT Madras — Takeaways was originally published in XRPractices on Medium, where people are continuing the conversation by highlighting and responding to this story.