**Short Description:** This project will extend [KodaDot NFT explorer](https://nft.kodadot.xyz) with the ability to showcase, render and interact with NFTs in extended reality. The main idea is to leverage existing technology to show NFT items in AR/VR, i.e. create interaction leveraging Subsocial on particular NFT items in XR, make it compatible with an existing headset like Oculus, Hololens, Magicleap and make it compatible viewable through usual Android or iOS smartphone device.

[Original proposal document on past grant M1 and upcoming M2 could be found here](https://docs.google.com/document/d/10LjFxQsOE0XbWosck4RO-8A41fSq5ASXXKrpIw7UM7I/edit?usp=sharing)

## 1. Context of the proposal

The main delivery is to implement basic WebXR (AR/VR) implementation of NFT assets to render them in customizable metaverses in a low-poly model and create an ability to interact with them, make transactions, manipulate them in space.

## 2. Problem statement
- Right now there is no metaverse movement around [Kusama.network]() 
- There is known [bit.country]() yet doesn't provide anything accessible right now.
- We think that [webXR Device API](https://immersive-web.github.io/webxr/) will be probably a new way to interact with future content on the web.

## 3. Functional objectives
* Linkable ephemeral scenes to explore in metaverse nature
* Model viewer of 3D models - [Proof of work here](https://nft.kodadot.xyz/rmrk/detail/6825929-0E76E3AC15B4C1FA1E-GLITCH-LIDAR_MALFUNCTION-0000000000000002) 
* Create a multi spatial experience in web XR using RMRK.app, i.e. interactive virtual galleries 
* Possibility to set the position of objects in space and combine them together
* Integration Subsocial for deeper interaction within XR assets
* Specific web XR interface for better interaction with web XR devices
* Create collaboration surface in Metaverses for Kusama

### Milestone 2: duration 6 weeks (covered on this treasury proposal) - 27,000 EUR
#### Deliverables
* Research on AR/VR architecture and how assets could be explored in metaverse
* Create page & components which displays selected NFTs in AR/VR space by user or address of asset
* Implement sharable ability through links 
* Write implementation for showing metadata for particular NFT 
* Ability to view collection in AR/VR - putting NFT in the 3D space
* Co-operation with AR/VR experts to get best industry standards in place in works
* Possibility to set position of objects in space and combine together
* Create WebXR scenes to combine multimedia assets (images, audio, video, 3d objects)
* Integration Subsocial for deeper interaction within XR assets
* Specific WebXR interface for better interaction with webXR devices
* Release open source library to interact with RMRK on Kusama through AR/VR
* Documentation of open source library
* Support for common AR and VR headsets like Oculus Quest (2) and AR headsets like nReal, Magic Leap and Holo Lens
* Cover partially acquisition costs for HW like
Oculus Quest 299USD 
MagicLeap or HoloLens2, what’s more accessible to deliver to develop for best webXR experience for headsets (approx HL2 3500USD, ML 2440GBP)
* Device for creating LiDar scans - most viable option we’ve found is iPhone12 Pro (1150EUR)


## The team behind it

* Matej Nemcek ([@yangwao](https://twitter.com/yangwao)) - Co-Founder of [KodaDot](https://twitter.com/kodadot), VueJS background, more info [hypersignal.xyz]()
* Viktor Valastin ([@vikiival](https://twitter.com/vikiival)) - Co-Founder of [KodaDot](https://twitter.com/kodadot), Publication about carsharing dApp on ETH using ERC721 token composition. Working for a company which is creating car-management software(React, Spring) and R&D in blockchain.

## Team Code Repositories
* [github.com/kodadot/nft-gallery](https://github.com/kodadot/nft-gallery)

## Work being already done towards this proposal
* [KodaDot NFT explorer](https://kusama.polkassembly.io/post/384) - Milestone 1
* Model viewer of 3D models - [Proof of work here](https://nft.kodadot.xyz/rmrk/detail/6825929-0E76E3AC15B4C1FA1E-GLITCH-LIDAR_MALFUNCTION-0000000000000002) 
* Attract new user base to Kusama ecosystem through AR/VR functionality [[1]](https://twitter.com/FeiStrife/status/1335404817821339656)

: This project will extend KodaDot NFT explorer with the ability to showcase, render, and interact with NFTs in extended reality. The team will use the WebXR device API to create linkable ephemeral scenes to explore within a metaverse, as well as model viewers of three-dimensional models, and possibilities to set the position of objects in space. It will also integrate with Subsocial for deeper interaction and collaborate with AR/VR experts for standards. The team has already done work towards this proposal with the KodaDot NFT explorer and its proof of work.

#577 KodaDot NFT eXtended Reality - webXR