GIBSON Prototype

Project GIBSON has started as the forth joint research project with Hakuhodo DY Holdings, which follows AR City in Kobe, Spatial Message, and mirr. The global pandemic of COVID-19 restricts our physical travel and reduces the chance to see people.

As a solution to the situation and a way of communication that re-connect people, we created a cross-AR/VR experience that delivers the feeling of co-presence while staying away. This prototype used MESON office for its location to verify the technical and UX value of the cross-AR/VR experience. 

GIBSON enables the communication experience that allows AR users who stays in the real space and VR users who access the space remotely to share the same space by building a digita twin, a digital copy of the real world.

GIBSON provides a realtime, immersive communication experience in which people have the same environmental contexts of either the real space or the cyber space by sharing information of user, object, and space via a RGB camera and a LiDAR sensing device. This prototype used MESON office’s digital twin to verify the technical and UX value of the cross-AR/VR experience.

In phase 1, we build a digital copy of our office and made a cross AR/VR experience. Using iPad LiDAR sensing application 3D Scanner App, we scaned the office and build a 3D model of our office in Blender in reference to the scanned data.

After this prototype expereiment, we challenged a city-scale experienment of GIBSON in collaboration with Japan's Ministry of Land, Infrastructure, Transport and Tourism.

Through the prototype development, we were able to verify the necessary functions to conduct demonstration experiments in real life situations. Possible cases for demonstration experiments include "sightseeing" and "shopping," for example.

Tourists can connect to this platform from remote locations using VR devices and walk around on the digital twin of highly immersive tourist attractions built in cyberspace and communicate with local people, or they can connect to the GIBSON platform from remote locations and talk with brand staff in the actual location by entering a shop built in cyberspace.

In this use case, you can actually talk with the local brand staff and check the products in the store in detail and purchase them by entering the store built in cyberspace. GIBSON is actively seeking partners to conduct such demonstrations.