Glasses with augmented reality (AR) capabilities can analyze and comprehend their environment thanks to sensors like lidar and cameras. Through specialized software, these glasses use artificial intelligence and machine learning to create a virtual map of the surrounding area using the information collected by the sensors. Through the virtual map, the AR glasses track the wearer's location and enable the placement of digital objects in the real world. Through the use of glasses, this technology gives the impression that digital objects are real-world objects.

Display

In augmented reality glasses, the combiner combines digital LED or OLED screens for computer-generated images with glass lenses for natural light entry. This enables users to view images from digitally generated objects and the real world at the same time.

Camera

Since the augmented reality app cannot see the owners surroundings through their eyes, AR glasses have a camera built in to take pictures of the real world. When used in conjunction with AR glasses, the camera is either integrated into the glasses or activated on a smartphone.

Registration

In order to place augmented reality (AR) objects in the actual world, the device's computational component must follow invisible icons or markers. These markers, which are frequently found in augmented reality software, make use of actual landmarks like corners, window lines, or object shapes to make object placement easier, as in the case of home décor applications.

Computer perception

The combination of images produced by marker registration and those taken by the camera creates magic. These two kinds of images are combined by the software package or app. When choosing AR glasses, the field of view is very important. Considering that the human field of vision is roughly 210 degrees horizontally and 150 degrees vertically on average, AR glasses are limited by the size of their lenses and their computational capacity. For augmented reality glasses, a 50-degree field of view is currently regarded as large, which affects how immersed one is in the experience.

Microsoft HoloLens 2 – Glasses for AR

Microsoft HoloLens 2 is the second iteration of a revolutionary mixed reality device. It's a device with a shield on your eyes that you put on your head, which allows a completely new way of interacting with information. It is a stand-alone device with an on-board computer and a built-in Wi-Fi module that acts as a data client on a stand-alone device, the Azure cloud, or the web in general.  

HoloLens 2 runs on the Windows Holographic OS, which is very similar to Windows 10 and provides users, administrators, and developers with a robust, powerful, and secure platform. Compared to its predecessor, this is an almost brand-new product with more computing power, better sensors, longer battery life and a few extra features that should be mentioned. It has a larger FOV - a display field that allows the user to see more information and makes the device more interesting to use with applications that provide a large amount of information.  

Brand new, more intuitive hand gestures are available to make content easier to manipulate. Any command can be executed by combining the user's hand movement with voice control. The most visible improvement over the old model is that the device is smaller and lighter. This makes it much more comfortable to wear and work with.  

HoloLens 2 contains several sensors, namely - 4 cameras (visible light) for head tracking, 2 infrared cameras for eye tracking, 1 megapixel depth camera, accelerometer, gyroscope, magnetometer and one 8-megapixel camera with HD resolution. 

Microsoft HoloLens 2 (zdroj: microsoft.com)

Microsoft HoloLens 2 (source: microsoft.com)

The basic functions of this device include the following:

  1. World-anchoring - HoloLens 2 understands the workspace so digital content and holograms remain anchored where they were created
  2. Hand tracking - allows you to touch, grab and scroll holograms in a natural way
  3. Eye tracking - the device captures where the user is looking, so he can understand the intent and adjust the holograms to his eyes in real time
  4. Voice enabled - built-in voice commands allow you to move and control the device quickly while your hands are busy with a task
  5. Azure-powered stream - allows you to stream 3D content using the Microsoft Azure cloud platform
  6. Mixed reality capture - allows you to document all experiences, whether as a photo or as a video that can be shared with others
  7. Ergonomic - the device is heavy (3.28 kg) and you can move freely without cables or external packaging
Microsoft offers several approaches to content development for HoloLens devices. For example, it provides cloud services on the Microsoft Azure platform, which are not complicated to use and can serve as a starting point for application development. For developers who at some point do not have access to a physical representation of these glasses, a software emulator is available, on which they are able to develop and test their applications. Application development for HoloLens devices needs to target the Universal Windows Platform for proper functioning. (An alternative in developing applications for HoloLens devices will focus on the target platform Universal Windows Platform).

Other similar devices for augmented reality include: Google Glass, Vuzix Blade AR, Raptor AR, and many others.