There are plenty of opportunities for designers and brands to explore the possibilities of augmented reality (AR) and how it can enhance creative work, provide entertainment or better society.
Tech giants such as Microsoft, Google and Apple – but also everything from children’s books to 3D modelling for gaming – are experimenting with AR. The abundance of free content creation apps are democratising AR, which means anyone (not just developers) can create their own AR experiences.
This feature provides a broad overview on what augmented reality is, what it’s used for and how you can use it to create your own content.
What is augmented reality?
With lots of buzzwords being thrown around lately, it’s important to understand exactly what augmented reality provides (yes, it’s moved beyond just QR scanning) for the user compared with mixed reality and virtual reality.
Augmented reality uses existing reality and physical objects to trigger computer-generated enhancements over the top of reality, in real time. Essentially, AR is a technology that lays computer-generated images over a user’s view of the real world. These images typically take shape as 3D models, videos and information.
How this is overlaid depends on the nature of the experience – and the hardware you’re looking at the experience on. The simplest way is using your phone – where what you see through the camera has digital elements added to it. The best known example of this is Pokemon Go – but it has also been used to guide people around places, with virtual signposts added giving directions, or in art galleries to bring up information on artworks as you look at them ‘through your phone’.
,
,
This can feel clunky, so for a more immersive experience you can slip on a headset such as Microsoft’s HoloLens – which frees you up from having to hold up a phone and makes the mix of the real world and CG (computer-generated) elements feel a lot more real.
Augmented reality vs mixed reality and virtual reality
Microsoft brought the term ‘mixed reality’ (MR) back into the spotlight when it released the HoloLens (see what the HoloLens can do for designers and artists here). Some predict it might have been to distinguish their technology as something new and different. Microsoft says it was used to simplify the VR/AR spectrum. Either way, the new term may have caused more confusion than it’s worth.
,
,
Microsoft’s HoloLens
Mixed reality lets users interact with virtual holograms and real objects within their physical world. Although this is what augmented reality does – mixed reality is said to anchor virtual objects to a point in real space, making it possible to treat them as ‘real’ from the perspective of the person using MR devices. Essentially, the digital illusion is harder to break.
AR is also not to be confused with virtual reality (VR), which is a fully immersive experience for the user without interaction of the physical world around them. VR is a computer-generated simulation of 3D images (or usually an environment) that can be interacted with by the user in a seemingly real way through the aid of a headset and/or gloves, but it’s essentially quite an isolating experience.
How does AR work?
Augmented reality works in conjunction with headsets and/or digital devices such as tablets, smartphones and even PCs. The devices themselves contain software, sensors and digital projectors that trigger digital displays onto physical objects.
AR can be created and consumed in many different forms. For example, Google Glass displays 2D images onto see-through glasses, whilst Microsoft’s HoloLens embeds 3D images into the world around you. Apps such as Blippar, Zappar andAurasma allow affordable (if not free) AR content creation for small businesses, education and plenty more industries, and of course AR features within existing smart phone apps and games, such as Snapchat and Pokémon Go.
The AR process uses a camera with “scanning mode”. To use some AR creation apps like Blippar, you’ll need to point the scanning camera at different objects in the room to create a database of shapes and corners. Once the camera detects a ‘triggering’ object from it’s database, a digital object onscreen will appear in the position of the target object, as seen in the video below.
,
,
In turn, businesses can download Zapworks Studio for a small price to create, edit and track the success of their own AR content.
,
,
London-based UX designer Radu Fotolescu predicts augmented reality will boost the retail sector, and help simple tasks like finding the right part in a car when it breaks down in the future (as seen below).
Gaming
Augmented reality is probably best known for its use within games, especially Pokémon Go. AR gaming essentially integrates game visual and audio content with the user’s environment in real-time.
Just type ‘Augmented Reality Games’ into Google to get an understanding of what’s on offer right now. I tried Zappar’s mini golf game – the experience of hitting a digital mini golf ball with a physical cardboard controller and headset (seen below). We’ve also featured SwapBots, a children’s game which pairs with an iPad, earlier this year.
AR games can be used as another source of branding experience for consumers.
But beyond mere pleasure and entertainment, AR has some serious societal benefits as well.
Education
In a world where simply studying a textbook or YouTube video isn’t enough to stimulate young digital-native minds, AR offers a new experience of transferring information. AR hardware such as the ZapBox kit offer a much more affordable option for schools to purchase for multiple classrooms, in comparison to the HTC Vive, Oculus Rift, or Microsoft’s HoloLens which currently sits at a staggering £2,719 for the development edition.
Educators can create their own learning environment using software like Blippbuilder, monitor student performance and share and collaborate with different teachers, students and content providers.
For example, Volcano Activity is a prototype being tested in classrooms right now, available through Blippar. Students can download the Blippar app onto a smartphone, aim and frame the whole image and watch a 3D model of a volcano erupt before opening detailed information and a quiz.
Google also provides AR education through its Pioneer Program and Zapworksoffers lesson plans and tools for teachers.
Museums are also working with AR technology to provide more information about exhibitions. The British Museum has forged a partnership with Samsung and is trialling in-gallery apps.
Architecture
Architects are experimenting with different augmented reality apps and software – from Microsoft’s HoloLens to free apps – mainly used to build 3D virtual building models which can be experienced from the interior and exterior using an AR headset.
But unlike virtual reality, AR allows architects to project digital information onto physical scale models. From a commercial perspective, architectural firms can sell and present building projects using AR to digitally create a 3D model of floor maps and brochures, for example.
How can I create my own AR content/project?
There are lots of different apps, software and headsets to get your hands on for an augmented reality experience, all of which vary drastically in price and availability. The high-end option is Microsoft’s HoloLens, which claims to be the first self-contained holographic computer. Check out what it can do for designers and artists in our extensive review. And of course, we’ve already mentioned Apple’s ARKit if you own the right devices.
But if you’re a creative professional wanting to get a handle on AR and how to use it, it’s worth experimenting with the following affordable apps and drag-and-drop software.
Aurasma
Speaking to a student at London College of Communication’s (LCC) grad show this year, we discovered Aurasma – a free app he used to create an incredible AR project. Aurasma is available to anyone with an email address. All you need to do is create an account, create content using its drag-and-drop web studio (which also measures commercial results), share it with customers or fans and download the app. You can even create your own whitelabeled instance of the Aurasma app or embed the technology into new or existing apps. Brands like Disney and AMC Theatres already use it.
Aurasma is aimed at marketers, agencies, developers, educators and students. Watch the video below to learn how to create AR in Aurasma Studio.
,
,
Learn how to use the Zapworks Designer tool in the video below.
,
Source: Digital Arts Online