top of page

Beyond virtual DnD: AR Project

This AR project will explore user interaction and experience design using trackable AR targets. The product is designed to act as an accessibility support to the DnD beyond™ application. Individuals who struggle visualizing, or comprehending large bodies of text, could have trouble operating the DnD Beyond app. DnD is notoriously known for its large, but detailed bodies of text. Be it for spells, backgrounds, descriptions or stats. Adding a summarized, visual element to this interphase, can help users have a more pleasant experience with the game. Having the game details at the points of your fingers, summarised, can aid in speeding up combat scenarios, help visual based individuals understand gameplay.

01

Project Requirements

  • This AR project will explore user interaction and user experience design using trackable AR targets

  • Design own pop up theme and Interactive Target Design

  • Users should be able to interact with the experience through 3D Object Interfaces and 2D Interface Design. Objects in the scene should track and respond to users’ actions in intuitive and and understandable ways

  • Material / Lighting / Sound / UI / Animations should be considered as part of the storytelling and consistent throughout the design. Points of interaction should be legible in the design and create a mood within the scene. 

02

Project Concept

Product Sensibility 

The product is designed to act as a compliment and to be incorporated with the ”DnD Beyond” app. Thus far the product is only in prototype phase. In order to be incorporated, access to user account logins, permission from Wizards of the Coast, and incorporation with 3D modelling software will be required.
 

Concept 

The product is designed to act as an accessibility support to the DnD beyond application. Individuals who struggle visualizing, or comprehending large bodies of text, could have trouble operating the DnD Beyond app. DnD is notoriously known for its large, but detailed bodies of text. Be it for spells, backgrounds, descriptions or stats. Adding a summarized, visual element to this interphase, can help users have a more pleasant experience with the game. Having the game details at the points of your fingers, summarised, can aid in speeding up combat scenarios, help visual based individuals understand gameplay.

 

Medium

Unity & Vuforia

Goals

Summarise DnD Beyond page information

Visual effects for interactions

Features

Interactive: pop ups, sounds, animations, summarised text
 

Brainstorming.png

03

Brainstorming

Content interphase of content on the DnD Beyond website. 

Themed according to the Wizards of the coast books.

Display similar to JARVIS, interactive and responsive based on personal needs (user based account)

Interactive and customizable 

04

Story board

Character avatar central. Click for animate/ speech?

 

2 side panels

appearance

- Clothing (dress up element)

Description

-Summary of content- actions, skills, inventory

Main panel

Stats- quick access to key character features

Dice- interactive gameplay 

20210719_102425.jpg
luna-black.jpg

05

Target image

Individual based target image according to character sheet

06

Project Storyboard: Levels of inclusion

Levels of inclusion.png

07

Anticipated Project Challenges

Setting up a concise theme

Since the app is set in a fantasy setting, gathering immersive sprites, audio, and ambience. It will take time to make/ gather assets.

Improving hierarchy setup

Previous project I just added everything with little organisation, I would like to improve the set up this time.

Layout

There is a lot of information I would like displayed, so it would be important to plan out the interfase before hand.
 

08

Demo

What you will see in this product video

The demo demonstrates the use of the application. It starts with the main menu and user help screen, and follows into the AR camera. After the target is scanned, the user’s dnd character with their corresponding character sheet will be displayed. 


What to Look Out For 

Try out the different outfit combinations the avatar has. 

See if you can roll a natural 20 with the dice.

Explore cleric spells.

09

Project Challenges

  • Scaling of UI

    • Using text mesh pro can have an effect on the scaling of the UI. 

    • Make sure things are anchored, and in scale 1:1:1 or, when building, assets will not be in the correct spacing

    • The size of the image target (physical printed) has an effect on size of rendering. A smaller printed target, yields better results. 

  • Project not building correctly

    • I just had the wrong scene in my build settings. PEBKAC. Make sure the correct scene is in your build settings. If you move your scene, or rename it, it will no longer be correct in the build settings and your project wont build correctly. Please always make sure the correct scene is in the build settings. 

10

Lessons learned

  • Check anchors

    • Scaling canvas to character

    • Shift alt 

    • Keep scale 1:1:1, rather change l:w:h

 

  • Make character stay on screen even if target is lost

    • World space

 

  • Layout groups and ui elements

ENHANCMENTS.png

11

Enhancements

  • Make the avatar based on character sheet

    • I'm not the best 3D modeller, I have like a week of experience, but I would still like to make my own characters, because commissions and assets can be expensive. So I did my research on options. 

    • I figured that custom mini’s could work. Yes and no. Most mini’s are only in physical material, which can be delivered to an address, not the mesh itself. 

    • Further research led me to discover Desktop Hero. They have an option to download the mesh for free.

    • However, most of the items are paid.  It is extremely high poly. I don’t know how to animate.

 

  • My next explore will be how to reduce the poly count, and how to animate the 3D model.

bottom of page