Creating a Space AR poster using Unity

1. Unity 3D - This lesson is developed using Unity 3D (2018 4.9f1) although any new version would work
2. Free account with Unity 3d (https://id.unity.com)
3. Vuforia SDK (V8.5.8) for Unity 3D
4. Free account with Vuforia developer (https://developer.vuforia.com)

• Printed copy of an Image Target. Download the image used in this project from here
• 3D object that you want to overlay image (Note: this lesson uses freely available 3D objects)
• Computer to install Unity 3D (check system requirements for development)
• iPad or a computer with a webcam (in-built or wired) to test AR poster

The following are some suggested steps for implementing the lesson.

1. If you haven’t installed Unity in your computer, please follow the comprehensive steps listed in the Unity documentation.
2. You will need a free account with Unity 3D to access free Unity assets. Follow the instructions to create an account.

3. You will need to add ‘Vuforia AR’ resources when you are installing Unity. ‘Check’ the Vuforia Augmented Reality Support during Unity installation as below. If you want to test your project using iOS or Android devices, check the corresponding components (Note: Be mindful about the Install Size of these components since you will need free disk space in your computer to install these). To develop this lesson, we used ‘Vuforia Augmented Reality Support’ and ‘iOS Build Support’.

   

4. If you have completed the above steps, click New button to start developing this lesson.

   

5. Provide a name for the project (e.g. AR_poster), select Template as 3D and choose a location from the computer to store the project files and click Create project (Note: it might take a while to import things needed for your project such as assets).
6. Please complete steps 2-4 in order to set up the environment for your Unity-AR project.
7. Once these steps are completed, start ‘Step 5’ to start developing your AR project.

1. When our camera recognises the image target, we want to overlay a 3D object over it.
2. If you want to add your own assets, you can create 3D models on your own or download from the web (Note: 3D models that compatible with Unity can be found here - https://docs.unity3d.com/Manual/3D-formats.html)
3. Below are some suggested websites to find good 3D models. Feel free to share new suggestions with the CSER community (https://teachingai.blog/)
   1. https://www.assetstore.unity3d.com/
   2. https://free3d.com/
   3. https://grabcad.com/

1. In order to start a new project, you will need to add a new scene by selecting File -> New Scene and provide a name for the scene (e.g. Astronaut). Alternatively, you can reuse the default SampleScene by deleting existing objects that loaded automatically.
2. In the left panel (Hierarchy), delete the default Main Camera and Directional light objects. To do this, right-click on each object and select Delete.
3. Once the existing objects are deleted, add ARCamera to the project by selecting GameObject > Vuforia Engine > AR Camera (if you are prompted for anything, you will have to authorise them all - e.g. importing additional assets).

   

4. You should see the AR Camera object added to the Hierarchy panel. Once you select AR Camera, you should see the Inspector panel on the right hand side. This demonstrates the configurations of the object.
5. Towards the bottom of the ‘Inspector’ section, you should see a button Open Vuforia Engine Configuration that is disabled by default.

   

6. To enable it, go to Edit > Project Settings and click on the Player button.

   

7. In the XR Settings section (bottom), select the option Vuforia Augmented Reality Supported (Click ‘accept’ if you were prompted for Vuforia Software Licence).
8. You can then close the Project Settings window and go back to the AR Camera’s configurations window.
9. The Open Vuforia Configurations button should be enabled by now (click ‘AR camera’ to see the ‘Inspector’ window).

   

10. You will need to have a webcam (either built-in or wired) configured for this project (Note: if you do not have a webcam, alternative steps for testing are listed at the bottom of this lesson). If you have only one camera associated with your PC or laptop, everything should be working fine with the default settings. To confirm this, click Resources in the Assets tab and select VuforiaConfiguration.asset.

    

11. In the Inspector window, check Webcam settings towards bottom. In the Camera Device, select the webcam you want to use for this project. Otherwise, leave Integrated Webcam as below.

    

12. To add an image target to our project, go to GameObject > Vuforia > Image. This will add the image target to your scene

13. In the Image Target Behaviour component, click on the Database drop-down list and select your Target database (e.g. VuforiaMars_Images). In the Image Target drop-down list, select the name of your Image Target (e.g. Astronaut) from the database.

    

    Note: You may have to zoom in a little bit inside your scene to see the image.

    

14. The default image comes from the Vuforia core samples we imported earlier. It can be replaced later with your custom image, but for now, we want to check that our setup is working.
15. Therefore, we use predefined as the Type of Image Target Behaviour. You can also define custom image targets by changing the Type to User Defined (See optional steps at the end of this lesson to add custom image targets).

    

16. Now we will need to add a 3D object to the Image Target. For this, right-click on the ImageTarget in the left panel and select Vuforia > ModelTarget.
17. We have selected VuforiaMars_ModelTarget as the Database and the Model Target in this project.
18. By default, the 3D model is quite big. Therefore, we need to scale it down. Click on the ModelTarget object in the left panel and update its scale in the right panel. A scale X, Y and Z of 0.5 should work well. After scaling it down, it should look something like below.

    

19. At this stage, we should test that our setup is working properly before starting to add our own assets. In the Hierarchy window, make sure the Model Target is placed under the Image Target (Note: You might want to change the position of the model, change the values of the Scale / Rotation (inside the inspector) to get it into the right place)

1. To learn more about Image Targets, click here.
2. In the Vuforia Developer Portal, select Target manager.
3. Click Add database, provide a name, select type as Device and click Create.

   

4. Now select the database we have created (e.g. Space_posters) and click Add Target.

   

   There should be four different target types. Select Single Image and browse your disk to locate the image you want to use as an Image Target

   1. The Width value (e.g. 5.5 in cm) is a scale value that you need to set to the size you want the image to appear in your Unity Scene (Note: Unity measures everything in your Scene in relation to the size of your Image Target).
   2. Give a name to the target and upload it
   3. Now the uploaded image appears in the list of targets with a rating. If the image you uploaded has low ratings, it may be difficult for the camera to track it (see more information here). In such cases, try to upload a different image.
   4. Once you are satisfied with your image’s rating, check the box next to Target Name and click Download Database button.
   5. Under the development platform, select Unity Editor and click Download and save this file (.unitypackage) in your disk.
   6. Switch back to your Unity project to use the Unity package in your AR application.
   7. Now, we need to import Image Target that we have saved. In the Project window, right click Assets and select Import Package > Custom Package and select the package saved in the disk before.
   8. Add you App Licence Key saved from Vuforia Licence Manager.
   9. Once you have set the image target, next step is to add image target to the scene by selecting GameObject > Vuforia > Image and follow the instructions listed in Step 5: AR development using Unity.

The following are some suggested discussion points to create the augmented world with astronaut poster. You can add answers to following questions as audios, new 3D models, videos, or new Image Targets.

• How many astronauts can live on the International Space Station at once?
• What was the first mission to successfully land on the Moon? Who involved? When was it?
• Which NASA space shuttle exploded 73 seconds into its flight? What was the reason? And which astronauts on board sacrificed their lives?
• Why 2019 October is important for female astronauts? What it means by ‘All-Female SpaceWalk’? Who is involved? (See more information here)
• How does the computer/device recognise the Target image?

An astronaut is a person trained by a human spaceflight program to command, pilot, or serve as a crew member of a spacecraft. Before learning about the life of an astronaut it is important to know about the environment where astronauts work. Space is located approximately 76 miles above the earth's surface. Because it is above the atmosphere, there is no air - more specifically there is no oxygen. Space is a dangerous place to travel, filled with unique challenges for working and living there. And yet, it somehow draws astronauts to go there and explore this vast unknown.

In this activity, students are engaged in evaluating the AR posters and considering how they could build their own AR/VR experience about astronauts. In doing so they are thinking about the digital content and ways of presenting information in a 3D space.