3D augmentation on an image reference

Foreword

This tutorial will show you how to create a simple project with a 3D augmentation displayed relative to a textured image reference with AugmentedPro Creator and get it ready to play in AugmentedPro Player.

In this tutorial a reference image is used to display visual information in augmented reality. Please follow the following recommendations to get the best tracking results:

  • Select a textured reference image. Uniform images cannot be used for tracking.
  • Make sure that the resolution of the reference image inserted in AugmentedPro Creator is close to the resolution of the camera used in your target device.

A calibrated camera is required to display 3D augmentations with AugmentedPro Player. Please refer to the Calibration tutorial to learn how to get the calibration parameters for your target device.

Step by step procedure

Launch AugmentedPro Creator, click on the New Project button, choose a device or create a new one and click on the OK button.

A new AugmentedPro project is created with a default start screen that appears in an opened tab. Add an augmentation to the current screen by clicking on the Augmentation button in the Insert menu.

A file explorer dialog appears to select the trackable, which is the reference model used for the tracking process, in this tutorial our textured reference image.

When inserting a new augmentation from an active screen tab, a new tab is opened for this augmentation and the following actions are done automatically by AugmentedPro Creator:

  • Create a camera stream in the active screen
  • Create a new beacon, which is a container that shares a common trackable with its augmentations and detections children
  • Create the trackable associated to the beacon container
  • Create a new augmentation as a child of the beacon just created
  • Add an augmentation item to the camera stream in the active screen, that refers to the augmentation just created

When creating a new augmentation, the container tab only shows the trackable, but no visual information to be displayed in augmented reality has been defined at this point. You can now add visual content to be displayed in augmented reality when playing the project in AugmentedPro Player, either through the Insert menu, or through the Libraries menu to insert predefined objects. In this tutorial, a predefined 3D model is inserted into our augmentation container.

Select AdjustableWrench.obj in the 3D Models dropdown list in the Libraries menu.

In AugmentedPro Creator, images are displayed with an interpretation of the image resolution in meters with 1 pixel = 1 mm. 3D objects are loaded with a default interpretation of coordinates in meters. The resolution of the texture image used in this tutorial is 760x760, and the 3D model of the wrench used has coordinates defined over 30, which is the reason why the wrench is first displayed more than 30 times bigger than the trackable image. In the properties pane, change the 3D model unit to cm.

Move the camera around the 3D scene by moving the mouse with the right button pressed, or by zooming in and out with the mouse wheel. Move the 3D model in translation and rotation with the arrows and circles that appear around the object when selecting it.

Select the screen tab and add an exit button by selecting Exit in the Button dropdown list in the Insert menu. You can then move the button in the screen.

In the file menu, save your work into an .apc file by clicking on the Save as... button and export the project to an .app file by clicking on the Export to Player button that can be transferred to AugmentedPro Player.

When transferring your app file to AugmentedPro Player on your target device, make sure to copy it to the projects folder. You can find the complete path of the projects folder in AugmentedPro Player on your target device, Settings section, Folders tab. The project appears automatically in the Projects column of the start screen in AugmentedPro Player. Make sure that your target device has a valid license that allows you to play personal projects. You can check the status of your license in the License tab of the settings section in AugmentedPro Player.