3D augmentation on a 3D model reference

Foreword

This tutorial will show you how to create a simple project with a 3D augmentation displayed relative to a 3D CAD model reference with AugmentedPro Creator and get it ready to play in AugmentedPro Player.

Make sure to use a 3D CAD model with visible edges in order to get the best tracking results.

The definition of a initial point of view is required to start the tracking of the CAD model and display the associated augmented reality visuals. You can define the initial point of view in AugmentedPro Creator.

A calibrated camera is required to display 3D augmentations with AugmentedPro Player. Please refer to the Calibration tutorial to learn how to get the calibration parameters for your target device.

Step by step procedure

Launch AugmentedPro Creator, click on the New Project button, choose a device or create a new one and click on the OK button.

A new AugmentedPro project is created with a default start screen that appears in an opened tab. Add an augmentation to the current screen by clicking on the Augmentation button in the Insert menu.

A file explorer dialog appears to select the trackable, which is the reference model used for the tracking process, in this tutorial our 3D CAD model in the .obj format.

When inserting a new augmentation from an active screen tab, a new tab is opened for this augmentation and the following actions are done automatically by AugmentedPro Creator:

  • Create a camera stream in the active screen
  • Create a new beacon, which is a container that shares a common trackable with its augmentations and detections children
  • Create the trackable associated to the beacon container
  • Create a new augmentation as a child of the beacon just created
  • Add an augmentation item to the camera stream in the active screen, that refers to the augmentation just created

Before adding visual information to display in augmented reality to the augmentation tab, you can select a different initial point of view than the default point of view displayed when loading the trackable into the augmentation tab. The initial point of view is used in AugmentedPro Player to initialize the tracking of the 3D CAD model. In AugmentedPro Player, the 3D reference model is displayed on screen so that you can move your target device and match the reference model to start the tracking and visualize your augmented reality visuals.

Move the camera around the 3D scene by moving the mouse with the right button pressed and by scrolling the mouse wheel to zoom in and out until you reach the desired initial point of view. A fixed frame shows you the bounds of the camera image in order for you to set the appropriate size of your 3D CAD model in the camera field of view. Click on your 3D reference CAD model and click on Set Init Camera View in the properties pane.

When creating a new augmentation, the container tab only shows the trackable, but no visual information to be displayed in augmented reality has been defined at this point. You can now add visual content to be displayed in augmented reality when playing the project in AugmentedPro Player, either through the Insert menu, or through the Libraries menu to insert predefined objects. In this tutorial, a predefined 3D model is inserted into our augmentation container.

Select Arrow.obj in the 3D Models dropdown list in the Libraries menu. You may hide the trackable by clicking on it and checking the Hide property in the properties pane.

Move the camera around the 3D scene by moving the mouse with the right button pressed, or by zooming in and out with the mouse wheel. Move the 3D model in translation and rotation with the arrows and circles that appear around the object when selecting it. You may also adjust the scale or the 3D model unit, which also has a scale effect.

Select the screen tab and add an exit button by selecting Exit in the Button dropdown list in the Insert menu. You can then move the button in the screen.

In the file menu, save your work into an .apc file by clicking on the Save as... button and export the project to an .app file by clicking on the Export to Player button that can be transferred to AugmentedPro Player.

When transferring your app file to AugmentedPro Player on your target device, make sure to copy it to the projects folder. You can find the complete path of the projects folder in AugmentedPro Player on your target device, Settings section, Folders tab. The project appears automatically in the Projects column of the start screen in AugmentedPro Player. Make sure that your target device has a valid license that allows you to play personal projects. You can check the status of your license in the License tab of the settings section in AugmentedPro Player.