audience

Creating Your First Augmented Reality Scene in ARKit Augmented Reality (AR) blends digital content with the physical world. Apple’s ARKit framework makes building these experiences for iOS smooth and accessible.

Here is a step-by-step guide to creating your very first AR scene using ARKit, Swift, and RealityKit. Prerequisites Before starting, ensure you have the necessary tools: A Mac running Xcode 11 or later.

An iOS device with an A9 chip or later (iPhone 6s or newer, iPad 5th generation or newer). A USB cable to connect your device to your Mac. A basic understanding of Swift and iOS development. Step 1: Create a New AR Project

Xcode provides a built-in template that handles the initial AR configuration. Open Xcode and select Create a new Xcode project.

Choose iOS as the platform and select the Augmented Reality App template. Click Next. Enter your project name (e.g., “MyFirstARScene”). Choose Swift as the language. Select RealityKit as the Content Technology.

Set the User Interface to SwiftUI or Storyboard, depending on your preference. For this guide, we will use SwiftUI. Click Next, choose a save location, and click Create. Step 2: Understand the Template Code

Xcode generates a foundational structure. Open ContentView.swift to inspect the core setup.

You will see an ARViewContainer struct conforming to UIViewRepresentable. This struct initializes and manages the ARView, which is the window into your AR world. Inside the container, you will find code similar to this:

func makeUIView(context: Context) -> ARView { let arView = ARView(frame: .zero) // Load the default Reality Kit scene let boxAnchor = try! Experience.loadBox() // Add the box anchor to the scene arView.scene.anchors.append(boxAnchor) return arView } Use code with caution.

The template automatically loads a pre-made 3D cube from the Experience.rcproject file included in your project assets. Step 3: Build a Scene Programmatically

Instead of using the pre-made file, you can build your first AR object entirely in code. This approach gives you total control over dimensions, materials, and placement.

Replace the code inside the makeUIView function with the following snippet:

func makeUIView(context: Context) -> ARView { let arView = ARView(frame: .zero) // 1. Create a 3D mesh (a sphere with a 10cm radius) let sphereMesh = MeshResource.generateSphere(radius: 0.1) // 2. Define the appearance using a simple material let sphereMaterial = SimpleMaterial(color: .systemBlue, isMetallic: true) // 3. Combine mesh and material into a ModelEntity let sphereEntity = ModelEntity(mesh: sphereMesh, materials: [sphereMaterial]) // 4. Create an anchor to pin the object to the real world // This pins the object 0.5 meters in front of the camera let worldAnchor = AnchorEntity(world: [0, 0, -0.5]) // 5. Hierarchy: Add the entity to the anchor, then the anchor to the view worldAnchor.addChild(sphereEntity) arView.scene.addAnchor(worldAnchor) return arView } Use code with caution. Step 4: Configure the AR Session

ARKit requires camera permissions and tracking configurations to understand your environment.

By default, RealityKit manages the session configuration automatically based on the anchors you add. Because we used a world anchor, ARKit initiates world tracking to monitor your device’s position relative to the room.

To ensure optimal tracking, add a basic configuration setup if you want manual control:

let configuration = ARWorldTrackingConfiguration() configuration.planeDetection = [.horizontal] arView.session.run(configuration) Use code with caution.

This configuration tells ARKit to actively look for flat surfaces like floors or tables, which allows for more realistic object placement later. Step 5: Deploy and Test Your App

ARKit cannot run in the Xcode simulator because it requires a real device camera and motion sensors. Connect your iPhone or iPad to your Mac.

In the top-left corner of Xcode, click the device dropdown menu and select your physical device. Click the Run button (the play icon) or press Cmd + R.

If prompted, unlock your device and trust your developer account profile in your device’s system settings.

Once the app launches, move your device slowly to let the camera sample your surroundings. You will see a metallic blue sphere floating exactly half a meter away from where you initialized the app. To move forward with your project, please let me know: