ARKit is Apple's augmented reality development framework, and it's compatible with millions of iOS devices. Find out why developers and end users will be curious to learn about ARKit.
ARKit was released with iOS 11 at the Apple's Worldwide Developer Conference in 2017. Augmented reality (AR) is at the forefront of specialized technology being developed by Apple and other high-tech companies, and this new kit helps developers bring AR to iOS devices. The development kit is integrated with the latest hardware to allow for a level of AR integration never seen before on iOS devices.
This article is an introduction to ARKit. We'll update this resource periodically when there's new information about the AR development framework.
SEE: Augmented reality: Quick glossary (Tech Pro Research)
- What is ARKit? iOS includes a framework in the iOS Software Development Kit (SDK) called ARKit. This framework allows developers to create augmented reality apps and take advantage of the hardware and software capabilities of iOS devices.
- Why does ARKit matter? Like virtual reality, augmented reality is a hot topic in tech. AR allows app users to place virtual objects in a real world, and then interact with them. AR apps will be especially popular for the gaming, shopping, and industrial sectors.
- Who does ARKit affect? iOS 11 was the first version of iOS that included ARKit, and it has been included in new iOS versions since, allowing developers to create AR experiences in their apps. This also affects users, because they can download and use ARKit apps on their iOS devices.
- When is ARKit available? ARKit has been available to developers as part of Xcode 9 since its beta release at WWDC '17 in June 2017. ARKit apps has been available to consumers on the App Store with the release of iOS 11 on September 19, 2017.
What is ARKit?
ARKit is an augmented reality framework included in Xcode that is compatible with iPhones and iPads. ARKit lets developers place digital objects in the real world by blending the camera on the screen with virtual objects, allowing users to interact with these objects in a real space.
It does this by using the camera on iOS devices to create a map of the area, detecting things like tabletops, floors, and the location of the device in the physical space using CoreMotion data. The user doesn't have to do any calibration--that's a breakthrough in this space.
ARKit can run on most modern iOS 11 iPhones and iPads, and can utilize Metal's features like SceneKit integration and integrate with third-party tools such as Unity and Unreal Engine.
For end users, ARKit will enable a new level of real-world integration never before seen on iOS devices. A new generation of apps will be able to be built that can do things like show furniture inside of your house while shopping in an app; show your dream car parked in your garage to see if it will fit; and many other inventive uses of this technology that developers haven't discovered yet.
Apple created a Swift Playgrounds challenge that uses ARKit. The Swift Playgrounds app can be downloaded for iPad from the App Store. Developers and end users can see how these AR apps are created and used.
- WWDC 2017: Apple launches augmented reality developer tools with ARKit (ZDNet)
- The first ARKit apps reveal how Apple's AR works (CNET)
- Apple says new iPhones are 'custom tuned for AR' (ZDNet)
- WWDC '17 Video: Introducing ARKit: Augmented Reality for iOS (Apple)
- Developer Video: Face Tracking with ARKit (Apple)
- Apple's Swift programming language: The smart person's guide (TechRepublic)
Why does ARKit matter?
AR has been a hotbed technology the past several years, and ARKit affirms this technology is here to stay and will become an ever-growing field for apps in the future. The use of AR in spaces other than gaming will be a game changer.
ARKit apps are currently in their infancy, but there is real potential in the apps that can be created with it. Apple has provided an amazing framework that is leaps and bounds better than what was previously available to create AR apps. Developers no longer have to develop a speciality, but instead can use this framework to create AR features in their apps without any prior experience working with AR.
SEE: Executive's guide to the business value of VR and AR (free ebook) (TechRepublic)
With the iPhone X, Apple has created a true AR device with a better camera that will provide both facial tracking and better positioning and topology detection.
In the future, we could see apps that are used by industrial workers, medical workers, scientists, and other technical professionals to overlay critical information over a real-world scene.
- Augmented reality gaining more traction than virtual reality in the enterprise (Tech Pro Research)
- Next big leap for Apple? - augmented reality (CBS News)
- Google brings AR development to Android phones (TechRepublic)
Which devices and apps support ARKit?
ARKit-enabled devices are any iPhone or iPad running iOS 11 or later that have the Apple A9, A10, A11, or later processor; these devices are required to run the advanced Metal graphics. At launch, most of the apps that support ARKit are in the games category; as more developers work with AR, we will see an increase in the number of useful apps.
- Egg, Inc. (Free): A farming game that lets you see your farm laid out on a table or floor.
- Thomas & Friends Minis (Free): In this game you can lay out a virtual train set on the floor.
- Splitter Critters ($2.99): In this game you can explore a fully playable version of the game overlaid on the floor.
Tools and other apps
- Overstock.com (Free): Place life-size 3D furniture models in a room to see how they will look; you can even walk around it to get a sense of scale.
- Edmunds (Free): Place a life-size 3D model of a car that's in their library in your driveway or garage to see if the car will fit.
- MeasureKit (Free): This is an AR utility that lets you measure a room or other object in real life using a virtual tape measure.
- Lowe's taps Apple's ARKit for new home improvement apps (ZDNet)
- The 23 best ARKit apps you can try right now (CNET)
- Learn Swift Programming Step by Step (TechRepublic Academy)
- Master Unity Game Development: Ultimate Beginners Bootcamp (TechRepublic Academy)
ARKit 2 improvements
ARKit 2 brought a new vivid augmented reality experience to apps that allowed them to interact with the real world in new ways. With ARKit 2, multiplayer AR games were possible, as well as tracking 2D images, and detecting known 3D objects like sculptures, toys, and furniture.
SEE: Virtual and augmented reality policy (Tech Pro Research)
ARKit 3 improvements
ARKit 3 adds features that take augmented reality even further. You can show AR content in front or behind people using People Occlusion, which can track up to three faces. You can also now support collaborative sessions, enabling completely new AR shared gaming experiences.
Motion capture can be used to understand body position and movement, tracking joints and bones, allowing for new AR experiences involving people instead of just objects.
Other major improvements:
- Detection capabilities of up to 100 images at a time
- Estimation of physical size of an image
- 3D-object detection is more robust and can better recognize objects in complex environments
- Machine learning is used to detect planes in the environment faster, leading to faster AR environment setup
- Simultaneous front and back camera use means that you can interact with AR content in new ways with facial recognition
- Multiple face tracking on iPhone X, iPhone XS, iPhone XS Max, iPhone XR, and iPad Pro can now track up to three faces at once
Reality Composer and RealityKit
These new tools available in ARKit can aid in the creation of AR scenes with little to no traditional AR design experience.
For more information, read about Reality Composer and Reality Kit on the Apple developer website.
- WWDC 2019: A guide for business pros (Tech Pro Research)
- Apple's coolest new AR features only work on iPads and iPhones with the newest processors (CNET)
- What Apple's new AR bowling game taught us about the future (CNET)
- Apple CEO Tim Cook touts enterprise augmented reality as Apple, SAP further integrate (ZDNet)
When is ARKit available?
ARKit was available beginning in June 2017 to developers in the iOS 11 beta and the Xcode 9 beta. The final version of 1.0 of ARKit was released alongside iOS 11 in September 2017. Developers began making ARKit apps available on the App Store for iOS beginning September 19, 2017.
- June 2017: Apple released the beta of ARKit alongside Xcode 9 and iOS 11 betas.
- September 2017: Apple announced iPhone X with TrueDepth camera, which enables ARKit to detect position, topology, and the user's facial expressions.
- September 2017: Apple released iOS 11 to the public and Xcode 9 to developers with the newly included Face Tracking features in ARKit.
- November 2017: Apple will release the iPhone X to the public, and developers will be able to take advantage of the facial tracking features in the TrueDepth camera system.
- June 2018: iOS 12 beta is released to developers at WWDC, bringing a beta version of ARKit 2.
- September 2018: Apple releases iOS 12 to the public, bringing ARKit 2 to iPhones and iPads, allowing developers to release ARKit 2 apps publicly.
- June 2019: iOS 13 beta is released to developers at WDWC, bringing a beta version of ARKit 3.
- Udacity, Unity launch new $200 developer training course for Apple's ARKit (TechRepublic)
- Developers: These are the iPhone X, iPhone 8, Apple TV 4K, and Apple Watch Series 3 features you need to know (TechRepublic)
- With the iPhone X, can Apple become the next AR leader? (TechRepublic)
- Apple unveils iPhone 8, 8 Plus as 'first smartphone designed for AR' (TechRepublic)
Editor's note: This article was originally published in September 2017.