The AR focused file format (USDZ) was announced at the WWDC Conference in 2018 and it’s supported on iOS, macOS and tvOS. In this post we will dive into what this format is and how we can convert and create USDZ files.
What is USDZ?
One of the biggest advantages of USDZ is its seamless integration with iOS apps like Messages, Mail, Safari, Notes, News, Files and of course, 3rd party apps.
The technology behind it is called USD (Universal Scene Description). It is a 3D file format developed by Pixar and it has a focus on speed, scalability and collaboration. USDZ is the distribution format for USD, which is a compact single file that is optimised for sharing. It is also the file used for AR quick look (checkout some AR quick look examples here).
How to convert an existing file to USDZ?
As it is early ages for this format, you will probably still have your 3D content available in other formats like .obj, .gltf, .fbx or .abc. But the good news is that converting any of those to .usdz has been made easy by Apple with the
usdzconvert command line tool. It also performs asset validation so you will be able to know if your files has been converted properly.
Installing the USD Python Tools
- Download the USD Python Tools from here
- Open the unzipped folder
- Double click on the
See all options
Convert a file to .usdz
Convert a file to .usdz while also adding materials
usdzconvert <file> -diffuseColor <file> -normal <file> -metallic <file> -roughness <file>
Plain text representation of your .usdz file
The structure of the model
For testing the .usdz converter with a .glTF file I used the Buggy model from the glTF-Sample-Models repository by KhronosGroup. In my test folder I made sure to have both the .glTF and .bin files for the conversion to work properly.
usdzconvert Buggy.gltf Input file: Buggy.gltf Output file: Buggy.usdz usdARKitChecker: [Pass] Buggy.usdz
To test out the file, I drag and dropped the Buggy.usdz file into my Notes app on my MacBook which is synchronised with my iPhone. Then I was able to open the file directly from my iPhone. Simple as that!
To be able to convert .fbx (Filmbox) files you will need to take some extra steps as it doesn’t come supported out of the box.
- Install the Autodesk FBX SDK and FBX Phython bindings from here
- Edit the
USD.commandfile from the USD Python Tools folder, uncomment and update the file path to point to the location of the fbx.so (Phython 2.7). In my case I had to update it to
export PYTHONPATH=$PYTHONPATH:/Applications/Autodesk/FBX\ Python\ SDK/2019.5/lib/Python27_ub
- Rerun the
USD.command. Now you should be able to convert FBX files.
For a testing example I used the Rose model from Free3d.com website. I downloaded the model and copied the .fbx file and textures to my test folder.
usdzconvert rose.fbx Input file: rose.fbx Output file: rose.usdz usdARKitChecker: [Pass] rose.usdz
You can preview the converted model by selecting it in the folder and pressing
SPACE on your Mac keyboard. Another way is by opening it with Xcode, or if you want to see it in real life, copy it into your iPhone and test it out.
A few notes to keep in mind:
- If you have an FBX file with external texture files make sure to have them in the same folder when making the conversion
- Texture files can be of type .png or .jpg
- Experimenting more with other models, it is quite often that the models fail conversion from first try. Most of the time, the issue is caused by missing or wrong formatted textures. This could be avoided by passing on the requirements for a good conversion to the 3d model designer.
How to create a USDZ file?
If you want to create your 3D assets directly in the USDZ file format there are different options and here are some examples:
- Substance painter by Adobe - Supported
- Autodesk Maya - Supported through a plugin (written and maintained by Pixar)
- SceneKit - Create or load a
SCNScenethat you can export to USDZ with an API call or directly from the user interface.