Importing 3D Models and Assets

Fab, Sketchfab, TurboSquid, CG Trader, etc.

• Export options: glTF, .glb, FBX exporter
• Suggested workflow: glTF or .glb download option. See Sketchfab to Vizard

Unity

• Export options: FBX exporter
• Suggested workflow: FBX exporter
  *Note: Can convert to glTF after export can use an online tool
• For a more comprehensive documentation on converting from Unity, see this tutorial

Unreal

• Export using glTF exporter (get from Marketplace and add to project). See this tutorial
  

Blender (Extension - .blend)

• Export options: gltF exporter
• Suggested workflow: Built in glTF exporter

3DSMax (Extension - .max)

• Export options: Bablyon.js, Sketchfab exporter, export as .fbx then convert to .glTF/.glb via Blender
  
• Suggested workflow: GLTF via Babylon.js
  

Maya (Extension - .ma)

• Export options: Babylon.js, Sketchfab exporter, Ziriax, export as .fbx then convert to .glTF/.glb via Blender
  
• Suggested workflow: GLTF via Babylon.js
  

Modo (Extension - .lxo)

• Export options: Native
  
• Suggested workflow: Native GLTF exporter
   *Note: You must setup your materials for gltf in Modo first
  

Substance Painter (Extension - .spp)

• Export options: Native GLTF exporter
  
• Suggested workflow: Native GLTF exporter
  

ZBrush

• Export options: FBX exporter
  
• Suggested workflow: Best used in a “high poly to low poly” workflow by an expert user
  

NVidia Omniverse and OpenUSD

• Convert USD to glTF using online converter
  
• https://products.aspose.app/3d/conversion/usdz-to-gltf
  

Revit (Extension - .rvt)

• Export options: Simlabs, Sketchfab Exporter, native FBX export, PIXYZ
• Suggested workflow: GLTF via PIXYZ
  *Note: Sketchfab exporter requires Revit 2018.1 and above

SketchUp (Extension - .skp)

• Export options: KhronosGroup exporter
  
• Suggested workflow: GLTF via KhronosGroup Exporter
  

Rhino

• Export options: FBX, .glTF exporter
  
• Suggested workflow: Shapedriver .glTF export
  

Solidworks

• Export options: Built in Extended Reality Plugin, Simlabs
  
• Suggested workflow: glTF via Extended Reality Plugin
  

Apps to scan and create 3d Models and Environments:

• Polycam:
  Download for Android
  ‍Download for  IOS
• Widar:
  Download for Android
  ‍Download for  IOS

3D scanning/ NerFs

Desktop Photogrammetry Applications
AutoDesk Recap Pro‍
Reality Capture‍‍
Metashape

• Luma Labs Genie (Text to 3D Model)
• Luma Labs Imagine (Create 3D Rendered Scenes from Video)
• https://www.meshy.ai/
• https://www.masterpiecex.com/
• 3d.csm.ai
  ▪ Tutorial
• https://skybox.blockadelabs.com/
  ▪ Tutorial
• Rodin
• Tripo3D (Fully rigged, high quality 3D models from prompts or images)
• CGDream
• https://huggingface.co/spaces/shariqfarooq/ZoeDepth
  ▪ Tutorial

• https://app.alpha3d.io/
• Stable Zero 1,2,3
• https://huggingface.co/spaces/hysts/Shap-E
• https://spline.design/ai
• https://3dfy.ai/
• https://app.sloyd.ai/
• Meshcapade
• Spline
• More to come soon
• See this tutorial for more information

For information on how to bring point cloud data into Vizard, please see this knowledge base article.

Point clouds of the format .dp, .ply, .3dc and .asc are supported

Other content from additional sources will work as well if the format is one of the supported file types, preferably .glTF/.glb or .fbx.

There are also included assets in the sightlab_resources- folder (environments, objects, media and avatars)
See here

Avatar models can be brought in if they are in either the .fbx, .glTF or .cfg (cal3D) format. See this page for more details.
‍

• FBX Avatars
• Mixamo Avatars
  ▪ Tutorial
  ▪ https://www.mixamo.com/
• Reallusion Avatars
  ▪ Tutorial
  ▪ Website
  ▪ ActorCore Library
• Ready Player Me Avatars
  ▪ Tutorial
• Avaturn
• MetaPerson
• RocketBox Avatars
• https://meshcapade.com/ (Go through Blender to get textures)
• RocketBox Avatars

Code to manually add an avatar to your scene

avatar =vizfx.addAvatar('vcc_male.cfg')
#set the position
avatar .setPosition(0,0,1)
#choose the animation state
avatar .state(1)

To use a full body avatar with the Meta Quest Pro add the line "from sightlab_utils import body_tracking" under the sightlab import
‍

Avatar Rigging

• Auto rigging with Mixamo
• Auto rigging with Accurig from Reallusion
• Facial morph rigging with Face-It Blender add-on

Avatar Animations

• There are many options for motion capture to create animations. Here are just a few, see the Vizard documentation for more supported devices for motion capture
• Using a standard video captured with a phone or camera (AI algorithm for converting to animation)
  
  ▪ https://www.deepmotion.com/
  ▪ Tutorial
  ▪ Kinetix tech
  ▪ Rokoku
• High end motion capture
  ‍
  ▪ Xsens
  ▪ Optitrack
  ▪ Vicon
  ▪ AR51 Markerless

You can also bring in content such as 360 videos (stereoscopic and monoscopic), 2D videos, images, audio (3D and stereo), and more. To use them in SightLab, simply place them in your project folder (default location is resources/media) and choose "360 Media" in the GUI, or use this code if using the code version:

video1 = viz.addVideo('sightlab_resources/media/name.avi')

sightlab.setEnvironment(video1,mode = MEDIA_360,mediaType =
 "video",mediaFormat = "Stereoscopic T/B")

For creating 360 videos and pictures you can use any 360 video camera, both stereo or monoscopic. You can also use your phone with an application like "360 Photosphere" to capture 360 images. Other good resources for getting 360 images online include

• Skybox AI (blockadelabs.com) for AI generated ones
• Any AI image generator, such as Leonardo.ai or Chat-GPT Dall-E and use a prompt such as "Equirectangular 360-degree image..."
  To convert the image to stereo, see the example script "convert 360 to stereo", results may vary.
• Pexels for some 360 images that can be downloaded.

Additionally, you can download 360 videos off of Youtube.
Download using 4K Video Downloader (download as .mkv)
https://www.4kdownload.com/-51
‍
If the videos download in a strange format, see this tutorial on how to adjust it using FFMPEG.  

Another option for generating 360 media content is to use one of the AI video-to-video options, such as RunwayML to either convert a 360 image to a video or change aspects of a 360 video

See the example script for displaying a virtual screen. SightLab can also support playback of any video type that you have a codec for.

Video can be sourced from many locations. Here's one good stock footage source
‍https://www.pond5.com/
Free, open source video editors
‍https://www.openshot.org/
‍https://shotcut.org/

Audio: (ambient and spatialized) .wav, .mp3
Good source for free audio
‍https://freesound.org/
Free audio editing and recording software
‍https://www.audacityteam.org/

A good tool for creating audio narrations is ElevenLabs. You can also use a large language model such as ChatGPT or Claude for help with creating the narration text.

https://elevenlabs.io/