How do you create a Gaussian Splat?

How Do You Create a Gaussian Splat?

Creating a 3D Gaussian Splat (3DGS) model follows a structured workflow: data capture, dataset preparation, training, and export. A Gaussian Splat model represents a scene using millions of 3D ellipsoids, known as "splats." Each splat contains:

  • 3D position (X, Y, Z)
  • Covariance (shape and orientation)
  • Opacity
  • View-dependent colour (via spherical harmonics)

Instead of building mesh geometry, the scene is rendered directly from these splats using GPU rasterisation.

1. Data Capture (The Most Critical Stage)

Data capture determines model quality and typically represents the majority of the effort.

Ground Capture

Use a high-resolution camera with:

  • Manual exposure
  • Manual focus
  • Fixed focal length
  • Locked white balance

Shoot in 4K (minimum) if recording video. Maintain strong parallax—avoid simple left-to-right pans. Move through the space to create depth variation.

Drone Capture

Use UAVs with large sensors and full manual controls. Fly slow, consistent paths and achieve 70–80% image overlap. Capture multiple altitudes for complete geometry.

Manual exposure and focus are essential. Automatic settings frequently cause reconstruction failures.

2. Dataset Preparation

Images or video frames are organised into a structured dataset ready for processing.

Common software options include:

  • Jawset Postshot (local GUI)
  • MIPMAP (local GUI)
  • Luma AI (cloud-based)
  • XGrids (hardware + pipeline)

Tool choice depends on dataset size, GPU capability, scalability requirements, and budget.

3. Training (Core Computational Stage)

Training is the optimisation phase where the system reconstructs the scene.

The process:

  • Images (with known camera positions) are imported.
  • Initial splats are placed in 3D space.
  • Optimisation algorithms (e.g., gradient descent) iteratively adjust each splat’s:
    • Position
    • Size and shape
    • Colour
    • Opacity

The goal is to minimise the difference between rendered views and original images.

During densification:

  • Splats may split
  • Weak splats are removed.
  • Scene density increases

Training time ranges from minutes to many hours, depending on dataset size and GPU performance. Modern GPUs (NVIDIA, AMD, Apple Metal) dramatically accelerate processing.

4. Output and Deployment

Once the data has trained, the 3DGS model can be exported as:

  • .ply splat files (for CAD/GIS integration)
  • Web viewer packages (browser-based inspection)
  • Custom viewers with LOD control
  • Self-hosted website embeds

These outputs support measurement, remote inspection, planning, collaboration, VR/AR, and engineering workflows.

For commercial deployment:

  • Host splat files on a CDN
  • Use WebGL viewers
  • Enable progressive loading

Common Failure Points

Most reconstruction failures stem from capture errors:

  • Insufficient image count
  • Poor overlap
  • Inconsistent exposure
  • Variable focus or focal length
  • Motion blur or rolling shutter
  • Reflective or moving objects
  • Inadequate GPU hardware

Nearly all issues trace back to inconsistent or incomplete data capture.

Conclusion

Successful Gaussian Splat creation depends on:

  1. High-quality, controlled image acquisition
  2. Structured dataset preparation
  3. Proper GPU-accelerated training
  4. Correct export for intended use

Master the capture stage first—because no amount of processing can repair fundamentally poor input data.

Follow by Email
Facebook
X (Twitter)
YouTube
Pinterest
LinkedIn
Instagram
Tiktok