## Neural Marching Cubes icy April 6, 2022 --- ## Fast Forward
--- ## Menu - Marching Cubes & Variants - Issues & Challenges - Details of NMC - Results, limitation & future work
Marching Cubes & Variants
Marching Cubes Algorithm
1987
Iso-surface extraction
Input: discretized implicit field
Output: triangle mesh.
## Marching Cubes Algorithm - MC – 15 cases
--- ## Marching Cubes 33
--- ## Marching Cubes 33
Issues of MC Variants & Challenges
Issues of MC Variants
Cannot recover sharp features
Some algorithms from MC can recover sharp features,
but they all require additional inputs.
Issues of MC Variants
Model-driven
The mesh topology in each cube and the vertex positions are decided by manually designed rules.
Solutions
Templates: can not represent sharp features
Design new templates or use existing templates that can better represent geometric features.
Model-driven: relies on the trilinear interpolant assumption
Use machine learning to learn the rules from training data.
Challenges
Represent the output mesh
Design an efficient neural network
Templates: From 2D to 3D
Templates: From 2D to 3D
Input: $ m \times n $
Output:
$\quad m \times n \times (5+12) \Rightarrow m \times n \times (2+10) $
Templates: From 2D to 3D
Output = Type + Vertices + Edges + Faces
Marching Cubes Algorithm
Input: $ m \times n \times k $
Output:
$\quad m \times n \times k \times (15+84)$
$\Rightarrow m \times n \times k \times (5+51) $
NMC Templates
NMC-lite Templates
Data Preparation & Networks
Data Preparation
Network Related
3D ResNet
Loss function:
BCE for Boolean part
MSE for Float part
Smooth loss if input is voxel
Results & Comparison
Beamer
Smooth Features
Sharp Features
Noisy Data Input
NMC vs MC33
Weakness & Future Work
Issues of NMC
Rotation sensitive
Most of the training data is axis aligned
Loss function of smooth prefers axis-aligned outputs
Issues of NMC
Cannot reconstruct some topological cases.
Self-intersections
Future
Work: NDC
Neural Dual Contouring
Finished in February 2022
https://arxiv.org/abs/2202.01999
SDF: Signed Distance Function
Future
Work: NDC
Thanks for your watching!