Model-Input Cleanersegmentation-first · faithfulness-gatedgate LIVE
repeatable recipe · product photo 3D-ready input

Messy retailer photo clean, product-faithful model-input image.

An automated pipeline that normalizes real product photos into consistent 3D-generation inputs, and gates every output on a measured faithfulness check: geometry, finish, and hardware preserved, or it does not ship.

geometry preserved finish held no hallucinated hardware consistent 3/4 + lighting
model-input · cleansource · messysource · messymodel-input · clean
/01

The recipe

One automated path from an imperfect source image to a trustworthy 3D-generation input.

01

Ingest

Read the source photo and its metadata: which details must survive (finish, hardware, proportions).

product record + attributes
02

Segment

Mask the product so the real pixels are kept. Geometry and finish are preserved by construction; nothing is repainted.

rembg / SAM / BiRefNet
03

Declutter

Remove related products and background. Related items are inpainted from the real surrounding material, not invented.

mask-bounded inpaint / gen-edit
04

Normalize

Canonical 3/4 framing, one studio light setup, neutral background, via a reference / control image shared across the batch.

reference + control image
05

Gate

Measure geometry, finish, hardware, and artifacts against the source. Only PASS is sent into 3D generation.

SSIM · edge-IoU · histograms
/02

The bench

Four real products. Drag the divider; run the gate live; toggle a bad edit and watch it fail.

model-input · cleansource · messysource · messymodel-input · clean
Seating / upholstered · failure focus: Bad angle + scene clutter
Wingback lounge chair
Isolate the chair from a plant-filled room; hold the 3/4 view, the chenille weave, and the turned front legs.
hold Wing + arm silhouettehold Chenille upholstery weavehold Cabriole wood legs

Faithfulness gate

safe for 3D generation only on PASS
PASS · 4/4
Geometry preserved0.88 / 0.72
SSIM 0.97 · edge-IoU 0.73 · product structure measured against the source
Finish / material preserved0.95 / 0.78
hue + saturation histogram, brightness-invariant so a relight passes
Hardware present, not hallucinated1.00 / 0.70
no discrete hardware on this item
No removal artifacts0.90 / 0.75
edges in the output absent from the source: halos, smears, invented detail
Simulated bad edit: a controlled geometry warp + hue/saturation shift + one hallucinated knob and one dropped knob, the drift an unconstrained gen-edit introduces. The gate catches it and blocks the image.
/03

How each failure is prevented

The exact failure modes that break a 3D generator, and the step or check that stops each one.

Changed geometry
Segmentation keeps the real product pixels; nothing is re-drawn. A per-region SSIM + edge-IoU check confirms structure held.
GATE: geometry
Altered material / finish
The product surface is never repainted. A hue + saturation histogram (brightness-invariant) confirms the finish is unchanged after relight.
GATE: finish
Hallucinated hardware
Edits are mask-bounded. A foreign-detail check flags edges that appear in the output but were not in the source.
GATE: artifact
Missing details
Each declared element (knob, handle, control) is checked for presence in the output before the image can pass.
GATE: hardware
Bad perspective
Normalized to one canonical 3/4 view. Sources too far off-angle are flagged for reshoot or a 3D-assisted re-angle, never faked.
STEP 04
Inconsistent lighting
Relit to a single studio reference shared across the batch, so every model-input photo matches.
STEP 04
Removal artifacts
Cutouts are filled from real surrounding material. The artifact check measures excess edge energy where items were removed.
GATE: artifact