
Cozy Hillside Hobbit Burrow & Garden Brook
WebGPU/TSL Shire Diorama, Cutaway Interior, 95° Swinging Round Door & Flowing Brook

Desktop mouse, keyboard & touch ready
60 fps Interactive 2.5D Living Anime Diorama from One 705 KB JPEG · Local AI Depth & GPU Puddles
Think of this like turning one flat 705 KB anime illustration into a living 3D pop-up book — with zero AI video generation, zero looping MP4s, and zero external audio files. Instead of generating a blurry AI video that warps faces over time, local AI estimates depth, Python slices the scene into layered cards and paints the hidden walls behind them, and live browser shaders drive rain, rippling puddles, glowing neon, blinking eyes, and interactive physics at a locked 60 fps.
Everything begins with a single 1376×768 anime frame (705 KB). No 3D meshes, no video clips, and no cloud video APIs are used anywhere.
Depth-Anything-V2-Large runs locally on Apple Silicon to separate near from far, while Python cuts out the woman, curtains, and lanterns and paints the hidden wall & brick behind them.
Seven automated region masks tell the GPU exactly where rain belongs, where puddles ripple, which neon signs glow, and where the indoor ramen counter stays completely dry.
Eleven custom WebGL2 shaders animate her breathing, blinking, hair sway, steam, and GPU water waves — plus you can brush the curtains, spark neon signs, splash puddles, and drag a live Before/After compare curtain.
Engineered end-to-end with Gemini 4 Neon from a single 705 KB static anime JPEG at zero cloud video cost: (1) local Apple Silicon MPS Depth-Anything-V2-Large monocular depth + OpenCV guided edge filtering + GrabCut & zone-split inpainting to slice 5 perspective-locked parallax plates (inpainted wet neon alley, rear/front red lanterns, 6-panel 深夜ラーメン noren curtains, and seated woman + counter), 7 packed RGB semantic stencils, and an 8×-supersampled eyelid patch; (2) eleven Three.js r187 WebGL2 GLSL passes including a 128 × 72 Live2D character vertex rig (chin-palm pivot head nod, breathing, hair breeze, eye gaze & 3-stage blink with 5-tap CAS sharpening), a 256 × 256 HalfFloat ping-pong GPU shallow-water puddle PDE with reflective Neumann boundaries, tactile cursor springs on noren cloth & coupled pendulum lanterns, click-to-spark flickering neon signs, curl-noise bowl/pot steam, depth-occluded slanted rain + awning drips, passing taxi headlights, sheet lightning brownouts, and a live draggable Before/After Split-Compare Curtain; and (3) zero-asset spatial Web Audio synthesis (rain, pitched drips, broth pot simmer, 120 Hz neon buzz & sparks, thunder, wet-tire whoosh, distant train rumble, and toggleable Kitchen Lo-Fi Radio).
Single-image pipeline — Local AI depth, Python OpenCV slicing & inpainting, WebGL2 GLSL shaders & procedural audio
| Scene Element | Pipeline / Tooling | How It Was Built |
|---|---|---|
Source Artwork & Guided Depth Map | Local Depth-Anything-V2-Large (Apple Silicon MPS) + OpenCV Guided Filter | Monocular relative depth predicted offline on Apple Silicon GPU from one 1376×768 (705 KB) JPEG and edge-sharpened against architectural lines via guided filtering |
Inpainted Neon Alley Backdrop (layer0) | Python OpenCV Inpainting + Zone-Split Wall/Brick Sampling | Erased all foreground cutouts and reconstructed clean warm kitchen wall, vertical wood slats, counter lip, and alley brick behind them (mean_abs_diff = 0.485) to eliminate parallax disocclusion holes |
Seated Woman + Counter (layer4) & 128×72 Live2D Rig | Python GrabCut + 8× Supersampled Eyelid Patch + Custom GLSL + CAS | Cutout plate (z = +0.34) deformed across a 128×72 vertex rig for rigid chin-palm pivot head tilt/nod, full-silhouette shoulder/hood breathing, flowing hair/bangs breeze sway, cursor eye-gaze drift, 3-stage eyelid blinking, and 5-tap neighborhood-clamped CAS ink sharpening |
6-Panel 深夜ラーメン Noren Curtains (layer2) | Python GrabCut + Per-Panel Cloth GLSL + Tactile Cursor Springs | Six individually masked cloth panels (z = +0.15) pinned strictly at top rod tabs with travelling wind ripples, organic billow, and non-tearing per-panel spring deflection when brushed by cursor |
Dual Red ラーメン Lanterns (layer1, layer3) | Python GrabCut + Coupled Pendulum Kinematics + Warm Emissive Glow | Independent rear (z = -0.05) and front (z = +0.20) cutout lanterns swinging around measured ceiling hook pivots with coupled wind sway, cursor brush impulses, and warm glow modulation |
7 Semantic RGB Stencils & Anchor Regions | Python OpenCV / NumPy (HSV, Canny, Black-Hat, Morphological Guards) | Seven packed A=255 1376×768 RGB masks isolating dry stall vs. rain alley, deep mist, wet street, 9 emissive sign/lantern groups, neon/lantern spill, gas flame, cloth panels, powerlines, breathing/hair zones, and AC grille bars plus normalized pixel coordinates |
GPU Shallow-Water Puddles & Wet Asphalt | WebGL2 256×256 RGBA HalfFloatType Ping-Pong PDE + Reflective GLSL | Real-time 2D shallow-water heightfield wave solver with Neumann reflective curb/wall boundaries, driven by exact awning drip landings, rain impacts, and cursor click/drag splashes, perturbing colored wet-asphalt neon reflections strictly inside the street mask (0.000 outside leak) |
Depth-Occluded Alley Rain & Awning Drips | Three.js Instanced GLSL + Deterministic Ballistic Kinematics | Multi-depth 7°–15° slanted rain streaks strictly masked outside the warm ramen stall (0.000 dry indoor leak) paired with sparse organic corrugated-awning valley swell droplets and gravity-accelerated translucent fall streaks locked to puddle splashes |
Selective Neon Sign Bloom, Flicker & Click Sparks | Multi-Mask Emissive GLSL + Z-Relief Sync + Tactile Click Impulse | Independent stochastic ballast flicker across 深夜ラーメン, OPEN, 居酒屋, ラーメン, and vending machine signs synchronized to background Z-relief (-farFactor * 0.042), with click-to-spark blackout drops and voltage surges |
Bowl/Pot Curl Steam, Gas Flame, Alley Mist & AC Fan | Procedural GLSL Shaders + Mask-Occluded Fan Rotation | Rising curl-noise vapor wisps above the ramen bowl and simmering pot (deflected by cursor swirl and gusts), fluttering blue stove gas burner flame, deep volumetric alley mist, overhead powerline sway, and rotating fan blades occluded behind AC grille bars |
Narrative Alley Events (Taxi Headlights & Sheet Lightning) | Deterministic Event Kinematics + Sky-Feathered GLSL + Neon Brownout | Periodic warm passing taxi headlights sweeping wet alley glare across the street and sky-weighted feathered sheet lightning flashes that trigger temporary neon ballast brownouts and synced distant thunder |
Optical Post-Pass (Thermal Heat-Haze & Split-Compare Curtain) | Single-Pass Fullscreen GLSL Post-Processing | Subtle rising refractive thermal heat-haze over the stove burner paired with an interactive draggable vertical curtain comparing the raw static original JPEG side-by-side against the live 2.5D Three.js scene |
Spatial Procedural Web Audio Engine | Zero-Asset Web Audio API Synthesis | Synthesizes stereo rain/downpour, pitched awning drips, simmering pot acoustics, 120 Hz neon buzz + spark crackle, lightning-locked thunder, headlight-locked wet-tire whoosh, distant JR train rumble, and toggleable low-pass kitchen lo-fi vinyl/rhodes radio with parallax panning |
Cinema Glass HUD, Mood Presets & Inspector | Responsive TypeScript UI + CSS Smoked Glass | Desktop HUD + unclipped 375×812 mobile bottom sheet offering 4 mood presets (Drizzle, Typhoon, 3AM, Steam), 5 sliders, camera/audio/compare/lightning controls, and 6-mode Layer & Mask Inspector |

WebGPU/TSL Shire Diorama, Cutaway Interior, 95° Swinging Round Door & Flowing Brook

1:1 Underwater Reef Test Rig, Meshed Spur-Gear Core, Camera-Iris Eyes & Autonomous Reef Walk

Playable 3D Pixel-Art Fighter Jet & Gunship Campaign · 5 AI Pilots · Desktop & Mobile