Projection-Mapped Relief Surface Appearance Study

ISEF Category: Technology Enhances the Arts

Subcategory: Display Technology  ·  Difficulty: Advanced  ·  Setup: University Lab  ·  Time: Full Year

The Hook

A flat screen can fake depth, but a projected sculpture can fake material too. Your eyes can be tricked into seeing metal, water, or matte clay on the same object. That makes this project part art, part optics, and part human perception. You get to test which visual cues do the heavy lifting.

What Is It?

This project combines 3D scanning, projection mapping, and visual perception. Projection mapping means you aim an image onto a real object so the image follows the object’s shape. If the scan is accurate, the light lines up with the bumps and curves on the surface. That lets you paint the sculpture with patterns that can make it look like different materials.

Think of it like makeup for objects, but the makeup is light. A matte surface usually looks soft because it reflects light evenly. A metallic surface looks shiny because it reflects light in a stronger direction. Wet surfaces often show bright highlights and dark shadows. By changing the projected shader, you can test which visual cues make people say, “That looks wet,” or “That looks like metal.”

The user study part matters. You are not just making cool visuals. You are measuring how people respond to specific lighting and texture cues, then comparing those responses across conditions.

Why This Is a Good Topic

This is a strong science fair topic because you can test a clear question, measure a clear response, and connect it to real display design. It links to museums, games, theater, and accessible art installations, where light can change how people read a surface. You can learn about scanning, registration, perception, and experimental design without needing a medical or wet chemistry lab. The project also has room for original work, since you can compare shader styles, surface shapes, or viewing conditions.

Research Questions

• How does the shader style change perceived material appearance ratings for matte, metallic, and wet finishes?
• What is the effect of surface geometry on how accurately users identify the projected material?
• Does higher scan registration accuracy improve agreement between intended and perceived material appearance?
• To what extent do highlights versus shadow contrast influence metallic appearance judgments?
• Which viewing distance leads to the strongest material identification accuracy?
• How does ambient room light affect perception of projection-mapped surface materials?

Basic Materials

• 3D printer or access to preprinted relief surfaces.
• Raspberry Pi with Pi Camera module.
• DLP mini-projector or equivalent small projector.
• Calibrated test objects with different surface shapes.
• Neutral room background or blackout cloth.
• Laptop for scan processing and data collection.
• Consent form and survey tool for user study.
• Digital camera or smartphone for documenting projection results.

Advanced Materials

• Structured-light projection setup with synchronized camera and projector.
• Calibration targets for camera-projector registration.
• High-resolution 3D scanner or photogrammetry setup.
• Different 3D-printed test surfaces with controlled microtexture.
• Colorimeter or spectrophotometer for projected light measurements.
• Eye-tracking system for viewing behavior analysis.
• Statistical analysis software for mixed-effects modeling.
• Optional calibrated display for comparison with screen-based stimuli.

Software & Tools

• ImageJ: Measures brightness, contrast, and surface response in captured images.
• Blender: Builds relief models and previews how shaders will look on curved surfaces.
• OpenCV: Helps with camera calibration, pattern detection, and alignment checks.
• Python: Organizes user study data, runs statistics, and automates image analysis.
• R: Tests whether material ratings differ across surface and lighting conditions.

Experiment Steps

1. Define the exact material cues you want to test, such as shine, roughness, and wetness.
2. Choose one surface family and one projection style so you can isolate the main effect.
3. Plan how you will measure registration quality between the scan, the projector, and the sculpture.
4. Design a user study that separates intended material from perceived material.
5. Build controls that compare projection-mapped surfaces with plain surfaces or flat images.
6. Choose an analysis plan that links image features, registration error, and participant ratings.

Common Pitfalls

• Using changing room light, which makes the same projected surface look different across trials.
• Letting scan misalignment blur the texture cues, which can make every material look equally wrong.
• Testing too many shader styles at once, which hides the effect of each cue.
• Choosing surfaces with very different shapes, which confounds geometry with material appearance.
• Asking vague survey questions like “What do you think?” instead of separate ratings for matte, metallic, and wet.

What Makes This Competitive

A stronger project goes beyond making a good-looking projection. You would quantify registration error, isolate specific visual cues, and test whether people consistently perceive the intended material. You could compare different surface shapes, lighting recipes, or rating methods, then use statistics to show which factor matters most. That kind of careful design turns an art demo into a real perception study.

Project Variations

• Test whether the same projection system makes clay, stone, or foam look more realistic on different relief shapes.
• Compare painterly shaders with physically based rendering shaders to see which one gives stronger material cues.
• Measure whether adding motion, like shifting highlights, changes how often viewers call a surface wet or metallic.

Learn More

• NIH PubMed: Search review articles on visual perception of gloss, texture, and material recognition.
• NASA OpenCourseWare and MIT OpenCourseWare: Look for free optics, imaging, and computer vision lecture notes.
• NOAA Digital Coast: Explore free resources on image calibration, mapping, and spatial data handling.
• USGS Publications Warehouse: Search for methods papers on structured light, 3D scanning, and surface reconstruction.
• Journal of Vision: Read peer-reviewed articles on how people judge gloss, roughness, and material appearance.