SpectroPhone: Enabling Material Surface Sensing with RearCamera and Flashlight LEDs

SpectroPhone: Enabling Material Surface Sensing with RearCamera and Flashlight LEDs
Maximilian Schrapel, Philipp Etgeton, Michael Rohs

CHI '21: The 2021 ACM CHI Conference on Human Factors in Computing Systems
Session: Late-Breaking Work Day 2 - E

Abstract
We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.

DOI:: https://doi.org/10.1145/3411763.3451753
WEB:: https://chi2021.acm.org/

Pre-recorded Presentations for the ACM CHI Virtual Conference on Human Factors in Computing Systems, May 8-13, 2021

Видео SpectroPhone: Enabling Material Surface Sensing with RearCamera and Flashlight LEDs канала ACM SIGCHI