Collaboration with KOSÉ explores the use of a Light Stage for development of systems supporting virtual counselling and selection of cosmetics.

Tokyo –  Toppan Printing (Toppan), a global leader in communication, security, packaging, décor materials, and electronics solutions, has collaborated with leading Japanese beauty and personal care company KOSÉ Corporation (KOSÉ) on pilot testing leveraging data from facial scanning to examine differences in skin appearance through optical simulations of layers of cosmetics. Testing is being conducted at the recently launched Toppan Virtual Human Lab, which researches the application of diverse information on the human body and is equipped with a Light Stage* developed by the University of Southern California (USC) for high-definition facial scanning. The initiative by Toppan and KOSÉ aims to drive the development of services making use of virtual spaces to support counselling and product selection matched to the characteristics of each person’s skin.

The COVID-19 pandemic has limited opportunities for face-to-face contact and counselling with customers in stores, and in many cases testers have been removed from display shelves. This has made it more difficult for consumers to select the best product for their needs. Toppan and KOSÉ therefore launched pilot testing with a view to developing systems that facilitate virtual skin counselling and selection of the right cosmetic products for each customer.

Testing is being conducted primarily at the Toppan Virtual Human Lab, with some performed at USC’s ICT Vision & Graphics Laboratory, and is due to be completed by the end of January 2021. 3D computer graphic data is generated from the results of high-definition facial scanning using the Light Stage. The data is then used as the basis for examining the effectiveness of counselling and optical simulation of layers of cosmetics. Toppan is handling facial scanning, 3D computer graphic data generation, cosmetics information mapping, and development of a makeup simulator. KOSÉ is providing test participants for the Light Stage, supplying Toppan with information on cosmetic products, and advising on the tuning of the simulator.

Preliminary testing confirmed that it is possible to faithfully reproduce in 3D computer graphics the characteristic colors of the pigments in KOSÉ‘s foundation products. Further testing has indicated that there is potential to use the Light Stage for a system that facilitates high-definition cosmetics simulations, counselling, and product selection in a virtual space.

“We are delighted to be collaborating with KOSÉ on part of Toppan’s efforts to create a Human Body Information Platform that will support the development of diverse offerings,” said Jin Endo, Executive Officer of Toppan’s Business Development Division and R&D Strategy Office. “The Light Stage can be the launch pad for providing a wide range of information to drive new value for clients and consumers with innovative services addressing the latest needs.”

*Light Stage: A device that controls multiple light sources in a spherical dome for high-definition scanning of face shape and texture.

For more information, visit https://www.kose.co.jp/company/en/.