3D head reconstruction solution
Our client is a creative design agency that provides branding, advertising, graphic design, and virtual modeling services for individuals and corporate customers. The agency has its own in-house souvenir production.
Computer Vision solution for a cosmetic retailer with Recommendation System
This AI-powered mobile solution is created for beauty retailers. It personalizes the user's skincare routine to make anti-ageing treatment a smarter and more customized experience. CHI Software's AI team is eager to share our experience in on-demand technology and computer vision development services.
Project background
Not so long ago the sale of cosmetic products depended mostly on the physical store experience: the customer needed to try out different shades or beauty products before they could find the right one that suits them best.
Retailers now have to meet the growing expectations of the customers for engaging experiences in stores. That’s why the consumers’ experience in beauty stores is now greatly transformed by technology, namely by diverse mobile opportunities: starting with chatbots and finishing with AI-powered computer vision solutions for retail to pick up needed products fast.
Our client, a cosmetic retailer, has a variety of beauty items, including products for all skin types, under-eye care, and decorative cosmetics. They were looking for innovative AI mobile solutions that could analyze the customer’s face and type of skin, and then offer the best-suited product and, thus, improve their customers’ experience.
- Duration: November 2020 – April 2021
- Location: New York, US
- Industry: Beauty/Health/Retail
- Services:
- Native mobile app development, custom software development, UI/UX design
Business needs
The client’s beauty company has a wide range of beauty products and customers in the United States. The company needed to train a large staff of consultants to serve everyone. Therefore, to optimize processes and minimize human labor, an idea of an app appeared. This solution should help end customers choose the right cosmetics themselves. Thanks to this AI-powered computer vision solution for retail the number of dissatisfied customers should decrease, and the costs of hiring and training new consultants should be optimized.
Product features
- Face analysis. Analyzes collected user data received from a photo (selfie)
- Recommendation Based on the collected data, this computer vision solution for retail makes recommendations on available beauty products
- Helpful hints. Offers hints and tips for the buyers to simplify the selection of items in the catalog
Solution
CHI Software developed a mobile application based on Computer Vision, and photo face recognition. In this computer vision case study we want to show how it works:
– A user takes a selfie
– Using the detectors based on the histograms of forfeited gradients from the Dlib library, the program can accurately determine the user’s face on the photo
– Using the same approach, we were able to train a system that can detect 126 feature points on the user’s face
– The app then analyzes the unique facial features of a user and adopts the user profile
– The applied AI technologies then help select the needed skincare
– Our system allows to perform a detailed/smart analysis of the user’s face
– The app now provides personalized skincare and beauty recommendations with the help of ChatGPT API integration.
Our technology stack
- C++
- Open CV
- Dlib
- Caffe
- Swift 4.2
- Alamofire
- REST
- AVFoundation
- CoreGraphics
- CoreImage
- CoreAnimation
- Multithreading
- UserDefaults
- Firebase analytics
- SafariServices (API)
- PHP 7.2.12
- MySQL
- MariaDB (AI)
- AWS EC2, S3, RDS
Client values
The client’s new mobile-based application helps users not only to navigate better in the range of items but also to buy cosmetics according to skin type and preferences. The selection of cosmetic products has become a simple and convenient automated process that increases consumers’ loyalty.
01
CHI Software researched the marker leaders and popular beauty tech solutions
02
Designed a prototype of a computer vision solution for retail to demonstrate how this solution can help the users
03
Developed AI-powered mobile apps for iOS and Android users
Employee testimonial
Artem Luban C++ Developer
It was an interesting computer vision case study in terms of technology with a revolutionary idea to improve the beauty industry behind it. I've practiced and boosted my skills in implementing Computer Vision in Face Analysis business solutions. As for challenges, the most difficult part was the detection of skin defects like acne. There needed to be clear criteria for their detection since defects' visibility can be very different under different lighting conditions.