Face analysis

A set of ML models that accurately detect human faces and predict crucial characteristics like facial landmarks, expression, ethnicity, age, and gender

Face analysis

A set of ML models that accurately detect human faces and predict crucial characteristics like facial landmarks, expression, ethnicity, age, and gender

Overview

The Face analyzer consists of several cutting-edge ML models. Its primary function is to detect visible human faces in images and predict some facial characteristics that are deemed important.

Leveraging state-of-the-art deep learning algorithms and neural networks, the Analyzer accurately identifies and analyzes faces, extracting the following information for each face:

• position in the image (bounding box);

• facial landmarks (coordinates of points that map to specific facial structures on the face);

• expression classification (happy, angry, sad, etc.);

• ethnicity classification;

• age estimation;

• gender classification.

Use cases

Use cases for automatic facial analysis include:

• Image tagging and organization - Automatic facial analysis enables users to easily categorize and index images based on expressions, ethnicities, age groups and genders. This streamlines content management, making it easier to locate specific images for various purposes.

• Inclusive representation - The Face Analyzer can facilitate inclusive representation in media content. By analyzing facial ethnicities and genders, content creators can ensure diversity and cultural representation in their visual assets, thus promoting inclusivity.

• Search Optimization - Automatic tagging and categorization of images based on facial characteristics allow users to find specific faces, expressions, or ethnicities with ease.

API endpoints

An up-to-date reference with all API endpoints is available here:

Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API

Example API responses

Input image	Input image
Output preview	Output preview
API response	API response
{ "status": "success", "version": "2.9.3", "request_uuid": "4f74f084-39a3-48f7-829a-336b55e8fd13", "result": "https://fdocs.filerobot.com/https://ask.filerobot.com/deliver/fdocs/4f74f084-39a3-48f7-829a-336b55e8fd13.png", "faces": { "face_0": { "box": [ 467, 269, 576, 416 ], "emotions": { "angry": 0.07, "disgust": 0.03, "fear": 0.02, "happy": 98.85, "sad": 0.3, "surprise": 0.58, "neutral": 0.16 }, "dominant_emotion": "happy", "races": { "asian": 0.89, "indian": 3.23, "black": 0.42, "white": 34.26, "middle eastern": 31.55, "latino hispanic": 29.64 }, "dominant_race": "white", "age": 34, "gender": "Male" }, "face_1": { "box": [ 907, 53, 1017, 207 ], "emotions": { "angry": 1.92, "disgust": 0.13, "fear": 1.65, "happy": 31.76, "sad": 9.86, "surprise": 3.49, "neutral": 51.2 }, "dominant_emotion": "neutral", "races": { "asian": 0.01, "indian": 0.02, "black": 0.0, "white": 89.42, "middle eastern": 5.25, "latino hispanic": 5.3 }, "dominant_race": "white", "age": 25, "gender": "Male" }, "face_2": { "box": [ 62, 254, 172, 398 ], "emotions": { "angry": 4.9, "disgust": 0.56, "fear": 0.16, "happy": 4.81, "sad": 22.33, "surprise": 0.13, "neutral": 67.1 }, "dominant_emotion": "neutral", "races": { "asian": 0.01, "indian": 0.0, "black": 0.0, "white": 99.67, "middle eastern": 0.12, "latino hispanic": 0.2 }, "dominant_race": "white", "age": 32, "gender": "Female" }, "face_3": { "box": [ 746, 346, 844, 474 ], "emotions": { "angry": 0.55, "disgust": 0.29, "fear": 0.15, "happy": 97.94, "sad": 0.09, "surprise": 0.92, "neutral": 0.06 }, "dominant_emotion": "happy", "races": { "asian": 3.73, "indian": 9.26, "black": 1.63, "white": 27.46, "middle eastern": 26.19, "latino hispanic": 31.73 }, "dominant_race": "latino hispanic", "age": 36, "gender": "Male" }, "face_4": { "box": [ 268, 143, 367, 267 ], "emotions": { "angry": 0.91, "disgust": 0.01, "fear": 0.11, "happy": 7.24, "sad": 16.02, "surprise": 0.69, "neutral": 75.03 }, "dominant_emotion": "neutral", "races": { "asian": 0.0, "indian": 0.0, "black": 0.0, "white": 99.97, "middle eastern": 0.02, "latino hispanic": 0.02 }, "dominant_race": "white", "age": 23, "gender": "Male" }, "face_5": { "box": [ 1131, 272, 1225, 400 ], "emotions": { "angry": 0.04, "disgust": 3.63, "fear": 0.02, "happy": 95.44, "sad": 0.2, "surprise": 0.05, "neutral": 0.63 }, "dominant_emotion": "happy", "races": { "asian": 0.0, "indian": 0.0, "black": 0.0, "white": 99.88, "middle eastern": 0.07, "latino hispanic": 0.05 }, "dominant_race": "white", "age": 24, "gender": "Female" } }, "file_downloaded": "friends.jpg" }	{ "status": "success", "version": "2.9.3", "request_uuid": "cf655b9a-7467-4d2c-8425-a12fbb600af4", "result": "https://fdocs.filerobot.com/https://ask.filerobot.com/deliver/fdocs/cf655b9a-7467-4d2c-8425-a12fbb600af4.png", "faces": { "face_0": { "box": [ 630, 161, 940, 573 ], "emotions": { "angry": 0.9, "disgust": 0.29, "fear": 0.09, "happy": 2.27, "sad": 3.59, "surprise": 0.09, "neutral": 92.79 }, "dominant_emotion": "neutral", "races": { "asian": 0.03, "indian": 0.06, "black": 0.0, "white": 84.59, "middle eastern": 7.62, "latino hispanic": 7.7 }, "dominant_race": "white", "age": 26, "gender": "Female" } }, "file_downloaded": "face.png" }