Visual Experience Platform
Help CenterRelease NotesBlogWebsite
  • VXP - Visual Experience Platform
    • The VXP
      • Token
    • Settings
      • My Account
        • Profile
        • Support
      • Organisation
        • General Organisation Settings
        • Billing
          • Payment
          • Invoices
          • Plan
        • Users
          • Users
          • Roles
        • Teams
      • Project
        • Branding
        • Subscription
        • Analytics
          • Standard Dashboards
            • Multi tenants
            • User Dashboard
            • DAM Storage
            • Workflows Monitoring
            • Traffic Origin
            • Caching (Volumetry)
            • CDN performance
          • Custom Dashboard
        • Access
          • API keys
          • Security templates
          • OAuth2
  • Digital Asset Management (DAM)
    • Library
      • Assets
        • Asset Details window
          • Asset actions
            • Regional settings
            • Context menu ("..." button)
            • Add to My favorites (heart icon)
            • Edit media (image, video, etc)
              • Edit image
              • Edit video
              • Edit design template (coming soon)
            • Share
          • Asset information tabs
            • General
            • Metadata
            • Variations
            • Comments
            • Approvals
            • History
      • Folders
      • Collections
      • Labels
      • Products
      • My favorites
      • Help
      • Sharebox
      • Airbox
      • Search and Filters
        • Faceted Search
    • Plugins & Connectors
      • Plugins
        • Adobe Creative Cloud
        • Adobe Commerce (Magento)
        • Canva
        • Contentful
        • Contentstack
        • Directus
        • Drupal
        • Opencart
          • Opencart (v4)
        • Prestashop
        • Shopware
        • Storyblok
        • Strapi (v4)
        • Sylius
        • Uniform CMS
        • WordPress - VXP [Beta]
        • Wordpress
      • Connectors
        • Akeneo PIM
          • Akeneo Community PIM Connector
          • Akeneo Enterprise PIM App
        • Canva App
        • CI-Hub
        • Commercetools FaaS App
        • Hygraph app
        • Kontent.ai
        • OneTeg
        • Pabbly Connect
        • Prismic
        • Shopify / Shopify plus app
        • Zapier automation
    • Settings
      • Library
        • Components
        • Appearance
      • Metadata
        • Metadata Configuration
        • Assets
      • Tags
        • Configuration
        • Dictionary
      • Notifications
      • Automations
        • Post processing
        • Webhooks
        • Workflows
      • Storage
        • Providers
        • Upload
        • Video
        • Listing
        • Retrieval
        • Custom routing
  • Visual AI
    • Welcome
    • Visual AI
      • Images
        • Classification models
          • Auto-tagging
          • Brand detect
          • Dominant color extraction
          • Faces
            • Face analysis
            • Face clustering
          • Image quality
          • OCR
          • Number Plate recognition
          • Product type
          • Property classification
          • Scene Classification
          • Sport Classification
        • Generative AI models
          • Image-to-text
          • Plate blurring
          • Quality improvement (remove artifacts)
          • Remove background
          • Text-to-Image
        • Moderation models
          • Face count
          • NSFW - Not Safe For Work
          • Real estate authenticity
          • Watermark detection
      • Videos
        • Face detection
      • Search & find assets
        • Text Search
        • Similar Assets
  • Portals
    • Welcome
    • Creating a Portal
    • Editing a Portal
      • Pages
      • Sections
      • Design
      • Fonts
    • Managing a Portal
      • Settings
      • Access
      • Users
      • Labeling, Cloning, Archiving
    • Publishing a Portal
  • Dynamic Media Optimization (DMO)
    • Welcome
      • Responsive libraries
      • Native plugins
      • 360° view builder
      • Service status
    • Insights
      • Delivery
      • Optimization
      • Alerts
      • Logs
    • Transformations
      • Image optimization
        • Operations
          • Width and height
          • Prevent enlargement
          • Crop
            • Automatic Gravity Crop
            • Positionable Crop
            • Focal point Crop
            • Face Crop
            • Face hide
            • Aspect ratio crop
          • Fit
          • Cropfit
          • Bound
          • Boundmin
          • Cover
          • Device pixel ratio
          • Flip
          • Rotate
          • Trim
          • Rounded corners
        • Filters
          • Adjustment
            • Brightness
            • Contrast
            • Saturate
          • Color manipulation
            • Color overlay
            • Grayscale
            • Duotone
            • Sepia
            • Invert
          • Blur
          • Pixelate
          • Sharpen
        • Watermarking
          • Static watermark
          • Dynamic watermark
          • Text watermark
        • Image compression
          • Image formats
          • Optipress
      • Video optimization
        • Video API
          • Editing
            • Chapters
            • Combine
            • Trim
          • Optimizing
            • Convert
            • Compress
            • Transcode
        • On-the-fly-video optimization
      • Static content optimization
        • PDF to image
        • JS/CSS optimization
    • Invalidation
    • Settings
      • Asset Origin
        • AWS S3 or any other S3-compatible storage provider
        • Google Cloud storage (GCP)
        • Azure Blob storage
        • Own HTTP-based Storage
      • Images
        • Compression
        • Options
        • Watermark
      • Static content
      • Delivery
        • CNAME
        • URL format
        • Rules
        • Security
        • Caching
        • Default behaviors
  • Developers / Headless
    • Headless DAM
      • DAM APIs
        • API Authentication
        • API Reference
      • Command Line Interface (CLI)
      • Media Asset Widget(MAW)
        • Overview
        • Developer reference
        • V2 End-of-life
Powered by GitBook
LogoLogo

Quick links

  • Go to website
  • Legal Center

©2024 Scaleflex SAS

On this page
  • Face analysis
  • Overview
  • Use cases
  • API endpoints
  • Example API responses
Export as PDF
  1. Visual AI
  2. Visual AI
  3. Images
  4. Classification models
  5. Faces

Face analysis

A set of ML models that accurately detect human faces and predict crucial characteristics like facial landmarks, expression, ethnicity, age, and gender

Face analysis

A set of ML models that accurately detect human faces and predict crucial characteristics like facial landmarks, expression, ethnicity, age, and gender

Overview

The Face analyzer consists of several cutting-edge ML models. Its primary function is to detect visible human faces in images and predict some facial characteristics that are deemed important.

Leveraging state-of-the-art deep learning algorithms and neural networks, the Analyzer accurately identifies and analyzes faces, extracting the following information for each face:

  • position in the image (bounding box);

  • facial landmarks (coordinates of points that map to specific facial structures on the face);

  • expression classification (happy, angry, sad, etc.);

  • ethnicity classification;

  • age estimation;

  • gender classification.

Use cases

Use cases for automatic facial analysis include:

  • Image tagging and organization - Automatic facial analysis enables users to easily categorize and index images based on expressions, ethnicities, age groups and genders. This streamlines content management, making it easier to locate specific images for various purposes.

  • Inclusive representation - The Face Analyzer can facilitate inclusive representation in media content. By analyzing facial ethnicities and genders, content creators can ensure diversity and cultural representation in their visual assets, thus promoting inclusivity.

  • Search Optimization - Automatic tagging and categorization of images based on facial characteristics allow users to find specific faces, expressions, or ethnicities with ease.

API endpoints

An up-to-date reference with all API endpoints is available here:

Example API responses

Input image
Input image

Output preview

Output preview

API response

API response

PreviousFacesNextFace clustering

Last updated 7 months ago

{
    "status": "success",
    "version": "2.9.3",
    "request_uuid": "4f74f084-39a3-48f7-829a-336b55e8fd13",
    "result": "https://fdocs.filerobot.com/https://ask.filerobot.com/deliver/fdocs/4f74f084-39a3-48f7-829a-336b55e8fd13.png",
    "faces": {
        "face_0": {
            "box": [
                467,
                269,
                576,
                416
            ],
            "emotions": {
                "angry": 0.07,
                "disgust": 0.03,
                "fear": 0.02,
                "happy": 98.85,
                "sad": 0.3,
                "surprise": 0.58,
                "neutral": 0.16
            },
            "dominant_emotion": "happy",
            "races": {
                "asian": 0.89,
                "indian": 3.23,
                "black": 0.42,
                "white": 34.26,
                "middle eastern": 31.55,
                "latino hispanic": 29.64
            },
            "dominant_race": "white",
            "age": 34,
            "gender": "Male"
        },
        "face_1": {
            "box": [
                907,
                53,
                1017,
                207
            ],
            "emotions": {
                "angry": 1.92,
                "disgust": 0.13,
                "fear": 1.65,
                "happy": 31.76,
                "sad": 9.86,
                "surprise": 3.49,
                "neutral": 51.2
            },
            "dominant_emotion": "neutral",
            "races": {
                "asian": 0.01,
                "indian": 0.02,
                "black": 0.0,
                "white": 89.42,
                "middle eastern": 5.25,
                "latino hispanic": 5.3
            },
            "dominant_race": "white",
            "age": 25,
            "gender": "Male"
        },
        "face_2": {
            "box": [
                62,
                254,
                172,
                398
            ],
            "emotions": {
                "angry": 4.9,
                "disgust": 0.56,
                "fear": 0.16,
                "happy": 4.81,
                "sad": 22.33,
                "surprise": 0.13,
                "neutral": 67.1
            },
            "dominant_emotion": "neutral",
            "races": {
                "asian": 0.01,
                "indian": 0.0,
                "black": 0.0,
                "white": 99.67,
                "middle eastern": 0.12,
                "latino hispanic": 0.2
            },
            "dominant_race": "white",
            "age": 32,
            "gender": "Female"
        },
        "face_3": {
            "box": [
                746,
                346,
                844,
                474
            ],
            "emotions": {
                "angry": 0.55,
                "disgust": 0.29,
                "fear": 0.15,
                "happy": 97.94,
                "sad": 0.09,
                "surprise": 0.92,
                "neutral": 0.06
            },
            "dominant_emotion": "happy",
            "races": {
                "asian": 3.73,
                "indian": 9.26,
                "black": 1.63,
                "white": 27.46,
                "middle eastern": 26.19,
                "latino hispanic": 31.73
            },
            "dominant_race": "latino hispanic",
            "age": 36,
            "gender": "Male"
        },
        "face_4": {
            "box": [
                268,
                143,
                367,
                267
            ],
            "emotions": {
                "angry": 0.91,
                "disgust": 0.01,
                "fear": 0.11,
                "happy": 7.24,
                "sad": 16.02,
                "surprise": 0.69,
                "neutral": 75.03
            },
            "dominant_emotion": "neutral",
            "races": {
                "asian": 0.0,
                "indian": 0.0,
                "black": 0.0,
                "white": 99.97,
                "middle eastern": 0.02,
                "latino hispanic": 0.02
            },
            "dominant_race": "white",
            "age": 23,
            "gender": "Male"
        },
        "face_5": {
            "box": [
                1131,
                272,
                1225,
                400
            ],
            "emotions": {
                "angry": 0.04,
                "disgust": 3.63,
                "fear": 0.02,
                "happy": 95.44,
                "sad": 0.2,
                "surprise": 0.05,
                "neutral": 0.63
            },
            "dominant_emotion": "happy",
            "races": {
                "asian": 0.0,
                "indian": 0.0,
                "black": 0.0,
                "white": 99.88,
                "middle eastern": 0.07,
                "latino hispanic": 0.05
            },
            "dominant_race": "white",
            "age": 24,
            "gender": "Female"
        }
    },
    "file_downloaded": "friends.jpg"
}
{
    "status": "success",
    "version": "2.9.3",
    "request_uuid": "cf655b9a-7467-4d2c-8425-a12fbb600af4",
    "result": "https://fdocs.filerobot.com/https://ask.filerobot.com/deliver/fdocs/cf655b9a-7467-4d2c-8425-a12fbb600af4.png",
    "faces": {
        "face_0": {
            "box": [
                630,
                161,
                940,
                573
            ],
            "emotions": {
                "angry": 0.9,
                "disgust": 0.29,
                "fear": 0.09,
                "happy": 2.27,
                "sad": 3.59,
                "surprise": 0.09,
                "neutral": 92.79
            },
            "dominant_emotion": "neutral",
            "races": {
                "asian": 0.03,
                "indian": 0.06,
                "black": 0.0,
                "white": 84.59,
                "middle eastern": 7.62,
                "latino hispanic": 7.7
            },
            "dominant_race": "white",
            "age": 26,
            "gender": "Female"
        }
    },
    "file_downloaded": "face.png"
}
Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API