Face detection

An ML model capable of analyzing videos frame by frame to detect human faces

Overview

The Video face detector is a powerful ML model that analyzes videos frame by frame to detect the presence of human faces. By accurately identifying faces and providing timestamps for their appearances, the model enhances the video asset management process, enabling users to locate the specific point in the video where human faces appear.

When a human face is detected, the returns the number of faces present in the frame along with the timestamp. This feature allows users to pinpoint specific moments in the video where human faces initially appear.

Typical use cases

This detector can be used in the following sample scenarios:

• Video analytics and insights - The model provides valuable insights from video content.

• Automated video tagging - Videos can be automatically tagged based on the presence of human faces. This simplifies content organization, making it easier for users to search and retrieve videos featuring individuals.

• Personalized video recommendations - The face detection results may be used to offer personalized video recommendations to users. By understanding viewer preferences for human presence, relevant content can be suggested, that enhances user experience and engagement.

• Advanced video search and filtering - The face detection results allow users to filter and search for videos containing groups of people.

API endpoints

An up-to-date reference with all API endpoints is available here:

Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API

Example API responses

Input video

API response

{
    "status": "success",
    "version": "2.9.3",
    "sha1": "2006fbd8ace6e11b6c0b44659def73ee3d120cc4",
    "request_uuid": "8e4feaf4-5270-4c61-9c21-d9b38f9becca",
    "video_duration": 14.64,
    "video_fps": 25.0,
    "file_downloaded": "pexels_videos_2795402 (720p).mp4",
    "faces": true,
    "faces_num": 1,
    "found_at_time": 0
}

Input video

API response

{
    "status": "success",
    "version": "2.9.3",
    "sha1": "91aaadd5f7c0f5dc279ab33bc3df4f031b5d1e9c",
    "request_uuid": "18d64761-58f6-49b0-8d4e-775e8ba285a0",
    "video_duration": 8.675333333333333,
    "video_fps": 23.976023976023978,
    "file_downloaded": "pexels_videos_2231485 (720p).mp4",
    "faces": false,
    "faces_num": 0,
    "found_at_time": false
}