Auto-tagging

Automatic assignment of relevant tags and keywords to the input video

Overview

Harnessing the power of visual assets is crucial for businesses across various industries. However, as digital libraries grow exponentially, manually assigning tags and keywords to videos becomes a daunting and time-consuming task. That's where automatic tagging can help.

The Video tagging ML model is a powerful machine learning algorithm integrated into our service. It automatically analyzes the frames of the video, extracts their features, and assigns relevant tags or keywords to facilitate improved organization and utilization of visual assets. With this model, businesses can unlock a new level of efficiency and productivity.

The process of AI tagging involves object detection techniques that detect objects, scenes, and concepts within the videos. Based on this analysis, appropriate tags are assigned to videos, enabling proper asset management and content discovery.

The model integrates a powerful translation layer, enabling the generation of tags in several languages. This ensures global reach and cross-regional collaboration for localized video assets.

Use cases

The AI tagging model can provide support for a wide range of typical use cases, including:

• Efficient organization - Automatically assigned tags enable efficient organization of visual assets by categorizing them based on specific objects, scenes or concepts. Users can easily navigate through their video library and quickly locate the desired assets.

• Accelerated search - Users can retrieve videos based on generated tags or keywords. This accelerates the search process, making it effortless to find the required videos in large collections.

• Content Recommendation - Visually similar assets can be identified based on shared tags. Users can discover related content and leverage the full potential of their visual assets.

• Visual content analysis - The model can aid in understanding visual trends, analyzing customer preferences and performing visual data analytics.

API endpoints

An up-to-date reference with all API endpoints is available here:

Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API

Example API responses

Input video

API response

{
    "status":"success",
    "version":"3.34.1",
    "method":"sfx_gmn",
    "tags":[
        {
            "tag":"rabbit",
            "confidence":100,
            "translations":{
                "it":"coniglio",
                "bg":"заек",
                "fr":"lapin"
            }
        },
        {
            "tag":"grass",
            "confidence":90,
            "translations":{
                "it":"erba",
                "bg":"трева",
                "fr":"herbe"
            }
        },
        {
            "tag":"nature",
            "confidence":90,
            "translations":{
                "it":"fiore",
                "bg":"цвете",
                "fr":"fleur"
            }
        },
        {
            "tag":"animal",
            "confidence":90,
            "translations":{
                "it":"natura",
                "bg":"природа",
                "fr":"nature"
            }
        },
        {
            "tag":"flower",
            "confidence":80,
            "translations":{
                "it":"grande",
                "bg":"голям",
                "fr":"grand"
            }
        },
        {
            "tag":"green",
            "confidence":80,
            "translations":{
                "it":"soffice",
                "bg":"пухкав",
                "fr":"moelleux"
            }
        },
        {
            "tag":"beautiful",
            "confidence":80,
            "translations":{
                "it":"pancia grossa",
                "bg":"голям корем",
                "fr":"gros ventre"
            }
        },
        {
            "tag":"big",
            "confidence":70,
            "translations":{
                "it":"animale",
                "bg":"живътни",
                "fr":"animal"
            }
        },
        {
            "tag":"fluffy",
            "confidence":70,
            "translations":{
                "it":"foresta",
                "bg":"гора",
                "fr":"forêt"
            }
        },
        {
            "tag":"butterfly",
            "confidence":70,
            "translations":{
                "it":"albero",
                "bg":"дърво",
                "fr":"arbre"
            }
        },
        {
            "tag":"smiling",
            "confidence":70,
            "translations":{
                "it":"pietra",
                "bg":"камък",
                "fr":"pierre"
            }
        },
        {
            "tag":"big belly",
            "confidence":60,
            "translations":{
                "it":"verde",
                "bg":"зелено",
                "fr":"vert"
            }
        },
        {
            "tag":"forest",
            "confidence":60,
            "translations":{
                "it":"estate",
                "bg":"лято",
                "fr":"été"
            }
        },
        {
            "tag":"tree",
            "confidence":60,
            "translations":{
                "it":"sole",
                "bg":"слънце",
                "fr":"soleil"
            }
        },
        {
            "tag":"jumping",
            "confidence":60,
            "translations":{
                "it":"farfalla",
                "bg":"пеперуда",
                "fr":"papillon"
            }
        },
        {
            "tag":"peaceful",
            "confidence":60,
            "translations":{
                "it":"saltare",
                "bg":"скачане",
                "fr":"sauter"
            }
        },
        {
            "tag":"rock",
            "confidence":50,
            "translations":{
                "it":"dormire",
                "bg":"спя",
                "fr":"dormir"
            }
        },
        {
            "tag":"summer",
            "confidence":50,
            "translations":{
                "it":"sorridente",
                "bg":"усмивка",
                "fr":"souriant"
            }
        },
        {
            "tag":"sun",
            "confidence":50,
            "translations":{
                "it":"bello",
                "bg":"красив",
                "fr":"beau"
            }
        },
        {
            "tag":"sleeping",
            "confidence":50,
            "translations":{
                "it":"pacifico",
                "bg":"спокойствие",
                "fr":"paisible"
            }
        }
    ],
    "count":20,
    "request_uuid":"3dc29b3e-a2bf-478e-9be7-13ecf4040aa2",
    "sha1":"43a8f0a8aa83eeaa4f7a926fd975ab3e492a7046",
    "file_downloaded":"SampleVideo_1280x720_5mb.mp4",
    "file_downloaded_in":1.05,
    "duration_sec":30

}