Visual Experience Platform
Help CenterRelease NotesBlogWebsite
  • VXP - Visual Experience Platform
    • The VXP
      • Token
    • Settings
      • My Account
        • Profile
        • Support
      • Organisation
        • General Organisation Settings
        • Billing
          • Payment
          • Invoices
          • Plan
        • Users
          • Users
          • Roles
        • Teams
      • Project
        • Branding
        • Subscription
        • Analytics
          • Standard Dashboards
            • Multi tenants
            • User Dashboard
            • DAM Storage
            • Workflows Monitoring
            • Traffic Origin
            • Caching (Volumetry)
            • CDN performance
          • Custom Dashboard
        • Access
          • API keys
          • Security templates
          • OAuth2
  • Digital Asset Management (DAM)
    • Library
      • Assets
        • Asset Details window
          • Asset actions
            • Regional settings
            • Context menu ("..." button)
            • Add to My favorites (heart icon)
            • Edit media (image, video, etc)
              • Edit image
              • Edit video
              • Edit design template (coming soon)
            • Share
          • Asset information tabs
            • General
            • Metadata
            • Variations
            • Comments
            • Approvals
            • History
      • Folders
      • Collections
      • Labels
      • Products
      • My favorites
      • Help
      • Sharebox
      • Airbox
      • Search and Filters
        • Faceted Search
    • Plugins & Connectors
      • Plugins
        • Adobe Creative Cloud
        • Adobe Commerce (Magento)
        • Canva
        • Contentful
        • Contentstack
        • Directus
        • Drupal
        • Opencart
          • Opencart (v4)
        • Prestashop
        • Shopware
        • Storyblok
        • Strapi (v4)
        • Sylius
        • Uniform CMS
        • WordPress - VXP [Beta]
        • Wordpress
      • Connectors
        • Akeneo PIM
          • Akeneo Community PIM Connector
          • Akeneo Enterprise PIM App
        • Canva App
        • CI-Hub
        • Commercetools FaaS App
        • Hygraph app
        • Kontent.ai
        • OneTeg
        • Pabbly Connect
        • Prismic
        • Shopify / Shopify plus app
        • Zapier automation
    • Settings
      • Library
        • Components
        • Appearance
      • Metadata
        • Metadata Configuration
        • Assets
      • Tags
        • Configuration
        • Dictionary
      • Notifications
      • Automations
        • Post processing
        • Webhooks
        • Workflows
      • Storage
        • Providers
        • Upload
        • Video
        • Listing
        • Retrieval
        • Custom routing
  • Visual AI
    • Welcome
    • Visual AI
      • Images
        • Classification models
          • Auto-tagging
          • Brand detect
          • Dominant color extraction
          • Faces
            • Face analysis
            • Face clustering
          • Image quality
          • OCR
          • Number Plate recognition
          • Product type
          • Property classification
          • Scene Classification
          • Sport Classification
        • Generative AI models
          • Image-to-text
          • Plate blurring
          • Quality improvement (remove artifacts)
          • Remove background
          • Text-to-Image
        • Moderation models
          • Face count
          • NSFW - Not Safe For Work
          • Real estate authenticity
          • Watermark detection
      • Videos
        • Face detection
      • Search & find assets
        • Text Search
        • Similar Assets
  • Portals
    • Welcome
    • Creating a Portal
    • Editing a Portal
      • Pages
      • Sections
      • Design
      • Fonts
    • Managing a Portal
      • Settings
      • Access
      • Users
      • Labeling, Cloning, Archiving
    • Publishing a Portal
  • Dynamic Media Optimization (DMO)
    • Welcome
      • Responsive libraries
      • Native plugins
      • 360° view builder
      • Service status
    • Insights
      • Delivery
      • Optimization
      • Alerts
      • Logs
    • Transformations
      • Image optimization
        • Operations
          • Width and height
          • Prevent enlargement
          • Crop
            • Automatic Gravity Crop
            • Positionable Crop
            • Focal point Crop
            • Face Crop
            • Face hide
            • Aspect ratio crop
          • Fit
          • Cropfit
          • Bound
          • Boundmin
          • Cover
          • Device pixel ratio
          • Flip
          • Rotate
          • Trim
          • Rounded corners
        • Filters
          • Adjustment
            • Brightness
            • Contrast
            • Saturate
          • Color manipulation
            • Color overlay
            • Grayscale
            • Duotone
            • Sepia
            • Invert
          • Blur
          • Pixelate
          • Sharpen
        • Watermarking
          • Static watermark
          • Dynamic watermark
          • Text watermark
        • Image compression
          • Image formats
          • Optipress
      • Video optimization
        • Video API
          • Editing
            • Chapters
            • Combine
            • Trim
          • Optimizing
            • Convert
            • Compress
            • Transcode
        • On-the-fly-video optimization
      • Static content optimization
        • PDF to image
        • JS/CSS optimization
    • Invalidation
    • Settings
      • Asset Origin
        • AWS S3 or any other S3-compatible storage provider
        • Google Cloud storage (GCP)
        • Azure Blob storage
        • Own HTTP-based Storage
      • Images
        • Compression
        • Options
        • Watermark
      • Static content
      • Delivery
        • CNAME
        • URL format
        • Rules
        • Security
        • Caching
        • Default behaviors
  • Developers / Headless
    • Headless DAM
      • DAM APIs
        • API Authentication
        • API Reference
      • Command Line Interface (CLI)
      • Media Asset Widget(MAW)
        • Overview
        • Developer reference
        • V2 End-of-life
Powered by GitBook
LogoLogo

Quick links

  • Go to website
  • Legal Center

©2024 Scaleflex SAS

On this page
  • Overview
  • Typical Use Cases
  • API endpoints
  • Example API responses
Export as PDF
  1. Visual AI
  2. Visual AI
  3. Images
  4. Classification models

Scene Classification

An ML model that accurately classifies images, offering appropriate scene categories and attributes

PreviousProperty classificationNextSport Classification

Last updated 7 months ago

Overview

The Scene classifier is a cutting-edge artificial intelligence system integrated into our service. Its primary function is to analyze and classify images based on their environmental context and distinguish between indoor and outdoor scenes. Leveraging the power of deep learning and neural networks, this model can accurately determine the setting of an image and provide insights about various scene categories, that the image has been determined to be part of.

The model offers a rich set of scene categories and attributes to help users understand the context of their images better. Some of the scene categories include landscapes, beaches, mountains, forests, interiors, exteriors, etc. It can also identify specific attributes like natural lighting, artificial lighting, crowded spaces, open spaces, urban settings, rural settings and more.

Typical Use Cases

Scene classification can be appropriate in the following use cases:

  • Content organization - The Scene classifier plays a vital role in automatically organizing large collections of images. By accurately determining whether an image is taken indoors or outdoors, users can easily filter and group their assets based on environmental context, streamlining content management and retrieval.

  • Marketing campaigns - Marketing teams can sort and analyze images that are relevant to specific campaigns. For instance, for an outdoor adventure campaign, the system can help select images of landscapes, mountains, and beaches, thus ensuring consistent and fitting visuals.

  • Search optimization - Scene classification adds a new layer of metadata to the images. This enhances search capabilities, enabling efficient searching for specific scenes or environments.

API endpoints

An up-to-date reference with all API endpoints is available here:

Example API responses

Input image
Input image

API response

API response

{
    "status": "success",
    "version": "2.9.3",
    "predictions": {
        "environment": "indoor",
        "scene_categories": [
            {
                "category": "arena/performance",
                "probability": 0.902
            },
            {
                "category": "stage/indoor",
                "probability": 0.063
            },
            {
                "category": "discotheque",
                "probability": 0.013
            },
            {
                "category": "orchestra_pit",
                "probability": 0.009
            },
            {
                "category": "stage/outdoor",
                "probability": 0.005
            }
        ],
        "scene_attributes": [
            "no horizon",
            "indoor lighting",
            "man-made",
            "enclosed area",
            "spectating",
            "congregating",
            "glossy",
            "cloth",
            "socializing"
        ]
    },
    "request_uuid": "026c192d-061e-4db6-9723-fa56fb73778b",
    "sha1": "2975abaf7208621839a1c41a09cc714b2e32498b"
}
{
    "status": "success",
    "version": "2.9.3",
    "predictions": {
        "environment": "outdoor",
        "scene_categories": [
            {
                "category": "lagoon",
                "probability": 0.389
            },
            {
                "category": "coast",
                "probability": 0.136
            },
            {
                "category": "beach",
                "probability": 0.122
            },
            {
                "category": "ocean",
                "probability": 0.082
            },
            {
                "category": "beach_house",
                "probability": 0.075
            }
        ],
        "scene_attributes": [
            "natural light",
            "open area",
            "sunny",
            "far-away horizon",
            "natural",
            "swimming",
            "boating",
            "diving",
            "clouds"
        ]
    },
    "request_uuid": "be1cc139-cad4-4ea2-958a-6f6ecd201899",
    "sha1": "7ff3940744ebdba29fce91b8b5e3648da2d258a2"
}
Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API
Logo