Scene classification

An ML model that accurately classifies images, offering appropriate scene categories and attributes

Overview

The Scene classifier is a cutting-edge artificial intelligence system integrated into our service. Its primary function is to analyze and classify images based on their environmental context and distinguish between indoor and outdoor scenes. Leveraging the power of deep learning and neural networks, this model can accurately determine the setting of an image and provide insights about various scene categories, that the image has been determined to be part of.

The model offers a rich set of scene categories and attributes to help users understand the context of their images better. Some of the scene categories include landscapes, beaches, mountains, forests, interiors, exteriors, etc. It can also identify specific attributes like natural lighting, artificial lighting, crowded spaces, open spaces, urban settings, rural settings and more.

Typical Use Cases

Scene classification can be appropriate in the following use cases:

• Content organization - The Scene classifier plays a vital role in automatically organizing large collections of images. By accurately determining whether an image is taken indoors or outdoors, users can easily filter and group their assets based on environmental context, streamlining content management and retrieval.

• Marketing campaigns - Marketing teams can sort and analyze images that are relevant to specific campaigns. For instance, for an outdoor adventure campaign, the system can help select images of landscapes, mountains, and beaches, thus ensuring consistent and fitting visuals.

• Search optimization - Scene classification adds a new layer of metadata to the images. This enhances search capabilities, enabling efficient searching for specific scenes or environments.

API endpoints

An up-to-date reference with all API endpoints is available here:

Scaleflex API for Digital Asset Management (DAM), Visual AI and Media OptimizationScaleflex API

Example API responses

Input image	Input image

API response

API response

{ "status": "success", "version": "2.9.3", "predictions": { "environment": "indoor", "scene_categories": [ { "category": "arena/performance", "probability": 0.902 }, { "category": "stage/indoor", "probability": 0.063 }, { "category": "discotheque", "probability": 0.013 }, { "category": "orchestra_pit", "probability": 0.009 }, { "category": "stage/outdoor", "probability": 0.005 } ], "scene_attributes": [ "no horizon", "indoor lighting", "man-made", "enclosed area", "spectating", "congregating", "glossy", "cloth", "socializing" ] }, "request_uuid": "026c192d-061e-4db6-9723-fa56fb73778b", "sha1": "2975abaf7208621839a1c41a09cc714b2e32498b" }

{ "status": "success", "version": "2.9.3", "predictions": { "environment": "outdoor", "scene_categories": [ { "category": "lagoon", "probability": 0.389 }, { "category": "coast", "probability": 0.136 }, { "category": "beach", "probability": 0.122 }, { "category": "ocean", "probability": 0.082 }, { "category": "beach_house", "probability": 0.075 } ], "scene_attributes": [ "natural light", "open area", "sunny", "far-away horizon", "natural", "swimming", "boating", "diving", "clouds" ] }, "request_uuid": "be1cc139-cad4-4ea2-958a-6f6ecd201899", "sha1": "7ff3940744ebdba29fce91b8b5e3648da2d258a2" }