Visual Insights on Videos
Updated
Detect presence of logos, text, objects, scenes, activities within video frames
Overview
Online analysis of a Brand based on text posts and image captions does not provide a complete social presence. Visual Insights, now with the inclusion of running on Videos, ensures comprehensive insights on multimedia posts.
You can now capture your Brand logos’ presence within the frames of a video. Additionally, all key visual enrichments like Objects, Scenes, Activities, Optical Character Recognition (OCR) and Inappropriate Content detection will now work on video posts.
While in the past, logo detection was only available for X (Twitter) as a source. The new video detection model analyses key frames throughout video content across Listening sources which can help you unlock use-cases like:
Matching of logos in audience, sponsor and retailer video posts across social and web data for Brand Reputation analysis
Detection of specific keywords being mentioned within video content using Optical Character Recognition (OCR)
Ensuring no inappropriate videos are visible to users of internal and external Sprinklr Insights reports
Identifying if the Brand is being depicted in a video containing specific scenes, activities or objects
Which visual detections are available on Videos?
The detections in visual insights can be of 2 types. The scope for video support for all detections is detailed below –
Data Fetching – These are the detections which can be added as criteria in a ‘Visual Listening’ Topic. These can be used to fetch new mentions in the partner environment.
Videos are now supported for the following Data Fetching detections:
Data Enrichments – These are the detections which are done on already fetched multimedia in Listening. These are not used to fetch new mentions in the partner environment.
Videos are now supported for the following Data Enrichment detections:
Objects
Scenes
Activities
Inappropriate Content
Which sources are supported for Visual Insights on Listening?
The support for Visual Insights on videos depends on whether the given video is supported as play-able within Sprinklr or not. Listening sources which redirect users to an external video player will not support frame-level video detections.
A summary of support for Listening sources is given in the table below:
Legend
Supported | ✔️ |
Not supported due to API Limitations | ✖️ |
Not supported due to videos only being playable in external player. Detections will happen on thumbnail content in this case | ! |
Source Details
Source | Data Fetching using Logos | Data Fetching using OCR | Logo-based filtering on existing data using ‘Video Brand’ | OCR-based filtering on existing data using ‘Photo Text’ | Objects/Activities/Scenes Detections | Inappropriate Content Detection | Remarks |
X (Twitter) | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ |
|
✖️ | ✖️ | ✔️ | ✔️ | ✔️ | ✔️ | Some Instagram videos become unplayable in platform due to expired URLs, detections within frames will not work for these | |
! | ! | ! | ! | ! | ! |
| |
YouTube | ✖️ | ✖️ | ! | ! | ! | ! |
|
! | ! | ! | ! | ! | ! |
| |
News | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | The support varies based on the domain URL |
VK | ! | ! | ! | ! | ! | ! |
|
Blogs | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | The support varies based on the domain URL |
Forums | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | The support varies based on the domain URL |
Videos (kuaishou.com) | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | ✔️ | For other domains such as Dailymotion, Rumble and Vimeo, the media opens in external link.
Thumbnail support is provided by several other domains |
How to view video detections in a dashboard?
Check this article to know how to setup a custom Visual Insights dashboard
Choose from the available dimensions given below to plot in a required widget as per your use-case:
Detection Type | Sprinklr Dimension |
Logo | Video Brand |
OCR | Photo Text* |
Objects | Photo Object |
Scenes | Photo Scene |
Activities | Photo Activity |
Inappropriate Content | Photo Inappropriate Content* |
*Photo Text and Photo Inappropriate Content dimensions are only available as filters and cannot be plotted in a widget