Streamlining VOD Ad Marker Insertion with the Amazon Rekognition Shot Detection API

Written by Nathan Agez, Lead Software Engineer

As revenue streams become increasingly reliant on digital content, the strategic insertion of advertisements assumes greater significance in driving profitability. Ad markers, acting as vital indicators within video streams, play a critical role by marking the beginning and end of advertisements. This precision allows for effective control over monetization efforts.

However, the task of seamlessly integrating ad markers into video streams poses significant challenges for broadcasters and network operators. From identifying optimal insertion points without disrupting viewer engagement to ensuring technical synchronization and continuous performance optimization, the ad insertion process demands meticulous attention to detail.

The subsequent sections describe a cloud-based workflow deployed on AWS that leverages the Amazon Rekognition Shot Detection API, AWS Elemental MediaTailor, and AWS Elemental MediaConvert to streamline and automate ad marker insertion.

The Role of SCTE-35 Ad Markers

SCTE-35 (Society of Cable Telecommunications Engineers – 35) is a communication protocol used to signal specific events in a video stream such as the start and end of advertisements. SCTE-35 ad markers are crucial for broadcasters and network operators as they allow precise control over when advertisements are aired, facilitating content monetization.

SCTE-35 Ad Marker Insertion

Inserting SCTE-35 advertising markers can be incredibly tedious and demanding. Determining the best placement for inserting these markers involves the following steps: 

Content analysis: Each program is unique, with its own pace, natural breaks, and key moments. Content needs to be carefully analyzed to spot appropriate moments for ad insertion while avoiding disruptions in the viewing experience.

User experience optimization: Inserting ads at the wrong time can frustrate viewers and lead to decreased engagement. Markers must be strategically placed to minimize interruptions and maintain a smooth user experience.

Technical considerations: Inserting SCTE-35 markers also involves technical considerations such as synchronization with broadcasting systems, managing transitions between main content and ads, and coordinating with other associated metadata.

Continuous monitoring and adjustment: Once ad markers are inserted, it is crucial to monitor and analyze data to assess the effectiveness of the advertising strategy. This may require constant adjustments to optimize performance and maximize advertising revenue.

Workflow Overview

The combination of the Amazon Rekognition Shot Detection API, AWS Elemental MediaConvert, and AWS Elemental MediaTailor results in a powerful solution that streamlines and automates the insertion of ad markers.

Amazon Rekognition Shot Detection API: The API utilizes artificial intelligence to automatically detect shot changes in a video. This enables operators to quickly segment content into individual shots, facilitating rapid video content analysis and management. With this capability, operators can quickly identify key moments in a program, such as transitions, action sequences, or scene changes, which can be useful for inserting advertisements or other content.

Technical cue

Shot Detection

AWS Elemental MediaConvert: A cloud-based video transcoding service that enables the conversion of videos from one format to another while offering advanced features such as SCTE-35 marker insertion. By integrating Amazon Rekognition shot detection with MediaConvert, operators can automate the process of inserting advertising markers, placing them precisely at opportune moments. This allows for more accurate and less intrusive advertising insertion for viewers.

AWS Elemental MediaTailor: Enables the customization of video content delivery based on viewer preferences and behavior. Combining information about detected shots with the customization features offered by MediaTailor allows operators to create smoother and more relevant viewing experiences for viewers. For example, by dynamically adjusting the placement and frequency of advertisements, operators can maximize the impact of ads while minimizing interruptions for viewers.

Conclusion – The Potential of Cloud-Based Workflows for Content Monetization

The integration of Amazon Rekognition’s Shot Detection API with AWS Elemental MediaConvert and AWS Elemental MediaTailor offers a powerful solution for operators to streamline ad insertion workflows and enhance viewer experience. 

This solution demonstrates the significant potential of cloud-based workflows in advertising and content monetization within the VOD landscape. As the media industry continues to evolve, embracing the latest advancements in cloud-based AI technology can offer a crucial edge to broadcasters and network operators aiming to stay competitive and meet the ever-changing demands of their audience.

About TrackIt

TrackIt is an international AWS cloud consulting, systems integration, and software development firm headquartered in Marina del Rey, CA.

We have built our reputation on helping media companies architect and implement cost-effective, reliable, and scalable Media & Entertainment workflows in the cloud. These include streaming and on-demand video solutions, media asset management, and archiving, incorporating the latest AI technology to build bespoke media solutions tailored to customer requirements.

Cloud-native software development is at the foundation of what we do. We specialize in Application Modernization, Containerization, Infrastructure as Code and event-driven serverless architectures by leveraging the latest AWS services. Along with our Managed Services offerings which provide 24/7 cloud infrastructure maintenance and support, we are able to provide complete solutions for the media industry.

About Nathan Agez