Challenge
A media customer faced a manual and error-prone media analysis pipeline that significantly slowed post-production processes. The inconsistent metadata generated by this approach hindered efficient content indexing and searchability. Additionally, the system struggled to scale with the company’s growing volume of video content, ultimately limiting the company’s ability to deliver timely, high-quality content analysis and archiving services.
Implementation
TrackIt designed and deployed a fully serverless, generative AI-powered media analysis pipeline to automate facial recognition, audio transcription, speaker identification, and context identification. The solution integrates Generative AI and AWS services to ensure rich, scalable, and accurate metadata generation across large volumes of video content.
AWS Services Used
- Amazon Bedrock: Supports Generative AI-based context extraction
- Amazon SageMaker: Hosts custom AI models for specialized media analysis
- Amazon Rekognition: Automates facial recognition
- Amazon CloudWatch: Monitors and logs processing workflows
- AWS CloudFormation: Automates and manages infrastructure as code
Outcome
The generative AI-powered pipeline transformed the customer’s post-production operations. Manual tagging effort was reduced by over 80%, resulting in faster content processing and more consistent metadata. The serverless architecture now supports higher volumes of video data with no infrastructure management burden. Enhanced transcription accuracy, speaker tagging, and context-aware metadata extraction have improved content searchability and streamlined archiving, contributing to more efficient content monetization.
Metrics
- Manual Effort Reduction: ~85% decrease, saving over 150 hours per month
- Cost Savings: Reduced third-party transcription expenses by about $24,000 annually
- Accuracy Improvement: Achieved ~92% accuracy in transcription and facial recognition, enhancing metadata quality
- Scalability: Processes up to 3× more data without requiring additional infrastructure
About TrackIt
TrackIt is an international AWS cloud consulting, systems integration, and software development firm headquartered in Marina del Rey, CA.
We have built our reputation on helping media companies architect and implement cost-effective, reliable, and scalable Media & Entertainment workflows in the cloud. These include streaming and on-demand video solutions, media asset management, and archiving, incorporating the latest AI technology to build bespoke media solutions tailored to customer requirements.
Cloud-native software development is at the foundation of what we do. We specialize in Application Modernization, Containerization, Infrastructure as Code and event-driven serverless architectures by leveraging the latest AWS services. Along with our Managed Services offerings which provide 24/7 cloud infrastructure maintenance and support, we are able to provide complete solutions for the media industry.