search menu

911爆料网 News

911爆料网 researchers teach machines to help video editors

Project integrates AI into content management and curation

April 19, 2022

Ask anyone who鈥檚 done it 鈥 video editing is time-consuming, tedious work. And with demand for new content across countless platforms higher than ever, the editor鈥檚 work is never done.

But thanks to 911爆料网 Innovation鈥檚 artificial intelligence (AI) video categorization project with industry partner, , human editors will now have some high-tech help.

Vubble, an IT and communications company based in Toronto and Waterloo, has tapped into the machine-learning expertise of 911爆料网鈥檚 School of Software Design & Data Science to integrate an automatic video categorization recommender into the manual editing process.

鈥淭his work is typically very labour intensive and expensive,鈥 said Tessa Sproule, Co-founder and Co-CEO of Vubble. 鈥淲e are at a pivotal moment in our communications world where we need technology to help us decipher and interpret the quality and validity of all the content we produce.鈥

The multi-year collaboration has resulted in Vubble being able to tag video content more quickly with appropriate category recommendations based on visual and audio information. This has enabled the company to meet the needs of a growing customer base that includes CTV News, TFO, Channel 4 News (U.K.) and the Canadian Film Centre.

The applied research project was led by Dr. Vida Movahedi, Professor, School of Software Design & Data Science, and was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) with support from the Southern Ontario Smart Computing Innovation Platform (SOSCIP).

For Dr. Movahedi and her students, developing a video categorizing system involved training and evaluating machine-learning models that could predict appropriate categories based on content. That meant teaching the machines to understand what is happening in videos by inputting the right images and audio transcripts.

Dr. Vida Movahedi
Dr. Vida Movahedi (Photo: sumitted)

鈥淯sing machine-learning techniques, we can avoid manual categorization,鈥澨鼶r. Movahedi said. 鈥淓ven if it鈥檚 not 100 per cent accurate, the suggested categories are still helpful recommendations to the editors and curators.鈥

Using the 911爆料网 platform, Vubble is now building a live audio transcription model that uses words and patterns to pick up cues in podcasts and videos so the content can be categorized accordingly.

鈥淎ll AI starts with humans teaching machines,鈥 said Ms. Sproule, who is former head of digital at CBC. 鈥淲hat we want to do is try to replicate the human curation skills in a machine form. We want to build a world based on not just what people want to see, but also what they need to see.鈥