Government Technology

First Low Cost, Efficient Search Engine for Video Content


Search Engine for Video Content
Search Engine for Video Content

July 8, 2009 By

With video content becoming ever more plentiful on the Web and in police and security operations generally, the problem of finding a specific segment which one recalls is ever more challenging.

It's a problem that TV journalists have long coped with, one they usually solved with detailed notes and time codes in the video tracks. However, as speech recognition software developed, journalists and other media archivists no longer had to painstakingly search to find a specific video section. But they had to invest some serious money in speech recognition software which still required the search to be updated regularly by specialists. (These systems are based on a kind of thesaurus containing all the words they can recognize. However, new topics and personalities bring along new words like "financial crisis" or names such as "Obama". These terms need to be transferred to the thesaurus so that they can be found.)

According to a news release, researchers at the Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS in Sankt Augustin, Germany have developed a speech recognition system that does not require expensive updating measures.

"Our system is based on a syllable thesaurus instead of a word thesaurus. Conventional speech recognizers can only discern a limited number of words, while the total number of words in existence is too vast to handle. The number of existing syllables, on the other hand, is manageable. With about 10,000 stored syllables we can make up any word," says IAIS scientist Daniel Schneider in the release. The program can even acquire new words independently by composing them from the stored syllables: fi-nan-cial cri-sis. It does not need to be updated and so does not entail any running costs.

For each search, the programs are first of all split into segments. Whenever a new speaker starts to talk or a film contribution begins - in which case the content of the audio track changes - the program saves the following scene as a new segment. The user can then navigate from speaker to speaker, and can choose to watch only the contributions of one particular interview partner. In a second step, the individual words are analyzed by speech algorithms. Users can apply the program just like a conventional search engine. You simply enter the search term, and a few milliseconds later the program has scanned 10,000 hours of processed data. Just like an Internet search engine, it displays the results in context in their given sentences. The user then simply clicks on a word to play back the relevant section of film material. The system can find over 85 percent of the spoken words in a program, and 99 out of a 100 located contributions are correct. A license model of the program is already available.

Photo by Chris Radcliff. CC Attribution-Share Alike 2.0 Generic

 


| More

Comments

Add Your Comment

You are solely responsible for the content of your comments. We reserve the right to remove comments that are considered profane, vulgar, obscene, factually inaccurate, off-topic, or considered a personal attack.

In Our Library

White Papers | Exclusives Reports | Webinar Archives | Best Practices and Case Studies
Cybersecurity in an "All-IP World" Are You Prepared?
In a recent survey conducted by Public CIO, over 125 respondents shared how they protect their environments from cyber threats and the challenges they see in an all-IP world. Read how your cybersecurity strategies and attitudes compare with your peers.
Maintain Your IT Budget with Consistent Compliance Practices
Between the demands of meeting federal IT compliance mandates, increasing cybersecurity threats, and ever-shrinking budgets, it’s not uncommon for routine maintenance tasks to slip among state and local government IT departments. If it’s been months, or even only days, since you have maintained your systems, your agency may not be prepared for a compliance audit—and that could have severe financial consequences. Regardless of your mission, consistent systems keep your data secure, your age
Best Practice Guide for Cloud and As-A-Service Procurements
While technology service options for government continue to evolve, procurement processes and policies have remained firmly rooted in practices that are no longer effective. This guide, built upon the collaborative work of state and local government and industry executives, outlines and explains the changes needed for more flexible and agile procurement processes.
View All

Featured Papers