New Technologies for A/V Analysis and Search

A/V Segment Matching – Tracking metadata and detecting duplicates

Aggregation, production and storage often include the creation of complete or partial copies of content, which results in unnecessary storage costs and issues related to metadata tracking. Fraunhofer IDMT’s audio and video segment technologies can be used to detect complete and partial matches as well as content reuse, which can also be a powerful tool for program analysis and content monitoring.

Automatic A/V annotation, now featuring audio forensics tools

Building on its existing A/V analysis technologies (amongst others speech-music discrimination and automatic audio/music and visual annotation), Fraunhofer IDMT now also provides several tools for audio forensics. “Our software tools support content production and avoid quality problems, for instance,” explains Patrick Aichroth, Head of Media Distribution and Security at Fraunhofer IDMT. “This can be achieved by using codec analysis to detect previous coding steps and parameters. Moreover, the tools allow the identification of the original recording device, which can be used to automatically adapt audio processing to the device’s properties”. Finally, if audio material was not properly annotated, the software helps finding cuts and edits.

An Open-Source Framework for multi-modal analysis and recommendation

The possibility to perform complex multi-modal content analysis is crucial to support advanced search and recommendation functionalities and to improve the quality of metadata, but it requires addressing of many technological challenges. The open-source framework MiCO (Media in Context), which was developed in a research project funded by the European Commission, addresses several of these challenges. The results and features of the project will be presented at NAB Show as well.

Automatic Quality Control (QC)

Fraunhofer IDMT will also present the integration of its QC components for automated Quality Control of DCP/IMF content into the professional movie post-production solution easyDCP by Fraunhofer IIS.

If you are interested in A/V Analysis and Search please feel free to stop by the Fraunhofer booth SU6110 in the South Upper Hall.

https://www.idmt.fraunhofer.de/en/events_and_exhibitions/nab_show_2017.html