DFG funds new joint research project for automatic indexing in scientific video archives
This January saw the start of the project “Development of a software system for automatic scene and person indexing in scientific video archives “, which is being funded by the German Research Foundation (DFG) for a period of three years.
The partners involved in the project are the German Broadcasting Archive (DRA, Director Angelika Hörth), the Chair of Practical Computer Science at Philipps-University of Marburg (Professor Bernd Freisleben) and the Visual Analytics Research Group (Professor Ralph Ewerth) of the Technische Informationsbibliothek (TIB) – German National Library of Science and Technology – Leibniz Information Centre for Science and Technology.
Within the project, the University of Marburg will develop methods for the detection of concepts and scenes, whilst TIB will concentrate on approaches for person detection and the visualisation of results. The German Broadcasting Archive (DRA) will contribute to the project from a documentary perspective by conducting requirement analyses and a qualitative evaluation.
In addition, it will make available historic TV material on a large scale – at its Potsdam-Babelsberg site, the DRA manages the entire wealth of television programmes of the former German Democratic Republic (GDR), and is the only point of contact for scientific research in this field. The project partners will be able to build on the excellent results of a forerunner project.
One of the first goals is to further optimise detection rates for concepts and persons and, with the use of the envisaged deep learning methods, to expand these to other research-intense parts of DRA television broadcasts. In addition, the project will involve the implementation of the automatic indexing of material for 100 further visual concepts and 100 further important persons of the GDR, enabling video content-based search enquiries to be conducted on this basis. Another objective is to ultimately enable archive staff to initiate training processes for the underlying machine learning methods for adding further concepts or persons.
The resulting software system should enable the DRA to respond quickly and flexibly to different research questions placed by archive users. However, the research project does not only seek to develop a sustainable solution for the entire material of the DRA, it is also supposed to be easily transferable to other archives. For this purpose, the software tools developed within the project will be made available in open source, enabling other research institutions with media archives to benefit from the person lexicon, concept lexicon and visualisation techniques, and to adapt them to their own needs with little effort.
Professor Ewerth is looking forward to advancing the content detection methods in videos and the visualisation of results: “As a result, we hope to be able to provide other institutes and organisations with reusable open source software tools for automatically indexing their video archives, contributing to the indexing of video data relevant to research.”
Acting in the capacity of the German national library of technology, as well as architecture, chemistry, computer science, mathematics and physics, the TIB –Leibniz Information Centre for Science and Technology and University Library provides academia, research, industry and business with literature and information in printed and electronic form.
TIB is continuously expanding its role as a German information centre for the digitisation of science and technology. The library provides scientific content, digital services and methodological skills to specialist and research communities at www.tib.eu, supporting the different stages of scientific work. The library’s search and order portal offers users access to more than 80 million technical and scientific datasets indexed by TIB. The library’s outstanding quality-assured collections also include knowledge objects such as audiovisual media, 3D models and research data. Thanks to specially developed search technologies, TIB’s AV-Portal (https://av.tib.eu/) can be used to search for specific content from scientific videos from the fields of science and technology. As a research library, TIB conducts applied research and development in order to generate new services and optimise existing ones. The key areas of research are in the fields of data science, non-textual material, Open Science and visual analytics.
TIB is a public-law foundation of the Federal State of Lower Saxony. The library is a member of the Leibniz Association.
https://www.tib.eu/en – More information about the TIB – Leibniz Information Centre for Science and Technology
Dr. Sandra Niemeyer | idw - Informationsdienst Wissenschaft
Plant identification increased tenfold with Flora Incognita App in March
03.04.2020 | Technische Universität Ilmenau
AI finds 2D materials in the blink of an eye
02.04.2020 | Institute of Industrial Science, The University of Tokyo
Drops of water falling on or sliding over surfaces may leave behind traces of electrical charge, causing the drops to charge themselves. Scientists at the Max Planck Institute for Polymer Research (MPI-P) in Mainz have now begun a detailed investigation into this phenomenon that accompanies us in every-day life. They developed a method to quantify the charge generation and additionally created a theoretical model to aid understanding. According to the scientists, the observed effect could be a source of generated power and an important building block for understanding frictional electricity.
Water drops sliding over non-conducting surfaces can be found everywhere in our lives: From the dripping of a coffee machine, to a rinse in the shower, to an...
90 million-year-old forest soil provides unexpected evidence for exceptionally warm climate near the South Pole in the Cretaceous
An international team of researchers led by geoscientists from the Alfred Wegener Institute, Helmholtz Centre for Polar and Marine Research (AWI) have now...
The bacteria that cause tuberculosis need iron to survive. Researchers at the University of Zurich have now solved the first detailed structure of the transport protein responsible for the iron supply. When the iron transport into the bacteria is inhibited, the pathogen can no longer grow. This opens novel ways to develop targeted tuberculosis drugs.
One of the most devastating pathogens that lives inside human cells is Mycobacterium tuberculosis, the bacillus that causes tuberculosis. According to the...
An international team with the participation of Prof. Dr. Michael Kues from the Cluster of Excellence PhoenixD at Leibniz University Hannover has developed a new method for generating quantum-entangled photons in a spectral range of light that was previously inaccessible. The discovery can make the encryption of satellite-based communications much more secure in the future.
A 15-member research team from the UK, Germany and Japan has developed a new method for generating and detecting quantum-entangled photons at a wavelength of...
Together with their colleagues from the University of Würzburg, physicists from the group of Professor Alexander Szameit at the University of Rostock have devised a “funnel” for photons. Their discovery was recently published in the renowned journal Science and holds great promise for novel ultra-sensitive detectors as well as innovative applications in telecommunications and information processing.
The quantum-optical properties of light and its interaction with matter has fascinated the Rostock professor Alexander Szameit since College.
02.04.2020 | Event News
26.03.2020 | Event News
23.03.2020 | Event News
03.04.2020 | Materials Sciences
03.04.2020 | Life Sciences
03.04.2020 | Life Sciences