DFG funds new joint research project for automatic indexing in scientific video archives
This January saw the start of the project “Development of a software system for automatic scene and person indexing in scientific video archives “, which is being funded by the German Research Foundation (DFG) for a period of three years.
The partners involved in the project are the German Broadcasting Archive (DRA, Director Angelika Hörth), the Chair of Practical Computer Science at Philipps-University of Marburg (Professor Bernd Freisleben) and the Visual Analytics Research Group (Professor Ralph Ewerth) of the Technische Informationsbibliothek (TIB) – German National Library of Science and Technology – Leibniz Information Centre for Science and Technology.
Within the project, the University of Marburg will develop methods for the detection of concepts and scenes, whilst TIB will concentrate on approaches for person detection and the visualisation of results. The German Broadcasting Archive (DRA) will contribute to the project from a documentary perspective by conducting requirement analyses and a qualitative evaluation.
In addition, it will make available historic TV material on a large scale – at its Potsdam-Babelsberg site, the DRA manages the entire wealth of television programmes of the former German Democratic Republic (GDR), and is the only point of contact for scientific research in this field. The project partners will be able to build on the excellent results of a forerunner project.
One of the first goals is to further optimise detection rates for concepts and persons and, with the use of the envisaged deep learning methods, to expand these to other research-intense parts of DRA television broadcasts. In addition, the project will involve the implementation of the automatic indexing of material for 100 further visual concepts and 100 further important persons of the GDR, enabling video content-based search enquiries to be conducted on this basis. Another objective is to ultimately enable archive staff to initiate training processes for the underlying machine learning methods for adding further concepts or persons.
The resulting software system should enable the DRA to respond quickly and flexibly to different research questions placed by archive users. However, the research project does not only seek to develop a sustainable solution for the entire material of the DRA, it is also supposed to be easily transferable to other archives. For this purpose, the software tools developed within the project will be made available in open source, enabling other research institutions with media archives to benefit from the person lexicon, concept lexicon and visualisation techniques, and to adapt them to their own needs with little effort.
Professor Ewerth is looking forward to advancing the content detection methods in videos and the visualisation of results: “As a result, we hope to be able to provide other institutes and organisations with reusable open source software tools for automatically indexing their video archives, contributing to the indexing of video data relevant to research.”
Acting in the capacity of the German national library of technology, as well as architecture, chemistry, computer science, mathematics and physics, the TIB –Leibniz Information Centre for Science and Technology and University Library provides academia, research, industry and business with literature and information in printed and electronic form.
TIB is continuously expanding its role as a German information centre for the digitisation of science and technology. The library provides scientific content, digital services and methodological skills to specialist and research communities at www.tib.eu, supporting the different stages of scientific work. The library’s search and order portal offers users access to more than 80 million technical and scientific datasets indexed by TIB. The library’s outstanding quality-assured collections also include knowledge objects such as audiovisual media, 3D models and research data. Thanks to specially developed search technologies, TIB’s AV-Portal (https://av.tib.eu/) can be used to search for specific content from scientific videos from the fields of science and technology. As a research library, TIB conducts applied research and development in order to generate new services and optimise existing ones. The key areas of research are in the fields of data science, non-textual material, Open Science and visual analytics.
TIB is a public-law foundation of the Federal State of Lower Saxony. The library is a member of the Leibniz Association.
https://www.tib.eu/en – More information about the TIB – Leibniz Information Centre for Science and Technology
Dr. Sandra Niemeyer | idw - Informationsdienst Wissenschaft
Quantum computers by AQT and University of Innsbruck leverage Cirq for quantum algorithm development
16.09.2019 | Universität Innsbruck
Artificial Intelligence speeds up photodynamics simulations
12.09.2019 | University of Vienna
Later during this century, around 2060, a paradigm shift in global energy consumption is expected: we will spend more energy for cooling than for heating....
Researchers from the Department of Atomically Resolved Dynamics of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg, the University of Potsdam (both in Germany) and the University of Toronto (Canada) have pieced together a detailed time-lapse movie revealing all the major steps during the catalytic cycle of an enzyme. Surprisingly, the communication between the protein units is accomplished via a water-network akin to a string telephone. This communication is aligned with a ‘breathing’ motion, that is the expansion and contraction of the protein.
This time-lapse sequence of structures reveals dynamic motions as a fundamental element in the molecular foundations of biology.
Two research teams have succeeded simultaneously in measuring the long-sought Thorium nuclear transition, which enables extremely precise nuclear clocks. TU Wien (Vienna) is part of both teams.
If you want to build the most accurate clock in the world, you need something that "ticks" very fast and extremely precise. In an atomic clock, electrons are...
Researchers from Chalmers University of Technology have demonstrated a detector made from graphene that could revolutionize the sensors used in next-generation space telescopes. The findings were recently published in the scientific journal Nature Astronomy.
Beyond superconductors, there are few materials that can fulfill the requirements needed for making ultra-sensitive and fast terahertz (THz) detectors for...
A supersolid is a state of matter that can be described in simplified terms as being solid and liquid at the same time. In recent years, extensive efforts have been devoted to the detection of this exotic quantum matter. A research team led by Tilman Pfau and Tim Langen at the 5th Institute of Physics of the University of Stuttgart has succeeded in proving experimentally that the long-sought supersolid state of matter exists. The researchers report their results in Nature magazine.
In our everyday lives, we are familiar with matter existing in three different states: solid, liquid, or gas. However, if matter is cooled down to extremely...
10.09.2019 | Event News
04.09.2019 | Event News
29.08.2019 | Event News
16.09.2019 | Life Sciences
16.09.2019 | Materials Sciences
16.09.2019 | Health and Medicine