DFG funds new joint research project for automatic indexing in scientific video archives
This January saw the start of the project “Development of a software system for automatic scene and person indexing in scientific video archives “, which is being funded by the German Research Foundation (DFG) for a period of three years.
The partners involved in the project are the German Broadcasting Archive (DRA, Director Angelika Hörth), the Chair of Practical Computer Science at Philipps-University of Marburg (Professor Bernd Freisleben) and the Visual Analytics Research Group (Professor Ralph Ewerth) of the Technische Informationsbibliothek (TIB) – German National Library of Science and Technology – Leibniz Information Centre for Science and Technology.
Within the project, the University of Marburg will develop methods for the detection of concepts and scenes, whilst TIB will concentrate on approaches for person detection and the visualisation of results. The German Broadcasting Archive (DRA) will contribute to the project from a documentary perspective by conducting requirement analyses and a qualitative evaluation.
In addition, it will make available historic TV material on a large scale – at its Potsdam-Babelsberg site, the DRA manages the entire wealth of television programmes of the former German Democratic Republic (GDR), and is the only point of contact for scientific research in this field. The project partners will be able to build on the excellent results of a forerunner project.
One of the first goals is to further optimise detection rates for concepts and persons and, with the use of the envisaged deep learning methods, to expand these to other research-intense parts of DRA television broadcasts. In addition, the project will involve the implementation of the automatic indexing of material for 100 further visual concepts and 100 further important persons of the GDR, enabling video content-based search enquiries to be conducted on this basis. Another objective is to ultimately enable archive staff to initiate training processes for the underlying machine learning methods for adding further concepts or persons.
The resulting software system should enable the DRA to respond quickly and flexibly to different research questions placed by archive users. However, the research project does not only seek to develop a sustainable solution for the entire material of the DRA, it is also supposed to be easily transferable to other archives. For this purpose, the software tools developed within the project will be made available in open source, enabling other research institutions with media archives to benefit from the person lexicon, concept lexicon and visualisation techniques, and to adapt them to their own needs with little effort.
Professor Ewerth is looking forward to advancing the content detection methods in videos and the visualisation of results: “As a result, we hope to be able to provide other institutes and organisations with reusable open source software tools for automatically indexing their video archives, contributing to the indexing of video data relevant to research.”
Acting in the capacity of the German national library of technology, as well as architecture, chemistry, computer science, mathematics and physics, the TIB –Leibniz Information Centre for Science and Technology and University Library provides academia, research, industry and business with literature and information in printed and electronic form.
TIB is continuously expanding its role as a German information centre for the digitisation of science and technology. The library provides scientific content, digital services and methodological skills to specialist and research communities at www.tib.eu, supporting the different stages of scientific work. The library’s search and order portal offers users access to more than 80 million technical and scientific datasets indexed by TIB. The library’s outstanding quality-assured collections also include knowledge objects such as audiovisual media, 3D models and research data. Thanks to specially developed search technologies, TIB’s AV-Portal (https://av.tib.eu/) can be used to search for specific content from scientific videos from the fields of science and technology. As a research library, TIB conducts applied research and development in order to generate new services and optimise existing ones. The key areas of research are in the fields of data science, non-textual material, Open Science and visual analytics.
TIB is a public-law foundation of the Federal State of Lower Saxony. The library is a member of the Leibniz Association.
https://www.tib.eu/en – More information about the TIB – Leibniz Information Centre for Science and Technology
Dr. Sandra Niemeyer | idw - Informationsdienst Wissenschaft
An AI that makes road maps from aerial images
18.04.2018 | Massachusetts Institute of Technology, CSAIL
Beyond the clouds: Networked clouds in a production setting
04.04.2018 | Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, DFKI
Novel highly efficient and brilliant gamma-ray source: Based on model calculations, physicists of the Max PIanck Institute for Nuclear Physics in Heidelberg propose a novel method for an efficient high-brilliance gamma-ray source. A giant collimated gamma-ray pulse is generated from the interaction of a dense ultra-relativistic electron beam with a thin solid conductor. Energetic gamma-rays are copiously produced as the electron beam splits into filaments while propagating across the conductor. The resulting gamma-ray energy and flux enable novel experiments in nuclear and fundamental physics.
The typical wavelength of light interacting with an object of the microcosm scales with the size of this object. For atoms, this ranges from visible light to...
Stable joint cartilage can be produced from adult stem cells originating from bone marrow. This is made possible by inducing specific molecular processes occurring during embryonic cartilage formation, as researchers from the University and University Hospital of Basel report in the scientific journal PNAS.
Certain mesenchymal stem/stromal cells from the bone marrow of adults are considered extremely promising for skeletal tissue regeneration. These adult stem...
In the fight against cancer, scientists are developing new drugs to hit tumor cells at so far unused weak points. Such a “sore spot” is the protein complex...
In an article that appears in the journal “Review of Modern Physics”, researchers at the Laboratory for Attosecond Physics (LAP) assess the current state of the field of ultrafast physics and consider its implications for future technologies.
Physicists can now control light in both time and space with hitherto unimagined precision. This is particularly true for the ability to generate ultrashort...
The Atlantic overturning – one of Earth’s most important heat transport systems, pumping warm water northwards and cold water southwards – is weaker today than any time before in more than 1000 years. Sea surface temperature data analysis provides new evidence that this major ocean circulation has slowed down by roughly 15 percent since the middle of the 20th century, according to a study published in the highly renowned journal Nature by an international team of scientists. Human-made climate change is a prime suspect for these worrying observations.
“We detected a specific pattern of ocean cooling south of Greenland and unusual warming off the US coast – which is highly characteristic for a slowdown of the...
13.04.2018 | Event News
12.04.2018 | Event News
09.04.2018 | Event News
18.04.2018 | Materials Sciences
18.04.2018 | Materials Sciences
18.04.2018 | Materials Sciences