Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

TIB’s Visual Analytics Research Group to develop methods for person detection and visualisation

19.03.2018

DFG funds new joint research project for automatic indexing in scientific video archives

This January saw the start of the project “Development of a software system for automatic scene and person indexing in scientific video archives “, which is being funded by the German Research Foundation (DFG) for a period of three years.


The partners involved in the project are the German Broadcasting Archive (DRA, Director Angelika Hörth), the Chair of Practical Computer Science at Philipps-University of Marburg (Professor Bernd Freisleben) and the Visual Analytics Research Group (Professor Ralph Ewerth) of the Technische Informationsbibliothek (TIB) – German National Library of Science and Technology – Leibniz Information Centre for Science and Technology.

Within the project, the University of Marburg will develop methods for the detection of concepts and scenes, whilst TIB will concentrate on approaches for person detection and the visualisation of results. The German Broadcasting Archive (DRA) will contribute to the project from a documentary perspective by conducting requirement analyses and a qualitative evaluation.

In addition, it will make available historic TV material on a large scale – at its Potsdam-Babelsberg site, the DRA manages the entire wealth of television programmes of the former German Democratic Republic (GDR), and is the only point of contact for scientific research in this field. The project partners will be able to build on the excellent results of a forerunner project.

One of the first goals is to further optimise detection rates for concepts and persons and, with the use of the envisaged deep learning methods, to expand these to other research-intense parts of DRA television broadcasts. In addition, the project will involve the implementation of the automatic indexing of material for 100 further visual concepts and 100 further important persons of the GDR, enabling video content-based search enquiries to be conducted on this basis. Another objective is to ultimately enable archive staff to initiate training processes for the underlying machine learning methods for adding further concepts or persons.

The resulting software system should enable the DRA to respond quickly and flexibly to different research questions placed by archive users. However, the research project does not only seek to develop a sustainable solution for the entire material of the DRA, it is also supposed to be easily transferable to other archives. For this purpose, the software tools developed within the project will be made available in open source, enabling other research institutions with media archives to benefit from the person lexicon, concept lexicon and visualisation techniques, and to adapt them to their own needs with little effort.

Professor Ewerth is looking forward to advancing the content detection methods in videos and the visualisation of results: “As a result, we hope to be able to provide other institutes and organisations with reusable open source software tools for automatically indexing their video archives, contributing to the indexing of video data relevant to research.”


About TIB
Acting in the capacity of the German national library of technology, as well as architecture, chemistry, computer science, mathematics and physics, the TIB –Leibniz Information Centre for Science and Technology and University Library provides academia, research, industry and business with literature and information in printed and electronic form.

TIB is continuously expanding its role as a German information centre for the digitisation of science and technology. The library provides scientific content, digital services and methodological skills to specialist and research communities at www.tib.eu, supporting the different stages of scientific work. The library’s search and order portal offers users access to more than 80 million technical and scientific datasets indexed by TIB. The library’s outstanding quality-assured collections also include knowledge objects such as audiovisual media, 3D models and research data. Thanks to specially developed search technologies, TIB’s AV-Portal (https://av.tib.eu/) can be used to search for specific content from scientific videos from the fields of science and technology. As a research library, TIB conducts applied research and development in order to generate new services and optimise existing ones. The key areas of research are in the fields of data science, non-textual material, Open Science and visual analytics.

TIB is a public-law foundation of the Federal State of Lower Saxony. The library is a member of the Leibniz Association.

Weitere Informationen:

https://www.tib.eu/en – More information about the TIB – Leibniz Information Centre for Science and Technology

Dr. Sandra Niemeyer | idw - Informationsdienst Wissenschaft

More articles from Information Technology:

nachricht Quantum computers by AQT and University of Innsbruck leverage Cirq for quantum algorithm development
16.09.2019 | Universität Innsbruck

nachricht Artificial Intelligence speeds up photodynamics simulations
12.09.2019 | University of Vienna

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Tomorrow´s coolants of choice

Scientists assess the potential of magnetic-cooling materials

Later during this century, around 2060, a paradigm shift in global energy consumption is expected: we will spend more energy for cooling than for heating....

Im Focus: The working of a molecular string phone

Researchers from the Department of Atomically Resolved Dynamics of the Max Planck Institute for the Structure and Dynamics of Matter (MPSD) at the Center for Free-Electron Laser Science in Hamburg, the University of Potsdam (both in Germany) and the University of Toronto (Canada) have pieced together a detailed time-lapse movie revealing all the major steps during the catalytic cycle of an enzyme. Surprisingly, the communication between the protein units is accomplished via a water-network akin to a string telephone. This communication is aligned with a ‘breathing’ motion, that is the expansion and contraction of the protein.

This time-lapse sequence of structures reveals dynamic motions as a fundamental element in the molecular foundations of biology.

Im Focus: Milestones on the Way to the Nuclear Clock

Two research teams have succeeded simultaneously in measuring the long-sought Thorium nuclear transition, which enables extremely precise nuclear clocks. TU Wien (Vienna) is part of both teams.

If you want to build the most accurate clock in the world, you need something that "ticks" very fast and extremely precise. In an atomic clock, electrons are...

Im Focus: Graphene sets the stage for the next generation of THz astronomy detectors

Researchers from Chalmers University of Technology have demonstrated a detector made from graphene that could revolutionize the sensors used in next-generation space telescopes. The findings were recently published in the scientific journal Nature Astronomy.

Beyond superconductors, there are few materials that can fulfill the requirements needed for making ultra-sensitive and fast terahertz (THz) detectors for...

Im Focus: Physicists from Stuttgart prove the existence of a supersolid state of matte

A supersolid is a state of matter that can be described in simplified terms as being solid and liquid at the same time. In recent years, extensive efforts have been devoted to the detection of this exotic quantum matter. A research team led by Tilman Pfau and Tim Langen at the 5th Institute of Physics of the University of Stuttgart has succeeded in proving experimentally that the long-sought supersolid state of matter exists. The researchers report their results in Nature magazine.

In our everyday lives, we are familiar with matter existing in three different states: solid, liquid, or gas. However, if matter is cooled down to extremely...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Society 5.0: putting humans at the heart of digitalisation

10.09.2019 | Event News

Interspeech 2019 conference: Alexa and Siri in Graz

04.09.2019 | Event News

AI for Laser Technology Conference: optimizing the use of lasers with artificial intelligence

29.08.2019 | Event News

 
Latest News

Too much of a good thing: overactive immune cells trigger inflammation

16.09.2019 | Life Sciences

Scientists create a nanomaterial that is both twisted and untwisted at the same time

16.09.2019 | Materials Sciences

Researchers have identified areas of the retina that change in mild Alzheimer's disease

16.09.2019 | Health and Medicine

VideoLinks
Science & Research
Overview of more VideoLinks >>>