Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

In a New Method for Searching Image Databases, a Hand-drawn Sketch Is all it Takes

31.05.2016

Computer scientists at the University of Basel have developed a new method for conducting image and video database searches based on hand-drawn sketches. The user draws a sketch on a tablet or interactive paper, and the system searches for a matching image in the database. The new method is free to access for researchers.

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.


From a hand-drawn sketch to a photo or video: a new method for image data bases.

Image: Martin Graf Photography

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as ‘vitrivr’, which allows a search for images and videos by means of a sketch.

... more about:
»Database »search engine »sequence »video clips

The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types – search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.

Further information

Prof. Heiko Schuldt, Head of the Database and Information Systems Research Group at the University of Basel’s Department of Mathematics and Computer Science, Tel. +41 61 207 05 58, Email: heiko.schuldt@unibas.ch

Weitere Informationen:

https://youtu.be/NjDqToONeZc - YouTube video on vitrivr
https://www.vitrivr.org - The vitrivr website

Christoph Dieffenbacher | Universität Basel

Further reports about: Database search engine sequence video clips

More articles from Information Technology:

nachricht Multifunctional e-glasses monitor health, protect eyes, control video game
28.05.2020 | American Chemical Society

nachricht Researchers incorporate computer vision and uncertainty into AI for robotic prosthetics
28.05.2020 | North Carolina State University

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Small Protein, Big Impact

In meningococci, the RNA-binding protein ProQ plays a major role. Together with RNA molecules, it regulates processes that are important for pathogenic properties of the bacteria.

Meningococci are bacteria that can cause life-threatening meningitis and sepsis. These pathogens use a small protein with a large impact: The RNA-binding...

Im Focus: K-State study reveals asymmetry in spin directions of galaxies

Research also suggests the early universe could have been spinning

An analysis of more than 200,000 spiral galaxies has revealed unexpected links between spin directions of galaxies, and the structure formed by these links...

Im Focus: New measurement exacerbates old problem

Two prominent X-ray emission lines of highly charged iron have puzzled astrophysicists for decades: their measured and calculated brightness ratios always disagree. This hinders good determinations of plasma temperatures and densities. New, careful high-precision measurements, together with top-level calculations now exclude all hitherto proposed explanations for this discrepancy, and thus deepen the problem.

Hot astrophysical plasmas fill the intergalactic space, and brightly shine in stellar coronae, active galactic nuclei, and supernova remnants. They contain...

Im Focus: Biotechnology: Triggered by light, a novel way to switch on an enzyme

In living cells, enzymes drive biochemical metabolic processes enabling reactions to take place efficiently. It is this very ability which allows them to be used as catalysts in biotechnology, for example to create chemical products such as pharmaceutics. Researchers now identified an enzyme that, when illuminated with blue light, becomes catalytically active and initiates a reaction that was previously unknown in enzymatics. The study was published in "Nature Communications".

Enzymes: they are the central drivers for biochemical metabolic processes in every living cell, enabling reactions to take place efficiently. It is this very...

Im Focus: New double-contrast technique picks up small tumors on MRI

Early detection of tumors is extremely important in treating cancer. A new technique developed by researchers at the University of California, Davis offers a significant advance in using magnetic resonance imaging to pick out even very small tumors from normal tissue. The work is published May 25 in the journal Nature Nanotechnology.

researchers at the University of California, Davis offers a significant advance in using magnetic resonance imaging to pick out even very small tumors from...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Dresden Nexus Conference 2020: Same Time, Virtual Format, Registration Opened

19.05.2020 | Event News

Aachen Machine Tool Colloquium AWK'21 will take place on June 10 and 11, 2021

07.04.2020 | Event News

International Coral Reef Symposium in Bremen Postponed by a Year

06.04.2020 | Event News

 
Latest News

Why developing nerve cells can take a wrong turn

04.06.2020 | Life Sciences

The broken mirror: Can parity violation in molecules finally be measured?

04.06.2020 | Physics and Astronomy

Innocent and highly oxidizing

04.06.2020 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>