In a New Method for Searching Image Databases, a Hand-drawn Sketch Is all it Takes

From a hand-drawn sketch to a photo or video: a new method for image data bases. Image: Martin Graf Photography

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as ‘vitrivr’, which allows a search for images and videos by means of a sketch.

The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types – search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.

Further information

Prof. Heiko Schuldt, Head of the Database and Information Systems Research Group at the University of Basel’s Department of Mathematics and Computer Science, Tel. +41 61 207 05 58, Email: heiko.schuldt@unibas.ch

https://youtu.be/NjDqToONeZc – YouTube video on vitrivr
https://www.vitrivr.org – The vitrivr website

Media Contact

Christoph Dieffenbacher Universität Basel

All news from this category: Information Technology

Here you can find a summary of innovations in the fields of information and data processing and up-to-date developments on IT equipment and hardware.

This area covers topics such as IT services, IT architectures, IT management and telecommunications.

Back to the Homepage

Comments (0)

Write comment

Latest posts

Seawater as an electrical cable !?

Wireless power transfers in the ocean For drones that can be stationed underwater for the adoption of ICT in mariculture. Associate professor Masaya Tamura, Kousuke Murai (who has completed the…

Rare quadruple-helix DNA found in living human cells with glowing probes

New probes allow scientists to see four-stranded DNA interacting with molecules inside living human cells, unravelling its role in cellular processes. DNA usually forms the classic double helix shape of…

A rift in the retina may help repair the optic nerve

In experiments in mouse tissues and human cells, Johns Hopkins Medicine researchers say they have found that removing a membrane that lines the back of the eye may improve the…

Partners & Sponsors

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close