Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

In a New Method for Searching Image Databases, a Hand-drawn Sketch Is all it Takes

31.05.2016

Computer scientists at the University of Basel have developed a new method for conducting image and video database searches based on hand-drawn sketches. The user draws a sketch on a tablet or interactive paper, and the system searches for a matching image in the database. The new method is free to access for researchers.

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.


From a hand-drawn sketch to a photo or video: a new method for image data bases.

Image: Martin Graf Photography

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as ‘vitrivr’, which allows a search for images and videos by means of a sketch.

... more about:
»Database »search engine »sequence »video clips

The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types – search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.

Further information

Prof. Heiko Schuldt, Head of the Database and Information Systems Research Group at the University of Basel’s Department of Mathematics and Computer Science, Tel. +41 61 207 05 58, Email: heiko.schuldt@unibas.ch

Weitere Informationen:

https://youtu.be/NjDqToONeZc - YouTube video on vitrivr
https://www.vitrivr.org - The vitrivr website

Christoph Dieffenbacher | Universität Basel

Further reports about: Database search engine sequence video clips

More articles from Information Technology:

nachricht Next generation photonic memory devices are light-written, ultrafast and energy efficient
15.01.2019 | Eindhoven University of Technology

nachricht Overtones can provide faster data communication
10.01.2019 | University of Gothenburg

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Flying Optical Cats for Quantum Communication

Dead and alive at the same time? Researchers at the Max Planck Institute of Quantum Optics have implemented Erwin Schrödinger’s paradoxical gedanken experiment employing an entangled atom-light state.

In 1935 Erwin Schrödinger formulated a thought experiment designed to capture the paradoxical nature of quantum physics. The crucial element of this gedanken...

Im Focus: Nanocellulose for novel implants: Ears from the 3D-printer

Cellulose obtained from wood has amazing material properties. Empa researchers are now equipping the biodegradable material with additional functionalities to produce implants for cartilage diseases using 3D printing.

It all starts with an ear. Empa researcher Michael Hausmann removes the object shaped like a human ear from the 3D printer and explains:

Im Focus: Elucidating the Atomic Mechanism of Superlubricity

The phenomenon of so-called superlubricity is known, but so far the explanation at the atomic level has been missing: for example, how does extremely low friction occur in bearings? Researchers from the Fraunhofer Institutes IWM and IWS jointly deciphered a universal mechanism of superlubricity for certain diamond-like carbon layers in combination with organic lubricants. Based on this knowledge, it is now possible to formulate design rules for supra lubricating layer-lubricant combinations. The results are presented in an article in Nature Communications, volume 10.

One of the most important prerequisites for sustainable and environmentally friendly mobility is minimizing friction. Research and industry have been dedicated...

Im Focus: Mission completed – EU partners successfully test new technologies for space robots in Morocco

Just in time for Christmas, a Mars-analogue mission in Morocco, coordinated by the Robotics Innovation Center of the German Research Center for Artificial Intelligence (DFKI) as part of the SRC project FACILITATORS, has been successfully completed. SRC, the Strategic Research Cluster on Space Robotics Technologies, is a program of the European Union to support research and development in space technologies. From mid-November to mid-December 2018, a team of more than 30 scientists from 11 countries tested technologies for future exploration of Mars and Moon in the desert of the Maghreb state.

Close to the border with Algeria, the Erfoud region in Morocco – known to tourists for its impressive sand dunes – offered ideal conditions for the four-week...

Im Focus: Programming light on a chip

Research opens doors in photonic quantum information processing, optical signal processing and microwave photonics

Researchers from the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have developed a new integrated photonics platform that can...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

Our digital society in 2040

16.01.2019 | Event News

11th International Symposium: “Advanced Battery Power – Kraftwerk Batterie” Aachen, 3-4 April 2019

14.01.2019 | Event News

ICTM Conference 2019: Digitization emerges as an engineering trend for turbomachinery construction

12.12.2018 | Event News

 
Latest News

Velcro for human cells

16.01.2019 | Life Sciences

Kiel physicists discover new effect in the interaction of plasmas with solids

16.01.2019 | Physics and Astronomy

The pace at which the world’s permafrost soils are warming

16.01.2019 | Earth Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>