Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

In a New Method for Searching Image Databases, a Hand-drawn Sketch Is all it Takes

31.05.2016

Computer scientists at the University of Basel have developed a new method for conducting image and video database searches based on hand-drawn sketches. The user draws a sketch on a tablet or interactive paper, and the system searches for a matching image in the database. The new method is free to access for researchers.

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.


From a hand-drawn sketch to a photo or video: a new method for image data bases.

Image: Martin Graf Photography

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as ‘vitrivr’, which allows a search for images and videos by means of a sketch.

... more about:
»Database »search engine »sequence »video clips

The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types – search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.

Further information

Prof. Heiko Schuldt, Head of the Database and Information Systems Research Group at the University of Basel’s Department of Mathematics and Computer Science, Tel. +41 61 207 05 58, Email: heiko.schuldt@unibas.ch

Weitere Informationen:

https://youtu.be/NjDqToONeZc - YouTube video on vitrivr
https://www.vitrivr.org - The vitrivr website

Christoph Dieffenbacher | Universität Basel

Further reports about: Database search engine sequence video clips

More articles from Information Technology:

nachricht New Foldable Drone Flies through Narrow Holes in Rescue Missions
12.12.2018 | Universität Zürich

nachricht NIST's antenna evaluation method could help boost 5G network capacity and cut costs
11.12.2018 | National Institute of Standards and Technology (NIST)

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Lethal combination: Drug cocktail turns off the juice to cancer cells

A widely used diabetes medication combined with an antihypertensive drug specifically inhibits tumor growth – this was discovered by researchers from the University of Basel’s Biozentrum two years ago. In a follow-up study, recently published in “Cell Reports”, the scientists report that this drug cocktail induces cancer cell death by switching off their energy supply.

The widely used anti-diabetes drug metformin not only reduces blood sugar but also has an anti-cancer effect. However, the metformin dose commonly used in the...

Im Focus: New Foldable Drone Flies through Narrow Holes in Rescue Missions

A research team from the University of Zurich has developed a new drone that can retract its propeller arms in flight and make itself small to fit through narrow gaps and holes. This is particularly useful when searching for victims of natural disasters.

Inspecting a damaged building after an earthquake or during a fire is exactly the kind of job that human rescuers would like drones to do for them. A flying...

Im Focus: Topological material switched off and on for the first time

Key advance for future topological transistors

Over the last decade, there has been much excitement about the discovery, recognised by the Nobel Prize in Physics only two years ago, that there are two types...

Im Focus: Researchers develop method to transfer entire 2D circuits to any smooth surface

What if a sensor sensing a thing could be part of the thing itself? Rice University engineers believe they have a two-dimensional solution to do just that.

Rice engineers led by materials scientists Pulickel Ajayan and Jun Lou have developed a method to make atom-flat sensors that seamlessly integrate with devices...

Im Focus: Three components on one chip

Scientists at the University of Stuttgart and the Karlsruhe Institute of Technology (KIT) succeed in important further development on the way to quantum Computers.

Quantum computers one day should be able to solve certain computing problems much faster than a classical computer. One of the most promising approaches is...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

ICTM Conference 2019: Digitization emerges as an engineering trend for turbomachinery construction

12.12.2018 | Event News

New Plastics Economy Investor Forum - Meeting Point for Innovations

10.12.2018 | Event News

EGU 2019 meeting: Media registration now open

06.12.2018 | Event News

 
Latest News

New discoveries predict ability to forecast dementia from single molecule

12.12.2018 | Health and Medicine

CCNY-Yale researchers make shape shifting cell breakthrough

12.12.2018 | Physics and Astronomy

Pain: Perception and motor impulses arise in the brain independently of one another

12.12.2018 | Health and Medicine

VideoLinks
Science & Research
Overview of more VideoLinks >>>