With affordable digital cameras, camcorders and camera phones becoming ubiquitous, consumers are increasingly finding themselves facing mountains of unorganised multimedia content. The vast majority of this data is not clearly identified – making finding and then annotating it correctly an unappealing and time-consuming task.
By some estimates as much as 70 percent of the multimedia content people produce themselves or obtain from other sources is never viewed again. Instead it is left to languish in assorted folders on PC hard drives. If, however, this content could be found and retrieved more easily, or even categorised intelligently and grouped with new content, it would undoubtedly be accessed and shared more readily.
This is the point of the aceMedia system, which uses advances in knowledge, semantics and multimedia processing technologies to support self-analysing, self-annotating and self-adapting content.
“People don’t want to have to spend time managing their content manually, they just want to be able to view it whenever and however they want,” says Paola Hobson, the aceMedia project coordinator. “For that to happen, multimedia content needs to become intelligent.”
The aceMedia system, which is being developed under the IST project until December 2007, relies on content pre-processing, image recognition and knowledge analysis tools to supply metadata annotations on static and moving images, and on specific parts of those images. A photo of a crowded beach, for example, could be automatically annotated with references to the beach, sea, sky and bathers.
Once the photo has this attached metadata specifying the content of the photo and its various components, any of the annotated words, similar words or combinations of them entered into a search engine would identify the photo. In addition, by drawing on the profiles of different users the system could return images that are personalised to the interests and prerequisites of the person doing the search.
The system is built around the concept of an Autonomous Content Entity (ACE). The ACE system consists of three technological layers: a content layer that is scaleable and adapts the content to the user's device and how it is viewed; a metadata layer that carries out the semantic analysis and annotation; and an intelligence layer that provides programmability and allows the ACE to act autonomously. In an effort to address privacy concerns, users can also assign restrictions on who can access the content on different devices.
In the case of videos, different sections of the video could be annotated depending on what was being shown, and individual segments could easily be extracted and viewed.
This 'smart' content can then be adapted by the system for display using a variety of devices.
“So far we’ve developed the technology for sharing from PCs to televisions via a set-top box. We also plan to bring mobile phones into the equation, given that today they are not only content-viewing but also content-creating devices,” Matellanes says.
Trials with end users are being carried out throughout the course of the project, and have so far drawn positive feedback from both members of the general public and professionals. “People really want and need the capabilities this system offers,” Matellanes says.
For content providers, such a system could be a boon to business, particularly when it comes to offering content for sale over the internet. “You can’t make money out of content if people can’t find it, and the cost of annotating content manually is enormous,” notes Hobson. “Automatic annotation will help people find what they want, and they would consume more of it.”Contact:
Jernett Karensen | alfa
Stable magnetic bit of three atoms
21.09.2017 | Sonderforschungsbereich 668
Drones can almost see in the dark
20.09.2017 | Universität Zürich
Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.
A warming planet
Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.
The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...
Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...
Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!
When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...
For the first time, physicists have successfully imaged spiral magnetic ordering in a multiferroic material. These materials are considered highly promising candidates for future data storage media. The researchers were able to prove their findings using unique quantum sensors that were developed at Basel University and that can analyze electromagnetic fields on the nanometer scale. The results – obtained by scientists from the University of Basel’s Department of Physics, the Swiss Nanoscience Institute, the University of Montpellier and several laboratories from University Paris-Saclay – were recently published in the journal Nature.
Multiferroics are materials that simultaneously react to electric and magnetic fields. These two properties are rarely found together, and their combined...
19.09.2017 | Event News
12.09.2017 | Event News
06.09.2017 | Event News
22.09.2017 | Life Sciences
22.09.2017 | Medical Engineering
22.09.2017 | Physics and Astronomy