With affordable digital cameras, camcorders and camera phones becoming ubiquitous, consumers are increasingly finding themselves facing mountains of unorganised multimedia content. The vast majority of this data is not clearly identified – making finding and then annotating it correctly an unappealing and time-consuming task.
By some estimates as much as 70 percent of the multimedia content people produce themselves or obtain from other sources is never viewed again. Instead it is left to languish in assorted folders on PC hard drives. If, however, this content could be found and retrieved more easily, or even categorised intelligently and grouped with new content, it would undoubtedly be accessed and shared more readily.
This is the point of the aceMedia system, which uses advances in knowledge, semantics and multimedia processing technologies to support self-analysing, self-annotating and self-adapting content.
“People don’t want to have to spend time managing their content manually, they just want to be able to view it whenever and however they want,” says Paola Hobson, the aceMedia project coordinator. “For that to happen, multimedia content needs to become intelligent.”
The aceMedia system, which is being developed under the IST project until December 2007, relies on content pre-processing, image recognition and knowledge analysis tools to supply metadata annotations on static and moving images, and on specific parts of those images. A photo of a crowded beach, for example, could be automatically annotated with references to the beach, sea, sky and bathers.
Once the photo has this attached metadata specifying the content of the photo and its various components, any of the annotated words, similar words or combinations of them entered into a search engine would identify the photo. In addition, by drawing on the profiles of different users the system could return images that are personalised to the interests and prerequisites of the person doing the search.
The system is built around the concept of an Autonomous Content Entity (ACE). The ACE system consists of three technological layers: a content layer that is scaleable and adapts the content to the user's device and how it is viewed; a metadata layer that carries out the semantic analysis and annotation; and an intelligence layer that provides programmability and allows the ACE to act autonomously. In an effort to address privacy concerns, users can also assign restrictions on who can access the content on different devices.
In the case of videos, different sections of the video could be annotated depending on what was being shown, and individual segments could easily be extracted and viewed.
This 'smart' content can then be adapted by the system for display using a variety of devices.
“So far we’ve developed the technology for sharing from PCs to televisions via a set-top box. We also plan to bring mobile phones into the equation, given that today they are not only content-viewing but also content-creating devices,” Matellanes says.
Trials with end users are being carried out throughout the course of the project, and have so far drawn positive feedback from both members of the general public and professionals. “People really want and need the capabilities this system offers,” Matellanes says.
For content providers, such a system could be a boon to business, particularly when it comes to offering content for sale over the internet. “You can’t make money out of content if people can’t find it, and the cost of annotating content manually is enormous,” notes Hobson. “Automatic annotation will help people find what they want, and they would consume more of it.”Contact:
Jernett Karensen | alfa
New interactive machine learning tool makes car designs more aerodynamic
14.08.2018 | Institute of Science and Technology Austria
Your Smartphone is Watching You: Dangerous Security Holes in Tracker Apps
13.08.2018 | Fraunhofer-Institut für Sichere Informationstechnologie SIT
Scientists develop first tool to use machine learning methods to compute flow around interactively designable 3D objects. Tool will be presented at this year’s prestigious SIGGRAPH conference.
When engineers or designers want to test the aerodynamic properties of the newly designed shape of a car, airplane, or other object, they would normally model...
Researchers from TU Graz and their industry partners have unveiled a world first: the prototype of a robot-controlled, high-speed combined charging system (CCS) for electric vehicles that enables series charging of cars in various parking positions.
Global demand for electric vehicles is forecast to rise sharply: by 2025, the number of new vehicle registrations is expected to reach 25 million per year....
Proteins must be folded correctly to fulfill their molecular functions in cells. Molecular assistants called chaperones help proteins exploit their inbuilt folding potential and reach the correct three-dimensional structure. Researchers at the Max Planck Institute of Biochemistry (MPIB) have demonstrated that actin, the most abundant protein in higher developed cells, does not have the inbuilt potential to fold and instead requires special assistance to fold into its active state. The chaperone TRiC uses a previously undescribed mechanism to perform actin folding. The study was recently published in the journal Cell.
Actin is the most abundant protein in highly developed cells and has diverse functions in processes like cell stabilization, cell division and muscle...
Scientists have discovered that the electrical resistance of a copper-oxide compound depends on the magnetic field in a very unusual way -- a finding that could help direct the search for materials that can perfectly conduct electricity at room temperatur
What happens when really powerful magnets--capable of producing magnetic fields nearly two million times stronger than Earth's--are applied to materials that...
The quality of materials often depends on the manufacturing process. In casting and welding, for example, the rate at which melts solidify and the resulting microstructure of the alloy is important. With metallic foams as well, it depends on exactly how the foaming process takes place. To understand these processes fully requires fast sensing capability. The fastest 3D tomographic images to date have now been achieved at the BESSY II X-ray source operated by the Helmholtz-Zentrum Berlin.
Dr. Francisco Garcia-Moreno and his team have designed a turntable that rotates ultra-stably about its axis at a constant rotational speed. This really depends...
08.08.2018 | Event News
27.07.2018 | Event News
25.07.2018 | Event News
14.08.2018 | Life Sciences
14.08.2018 | Life Sciences
14.08.2018 | Earth Sciences