Forum for Science, Industry and Business

Sponsored by:     3M 
Search our Site:

 

Unpacking pecking orders to get the gist of web gab

08.06.2006


A USC Information Sciences Institute system pulls answers from online conversations by identifying the alpha chatterers.


The ISI study characterized online posts according a schema of speech acts. While some speech-act characterization was done by hand in this study to test the results, the ISI group has already developed effective software to accomplish the task automatically. Credit: USC Information Sciences Institute



The system, to be presented at a conference on human language technology on June 6, was developed to analyze technical conversations in which an objectively correct answer exists. But the method for statistically characterizing response by the group to individuals is generalizable.

Online communities are now firmly established in domains ranging from high school gossip to professional open-source software design discussions, generating huge repositories of records of human knowledge processing, pre-converted to digital form.


"For study of online natural language interaction, it’s the mother lode," says Eduard Hovy of the University of Southern California Information Sciences Institute.

Such sites provide raw material for a new method that may, among other things, enable Internet chat room users to get a statistical measurement of their influence in their room.

This research is one of the first quantitative studies in the field of natural language processing that takes account of the fact that chat conversations are structured interactions among a large number of people.

In the long term, research in this area will lead to the development of systems that can automatically produce reports and summaries of meetings, researchers hope.

It’s easy to simply harvest factoids from text, said Hovy (left), who holds an appointment as research associate professor in the USC Viterbi School of Engineering department of computer science in addition to his post as deputy director of the ISI Intelligent Systems Division and director of the ISI Natural Language Group.

But the fact that human conversation has an inherent structure, including temporal ordering, references to previous statements, labeled sourcing and other clues opens the door to much deeper machine-generated understanding.

To make use of the structure, the team used a graph-based algorithm called HITS (Hypertext Induced Topic Selection) originally used by Cornell computer scientist Joel Kleinberg to rank and classify web pages by their connections to each other.

In the study, connections between conversation participants replace the web links for the HITS analysis.

The interactions used in the study were threaded discussions from three semesters of a USC undergraduate course in computer science, including 2214 messages in 640 threads, all discussing class material and posing questions about problems.

The goal was to extract from the conversation the best answer to the questions discussed. And, according to the paper, the system works -- not perfectly, but much better than one that selects answers at random. Random selection got the answer (as determined by human inspection) right 87 out of 314 times, where the best implementation of the HITS system was correct 221 times.

The ISI implementation of HITS integrates three separate elements--speech act analysis, lexical similarity, and poster trustworthiness--to create links for interpretation for individual conversation participants.

Speech act analysis classifies the statements in the record according to what they do in the context of the discussion, assigning each to one of thirteen kinds of acts, grouped in three categories: inform, request, social-interaction.

The "inform" speech act category includes corrections, descriptions, elaborations, suggestions, and answers to questions, both simple and complex. "Requests" include not just requests for information but also for action, namely commands. "Social" speech acts include acknowledgements, thanks, compliments, criticisms, objections, and supportive statements.

Lexical analysis looks for similarities in the vocabulary of responses to see which are related to each other. From this the system can determine the threads of the conversation, and decide when new subtopics are split off.

Finally, poster trustworthiness measures the degree to which participants accept statements made by each individual. This is determined by scoring responses to a given person’s posts as either negative or positive. Over time, people whose statements are more positively viewed become more central and more trusted in the online community.

To test the method, part of the data (the classification of the speech acts) was initially human coded. After it was trained, the machine system was then applied to the same data, and its performance was compared to that of the human coder. It achieved accuracy of between 65% and 70% -- a figure that is likely to improve.

How soon will it be possible to download a version that can score a given poster’s influence in his/her chat community? "This technology has considerable potential for commercialization," said Hovy.

Eric Mankin | EurekAlert!
Further information:
http://www.usc.edu

More articles from Information Technology:

nachricht Powerful IT security for the car of the future – research alliance develops new approaches
25.05.2018 | Universität Ulm

nachricht Supercomputing the emergence of material behavior
18.05.2018 | University of Texas at Austin, Texas Advanced Computing Center

All articles from Information Technology >>>

The most recent press releases about innovation >>>

Die letzten 5 Focus-News des innovations-reports im Überblick:

Im Focus: Powerful IT security for the car of the future – research alliance develops new approaches

The more electronics steer, accelerate and brake cars, the more important it is to protect them against cyber-attacks. That is why 15 partners from industry and academia will work together over the next three years on new approaches to IT security in self-driving cars. The joint project goes by the name Security For Connected, Autonomous Cars (SecForCARs) and has funding of €7.2 million from the German Federal Ministry of Education and Research. Infineon is leading the project.

Vehicles already offer diverse communication interfaces and more and more automated functions, such as distance and lane-keeping assist systems. At the same...

Im Focus: Molecular switch will facilitate the development of pioneering electro-optical devices

A research team led by physicists at the Technical University of Munich (TUM) has developed molecular nanoswitches that can be toggled between two structurally different states using an applied voltage. They can serve as the basis for a pioneering class of devices that could replace silicon-based components with organic molecules.

The development of new electronic technologies drives the incessant reduction of functional component sizes. In the context of an international collaborative...

Im Focus: LZH showcases laser material processing of tomorrow at the LASYS 2018

At the LASYS 2018, from June 5th to 7th, the Laser Zentrum Hannover e.V. (LZH) will be showcasing processes for the laser material processing of tomorrow in hall 4 at stand 4E75. With blown bomb shells the LZH will present first results of a research project on civil security.

At this year's LASYS, the LZH will exhibit light-based processes such as cutting, welding, ablation and structuring as well as additive manufacturing for...

Im Focus: Self-illuminating pixels for a new display generation

There are videos on the internet that can make one marvel at technology. For example, a smartphone is casually bent around the arm or a thin-film display is rolled in all directions and with almost every diameter. From the user's point of view, this looks fantastic. From a professional point of view, however, the question arises: Is that already possible?

At Display Week 2018, scientists from the Fraunhofer Institute for Applied Polymer Research IAP will be demonstrating today’s technological possibilities and...

Im Focus: Explanation for puzzling quantum oscillations has been found

So-called quantum many-body scars allow quantum systems to stay out of equilibrium much longer, explaining experiment | Study published in Nature Physics

Recently, researchers from Harvard and MIT succeeded in trapping a record 53 atoms and individually controlling their quantum state, realizing what is called a...

All Focus news of the innovation-report >>>

Anzeige

Anzeige

VideoLinks
Industry & Economy
Event News

In focus: Climate adapted plants

25.05.2018 | Event News

Save the date: Forum European Neuroscience – 07-11 July 2018 in Berlin, Germany

02.05.2018 | Event News

Invitation to the upcoming "Current Topics in Bioinformatics: Big Data in Genomics and Medicine"

13.04.2018 | Event News

 
Latest News

In focus: Climate adapted plants

25.05.2018 | Event News

Flow probes from the 3D printer

25.05.2018 | Machine Engineering

Less is more? Gene switch for healthy aging found

25.05.2018 | Life Sciences

VideoLinks
Science & Research
Overview of more VideoLinks >>>