Taking a cue from the world of business-performance experts and baseball talent scouts, Penn Medicine translational medicine researchers are among the first to find a way to measure the productivity of collaborations in a young, emerging institute. They published their findings the most recent issue of Science Translational Medicine.
While metrics exist to measure the contributions of individual scientists, judging the effectiveness of team science has been more challenging. Reasoning that team science produces papers and grants, first author postdoctoral fellow Michael Hughes, PhD, (now at Yale University) and colleagues measured these endpoints and analyzed them over time using network analysis, which examines a social structure made up of individuals connected by a common interdependency.
Using the numbers of publications and grants as their raw data, researchers from Penn's Institute for Translational Medicine and Therapeutics (ITMAT) measured how their productivity changed with increasing collaborations over the last five years.
"We're applying quantitative methods to evaluate the collaborative nature of academic science and medicine," says senior author John Hogenesch, PhD, associate professor of Pharmacology in the University of Pennsylvania School of Medicine. Hogenesch is also an ITMAT member and interim director of the Penn Center for Bioinformatics.
They found that the number of collaborative papers for ITMAT members doubled since 2006. They also found that researchers were more likely to collaborate within their own departments and institutions than between them. "While understandable, if the purpose of an institute is to facilitate cross-disciplinary interactions, then encouraging people to collaborate across departments and institutes is critical," says Hogenesch.
The authors concluded that studies such as these could help inform decisions about which institutes, centers, or departments are most likely to facilitate collaboration, and learn how they're doing it. This will point the way to ideas to increase cross-discipline collaborations such as trans-center grants to facilitate collaborations between departments.
"The most challenging aspect of the study was acquiring the data. At this point, we've analyzed PubMed and research grants and only for ITMAT. Ideally, we would be able to compare these metrics to those from other similar institutes including more data sources. Also, as time goes by, having downstream measures of this productivity such as literature citations and investigational new drug applications will point the way towards learning the operational rules of translational science," says Hogenesch.
Inspired by America's Pastime
First author Hughes is a baseball fan, and he realized that professional baseball has kept detailed statistics on the outcomes of every at-bat in every game for the last 100-plus years. These data provide a wealth of information to quantitatively address the traits that predict a successful baseball career, and the types and combinations of players needed to win games. By quantitatively and objectively studying performance, baseball analysts have been able to identify and exploit inefficiencies in the labor market -- highly skilled players were sometimes under-valued because of widely-held, but incorrect, assumptions. "If they're measuring performance quantitatively in baseball, shouldn't we do the same for science?," asks Hughes.
But how do investigators evaluate their performance quantitatively -- especially the scientific output of an institution comprising hundreds of active researchers, let alone comparing performance among centers and institutes with similar missions at different universities. Using ITMAT's roster of members over time, the team used network dynamics as a first step towards measuring scientific performance of cross-disciplinary institutes and centers.
ITMAT was founded in 2004 as the world's first translational medicine institute, and as of January 2009, included over 500 active investigators spanning four institutions and dozens of academic departments. "We reasoned that ITMAT's productivity could be partly measured by how it facilitates collaborations between its members," says Hogenesch.
To collect data, the team generated special data-mining programs to automatically extract publication information from PubMed. In addition, they analyzed grant proposals submitted by ITMAT faculty during the last five years and additional data from NIH Reporter. From this they quantified the number of papers and grants by ITMAT investigators over time, and how these collaborative interactions changed over time.
ITMAT's overall size and complexity grew significantly since its inception. Not only has the total number of investigators actively collaborating within ITMAT increased during this time, the average investigator has been collaborating more.
"This finding was not surprising since as the size of the network grows, the probability that two investigators would interact to co-publish papers or co-submit grants grows," explains Hogenesch. "In network-speak, the number of edges – co-published papers and grants - per node – two or more investigators - grew nearly twice as fast during the past five years, as the growth of ITMAT's membership has grown, suggesting that ITMAT's expansion increased the number of collaborations. What's more, the percentage of ITMAT investigators actively collaborating within ITMAT grew every year, with nearly two-thirds actively engaged in collaborations in 2009."
This work was supported by ITMAT through a grant from the National Center for Research Resources. John Peeler, MA, was also an author on the paper.
Penn Medicine is one of the world's leading academic medical centers, dedicated to the related missions of medical education, biomedical research, and excellence in patient care. Penn Medicine consists of the University of Pennsylvania School of Medicine (founded in 1765 as the nation's first medical school) and the University of Pennsylvania Health System, which together form a $3.6 billion enterprise.
Penn's School of Medicine is currently ranked #2 in U.S. News & World Report's survey of research-oriented medical schools, and is consistently among the nation's top recipients of funding from the National Institutes of Health, with $367.2 million awarded in the 2008 fiscal year.
Penn Medicine's patient care facilities include:
The Hospital of the University of Pennsylvania – the nation's first teaching hospital, recognized as one of the nation's top 10 hospitals by U.S. News & World Report.
Penn Presbyterian Medical Center – named one of the top 100 hospitals for cardiovascular care by Thomson Reuters for six years.
Pennsylvania Hospital – the nation's first hospital, founded in 1751, nationally recognized for excellence in orthopaedics, obstetrics & gynecology, and psychiatry & behavioral health.
Additional patient care facilities and services include Penn Medicine at Rittenhouse, a Philadelphia campus offering inpatient rehabilitation and outpatient care in many specialties; as well as a primary care provider network; a faculty practice plan; home care and hospice services; and several multispecialty outpatient facilities across the Philadelphia region.
Penn Medicine is committed to improving lives and health through a variety of community-based programs and activities. In fiscal year 2009, Penn Medicine provided $733.5 million to benefit our community.
Karen Kreeger | EurekAlert!
The personality factor: How to foster the sharing of research data
06.09.2017 | ZBW – Leibniz-Informationszentrum Wirtschaft
Europe’s Demographic Future. Where the Regions Are Heading after a Decade of Crises
10.08.2017 | Berlin-Institut für Bevölkerung und Entwicklung
At the productronica trade fair in Munich this November, the Fraunhofer Institute for Laser Technology ILT will be presenting Laser-Based Tape-Automated Bonding, LaserTAB for short. The experts from Aachen will be demonstrating how new battery cells and power electronics can be micro-welded more efficiently and precisely than ever before thanks to new optics and robot support.
Fraunhofer ILT from Aachen relies on a clever combination of robotics and a laser scanner with new optics as well as process monitoring, which it has developed...
Plants and algae use the enzyme Rubisco to fix carbon dioxide, removing it from the atmosphere and converting it into biomass. Algae have figured out a way to increase the efficiency of carbon fixation. They gather most of their Rubisco into a ball-shaped microcompartment called the pyrenoid, which they flood with a high local concentration of carbon dioxide. A team of scientists at Princeton University, the Carnegie Institution for Science, Stanford University and the Max Plank Institute of Biochemistry have unravelled the mysteries of how the pyrenoid is assembled. These insights can help to engineer crops that remove more carbon dioxide from the atmosphere while producing more food.
A warming planet
Our brains house extremely complex neuronal circuits, whose detailed structures are still largely unknown. This is especially true for the so-called cerebral cortex of mammals, where among other things vision, thoughts or spatial orientation are being computed. Here the rules by which nerve cells are connected to each other are only partly understood. A team of scientists around Moritz Helmstaedter at the Frankfiurt Max Planck Institute for Brain Research and Helene Schmidt (Humboldt University in Berlin) have now discovered a surprisingly precise nerve cell connectivity pattern in the part of the cerebral cortex that is responsible for orienting the individual animal or human in space.
The researchers report online in Nature (Schmidt et al., 2017. Axonal synapse sorting in medial entorhinal cortex, DOI: 10.1038/nature24005) that synapses in...
Whispering gallery mode (WGM) resonators are used to make tiny micro-lasers, sensors, switches, routers and other devices. These tiny structures rely on a...
Using ultrafast flashes of laser and x-ray radiation, scientists at the Max Planck Institute of Quantum Optics (Garching, Germany) took snapshots of the briefest electron motion inside a solid material to date. The electron motion lasted only 750 billionths of the billionth of a second before it fainted, setting a new record of human capability to capture ultrafast processes inside solids!
When x-rays shine onto solid materials or large molecules, an electron is pushed away from its original place near the nucleus of the atom, leaving a hole...
19.09.2017 | Event News
12.09.2017 | Event News
06.09.2017 | Event News
25.09.2017 | Power and Electrical Engineering
25.09.2017 | Health and Medicine
25.09.2017 | Physics and Astronomy