Patient records that are to be shared within the research community must have any identifying information removed. Manual removal of identifying information is prohibitively expensive and time consuming. Considerable research by many investigators has focussed on developing automated techniques for “de-identifying” medical records.
A team from the Massachusetts Institute of Technology (MIT) funded by the National Institutes of Health (NIH) aimed to solve this problem, pointing out that: “Text-based patient medical records are a vital resource in research. The expense of manual de-identification, coupled with the fact that it is time-consuming and prone to error, necessitates automatic methods for large-scale de-identification.”
The MIT team tested their censoring software on a meticulously hand-annotated database of 1836 nursing notes (a total of 296,400 words). According to the authors, “The software successfully deleted more than 94% of the confidential information, while wrongly deleting only 0.2% of the useful content. This is significantly better than one expert working alone, at least as good as two trained medical professionals checking each other’s work and many, many times faster than either.”
The MIT team is also providing access to the fully-scrubbed annotated data together with the software to allow others to improve their systems, and to allow the software to be adapted to other data types that may exhibit different qualities.
Graeme Baldwin | Source: alphagalileo
Further information: www.biomedcentral.com
More articles from Information Technology:
Siemens develops a video solution to uncover leaks in an industrial environment
20.11.2009 | Siemens AG
‘Fingerprinting’ RFID Tags: Researchers Develop Anti-Counterfeiting Technology
20.11.2009 | University of Arkansas, Fayetteville
Scientists Unravel Evolution of Highly Toxic Box Jellyfish
20.11.2009 | Life Sciences
When good companies do bad things: Examining illegal corporate behavior
20.11.2009 | Business and Finance
UCR plant scientist's research spawns new discoveries showing how crops survive drought
20.11.2009 | Agricultural and Forestry Science
Multidisciplinary meeting on Urological Cancers aims to benefit cancer patients
20.11.2009 | Event News
'Golden Age' for clinical psychology in Northern Ireland
20.11.2009 | Event News
New Perspectives in Marine Anti-Fouling Research
11.11.2009 | Event News