Patient records that are to be shared within the research community must have any identifying information removed. Manual removal of identifying information is prohibitively expensive and time consuming. Considerable research by many investigators has focussed on developing automated techniques for “de-identifying” medical records.
A team from the Massachusetts Institute of Technology (MIT) funded by the National Institutes of Health (NIH) aimed to solve this problem, pointing out that: “Text-based patient medical records are a vital resource in research. The expense of manual de-identification, coupled with the fact that it is time-consuming and prone to error, necessitates automatic methods for large-scale de-identification.”
The MIT team tested their censoring software on a meticulously hand-annotated database of 1836 nursing notes (a total of 296,400 words). According to the authors, “The software successfully deleted more than 94% of the confidential information, while wrongly deleting only 0.2% of the useful content. This is significantly better than one expert working alone, at least as good as two trained medical professionals checking each other’s work and many, many times faster than either.”
The MIT team is also providing access to the fully-scrubbed annotated data together with the software to allow others to improve their systems, and to allow the software to be adapted to other data types that may exhibit different qualities.
Graeme Baldwin | Source: alphagalileo
Further information: www.biomedcentral.com
More articles from Information Technology:
NIST Test Proves ‘The Eyes Have It’ for ID Verification
06.11.2009 | National Institute of Standards and Technology (NIST)
New Celestial Map Gives Directions for GPS
02.11.2009 | NASA/Goddard Space Flight Center
Airborne nitrogen shifts aquatic nutrient limitation in pristine lakes
06.11.2009 | Studies and Analyses
Genome sequence for the domestic horse to be unveiled
06.11.2009 | Life Sciences
06.11.2009 | Earth Sciences
Texas Tech University Hosts Major Textile Conference in India
06.11.2009 | Event News
Brief Highlights of the Fluid Dynamics Conference, Minneapolis
30.10.2009 | Event News
EUROSAFE Forum 2009 Brussels: "Safety Implications of an Increased Demand for Nuclear Energy"
29.10.2009 | Event News