Dataset Information

How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data.

ABSTRACT: This paper reviews the literature in historical record linkage in the U.S. and examines the performance of widely-used record linking algorithms and common variations in their assumptions. We use two high-quality, hand-linked datasets and one synthetic ground truth to examine the direct effects of linking algorithms on data quality. We find that (1) no algorithm (including hand-linking) consistently produces representative samples; (2) 15 to 37 percent of links chosen by widely-used algorithms are classified as errors by trained human reviewers; and (3) false links are systematically related to baseline sample characteristics, showing that some algorithms may induce systematic measurement error into analyses. A case study shows that the combined effects of (1)-(3) attenuate estimates of the intergenerational income elasticity by up to 20 percent, and common variations in algorithm assumptions result in greater attenuation. As current practice moves to automate linking and increase link rates, these results highlight the important potential consequences of linking errors on inferences with linked data. We conclude with constructive suggestions for reducing linking errors and directions for future research.

SUBMITTER: Bailey M

PROVIDER: S-EPMC8294155 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data.

Bailey Martha M Cole Connor C Henderson Morgan M Massey Catherine C

Journal of economic literature 20201201 4

This paper reviews the literature in historical record linkage in the U.S. and examines the performance of widely-used record linking algorithms and common variations in their assumptions. We use two high-quality, hand-linked datasets and one synthetic ground truth to examine the direct effects of linking algorithms on data quality. We find that (1) no algorithm (including hand-linking) consistently produces representative samples; (2) 15 to 37 percent of links chosen by widely-used algorithms a ...[more]

PMID: 34294947

Similar Datasets

Project description:BackgroundThe movement of animals is strongly influenced by external factors in their surrounding environment such as weather, habitat types, and human land use. With advances in positioning and sensor technologies, it is now possible to capture animal locations at high spatial and temporal granularities. Likewise, scientists have an increasing access to large volumes of environmental data. Environmental data are heterogeneous in source and format, and are usually obtained at different spatiotemporal scales than movement data. Indeed, there remain scientific and technical challenges in developing linkages between the growing collections of animal movement data and the large repositories of heterogeneous remote sensing observations, as well as in the developments of new statistical and computational methods for the analysis of movement in its environmental context. These challenges include retrieval, indexing, efficient storage, data integration, and analytical techniques.ResultsThis paper contributes to movement ecology research by presenting a new publicly available system, Environmental-Data Automated Track Annotation (Env-DATA), that automates annotation of movement trajectories with ambient atmospheric observations and underlying landscape information. Env-DATA provides a free and easy-to-use platform that eliminates technical difficulties of the annotation processes and relieves end users of a ton of tedious and time-consuming tasks associated with annotation, including data acquisition, data transformation and integration, resampling, and interpolation. The system is illustrated with a case study of Galapagos Albatross (Phoebastria irrorata) tracks and their relationship to wind, ocean productivity and chlorophyll concentration. Our case study illustrates why adult albatrosses make long-range trips to preferred, productive areas and how wind assistance facilitates their return flights while their outbound flights are hampered by head winds.ConclusionsThe new Env-DATA system enhances Movebank, an open portal of animal tracking data, by automating access to environmental variables from global remote sensing, weather, and ecosystem products from open web resources. The system provides several interpolation methods from the native grid resolution and structure to a global regular grid linked with the movement tracks in space and time. The aim is to facilitate new understanding and predictive capabilities of spatiotemporal patterns of animal movement in response to dynamic and changing environments from local to global scales.

Project description:Highly mobile species, such as migratory birds, respond to seasonal and interannual variability in resource availability by moving to better habitats. Despite the recognized importance of resource thresholds, species-distribution models typically rely on long-term average habitat conditions, mostly because large-extent, temporally resolved, environmental data are difficult to obtain. Recent advances in remote sensing make it possible to incorporate more frequent measurements of changing landscapes; however, there is often a cost in terms of model building and processing and the added value of such efforts is unknown. Our study tests whether incorporating real-time environmental data increases the predictive ability of distribution models, relative to using long-term average data. We developed and compared distribution models for shorebirds in California's Central Valley based on high temporal resolution (every 16 days), and 17-year long-term average surface water data. Using abundance-weighted boosted regression trees, we modeled monthly shorebird occurrence as a function of surface water availability, crop type, wetland type, road density, temperature, and bird data source. Although modeling with both real-time and long-term average data provided good fit to withheld validation data (the area under the receiver operating characteristic curve, or AUC, averaged between 0.79 and 0.89 for all taxa), there were small differences in model performance. The best models incorporated long-term average conditions and spatial pattern information for real-time flooding (e.g., perimeter-area ratio of real-time water bodies). There was not a substantial difference in the performance of real-time and long-term average data models within time periods when real-time surface water differed substantially from the long-term average (specifically during drought years 2013-2016) and in intermittently flooded months or locations. Spatial predictions resulting from the models differed most in the southern region of the study area where there is lower water availability, fewer birds, and lower sampling density. Prediction uncertainty in the southern region of the study area highlights the need for increased sampling in this area. Because both sets of data performed similarly, the choice of which data to use may depend on the management context. Real-time data may ultimately be best for guiding dynamic, adaptive conservation actions, whereas models based on long-term averages may be more helpful for guiding permanent wetland protection and restoration.

Dataset Information

How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data.

Publications

How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets