Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research.

ABSTRACT: Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta-analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%-99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.

SUBMITTER: Bergmann C

PROVIDER: S-EPMC6282795 | biostudies-literature | 2018 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research.

Bergmann Christina C Tsuji Sho S Piccinini Page E PE Lewis Molly L ML Braginsky Mika M Frank Michael C MC Cristia Alejandrina A

Child development 20180507 6

Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta-analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%-99%; median = 44%); and calculating power based on seminal publications ...[more]

PMID: 29736962

Similar Datasets

Liver transplantation vs liver resection in HCC: promoting extensive collaborative research through a survival meta-analysis of meta-analyses.

Project description:BackgroundHCC is a major global health concern, necessitating effective treatment strategies. This study conducts a meta-analysis of meta-analyses comparing liver resection (LR) and liver transplantation (LT) for HCC.MethodsThe systematic review included meta-analyses comparing liver resection vs. liver transplantation in HCC, following PRISMA guidelines. Primary outcomes included 5-year overall survival (OS) and disease-free survival (DFS). AMSTAR-2 assessed study quality. Citation matrix and hierarchical clustering validated the consistency of the included studies.ResultsA search identified 10 meta-analyses for inclusion. The median Pearson correlation coefficient for citations was 0.59 (IQR 0.41-0.65). LT showed better 5-year survival and disease-free survival in all HCC (OR): 0.79; 95% CI: 0.67-0.93, I^2:57% and OR: 0.44; 95% CI: 0.25-0.75, I^2:96%). Five-year survival in early HCC and ITT was 0.63 (95% CI: 0.50-0.78, I^2:0%) and 0.60 (95% CI: 0.39-0.92, I^2:0%). Salvage LT vs. Primary LT did not differ between 5-year survival and disease-free survival (OR: 0.62; 95% CI: 0.33-1.15, I^2:0% and 0.93; 95% CI: 0.82-1.04, I^2:0%).ConclusionOverall, the study underscores the superior survival outcomes associated with LT over LR in HCC treatment, supported by comprehensive meta-analysis and clustering analysis. There was no difference in survival or recurrence rate between salvage LT and primary LT. Therefore, considering the organ shortage, HCC can be resected and transplanted in case of recurrence.

| S-EPMC10986178 | biostudies-literature

Spread the Word: Enhancing Replicability of Speech Research Through Stimulus Sharing.

Project description:PurposeThe ongoing replication crisis within and beyond psychology has revealed the numerous ways in which flexibility in the research process can affect study outcomes. In speech research, examples of these "researcher degrees of freedom" include the particular syllables, words, or sentences presented; the talkers who produce the stimuli and the instructions given to them; the population tested; whether and how stimuli are matched on amplitude; the type of masking noise used and its presentation level; and many others. In this research note, we argue that even seemingly minor methodological choices have the potential to affect study outcomes. To that end, we present a reanalysis of six existing data sets on spoken word identification in noise to assess how differences in talkers, stimulus processing, masking type, and listeners affect identification accuracy.ConclusionsOur reanalysis revealed relatively low correlations among word identification rates across studies. The data suggest that some of the seemingly innocuous methodological details that differ across studies-details that cannot possibly be reported in text given the idiosyncrasies inherent to speech-introduce unknown variability that may affect replicability of our findings. We therefore argue that publicly sharing stimuli is a crucial step toward improved replicability in speech research.Supplemental materialhttps://doi.org/10.23641/asha.21985907.

| S-EPMC10465150 | biostudies-literature

The relation between language and arithmetic in bilinguals: insights from different stages of language acquisition.

Project description:Solving arithmetic problems is a cognitive task that heavily relies on language processing. One might thus wonder whether this language-reliance leads to qualitative differences (e.g., greater difficulties, error types, etc.) in arithmetic for bilingual individuals who frequently have to solve arithmetic problems in more than one language. The present study investigated how proficiency in two languages interacts with arithmetic problem solving throughout language acquisition in adolescents and young adults. Additionally, we examined whether the number word structure that is specific to a given language plays a role in number processing over and above bilingual proficiency. We addressed these issues in a German-French educational bilingual setting, where there is a progressive transition from German to French as teaching language. Importantly, German and French number naming structures differ clearly, as two-digit number names follow a unit-ten order in German, but a ten-unit order in French. We implemented a transversal developmental design in which bilingual pupils from grades 7, 8, 10, 11, and young adults were asked to solve simple and complex additions in both languages. The results confirmed that language proficiency is crucial especially for complex addition computation. Simple additions in contrast can be retrieved equally well in both languages after extended language practice. Additional analyses revealed that over and above language proficiency, language-specific number word structures (e.g., unit-ten vs. ten-unit) also induced significant modulations of bilinguals' arithmetic performances. Taken together, these findings support the view of a strong relation between language and arithmetic in bilinguals.

| S-EPMC4357777 | biostudies-literature

Learning abstract words and concepts: insights from developmental language disorder.

Project description:Some explanations of abstract word learning suggest that these words are learnt primarily from the linguistic input, using statistical co-occurrences of words in language, whereas concrete words can also rely on non-linguistic, experiential information. According to this hypothesis, we expect that, if the learner is not able to fully exploit the information in the linguistic input, abstract words should be affected more than concrete ones. Embodied approaches instead argue that both abstract and concrete words can rely on experiential information and, therefore, there might not be any linguistic primacy. Here, we test the role of linguistic input in the development of abstract knowledge with children with developmental language disorder (DLD) and typically developing children aged 8-13. We show that DLD children, who by definition have impoverished language, do not show a disproportionate impairment for abstract words in lexical decision and definition tasks. These results indicate that linguistic information does not have a primary role in the learning of abstract concepts and words; rather, it would play a significant role in semantic development across all domains of knowledge.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

| S-EPMC6015818 | biostudies-literature

Effect of language therapy alone for developmental language disorder in children: A meta-analysis

Project description:Despite numerous studies on the treatment of developmental language disorder (DLD), the intervention effect has long been debated. Systematic reviews of the effect of language therapy alone are rare. This evidence-based study investigated the effect of language therapy alone for different expressive and receptive language levels in children with DLD. Publications in databases including PubMed, the Cochrane Library, the Wanfang Database and the China National Knowledge Infrastructure were searched. Randomized controlled trials were selected. The methodological quality of the included trials was assessed using the modified Jadad method. RevMan 5.3 software was used for the data analysis. Fifteen trials were included in this study. Compared with the control (no or delayed intervention) group, the intervention group showed significant differences in overall expressive language development [standard mean differences (SMD), 0.46; 95% confidence interval (CI), 0.12–0.80], mean length of utterances in a language sample (SMD, 2.16; 95% CI, 0.39–3.93), number of utterances in a language sample (SMD, 0.52; 95% CI, 0.21–0.84), parent reports of expressive phrase complexity (SMD, 1.24; 95% CI, 0.78–1.70), overall expressive vocabulary development (SMD, 0.43; 95% CI, 0.17–0.69) and different words used in a language sample (SMD, 0.62; 95% CI, 0.35–0.88). However, language therapy did not show satisfactory long-term effects on DLD. Although language therapy is helpful in improving the performance of children with DLD, its long-term effect is unsatisfactory.

| S-EPMC9574219 | biostudies-literature

Meta-analysis of variation suggests that embracing variability improves both replicability and generalizability in preclinical research.

Project description:The replicability of research results has been a cause of increasing concern to the scientific community. The long-held belief that experimental standardization begets replicability has also been recently challenged, with the observation that the reduction of variability within studies can lead to idiosyncratic, lab-specific results that cannot be replicated. An alternative approach is to, instead, deliberately introduce heterogeneity, known as "heterogenization" of experimental design. Here, we explore a novel perspective in the heterogenization program in a meta-analysis of variability in observed phenotypic outcomes in both control and experimental animal models of ischemic stroke. First, by quantifying interindividual variability across control groups, we illustrate that the amount of heterogeneity in disease state (infarct volume) differs according to methodological approach, for example, in disease induction methods and disease models. We argue that such methods may improve replicability by creating diverse and representative distribution of baseline disease state in the reference group, against which treatment efficacy is assessed. Second, we illustrate how meta-analysis can be used to simultaneously assess efficacy and stability (i.e., mean effect and among-individual variability). We identify treatments that have efficacy and are generalizable to the population level (i.e., low interindividual variability), as well as those where there is high interindividual variability in response; for these, latter treatments translation to a clinical setting may require nuance. We argue that by embracing rather than seeking to minimize variability in phenotypic outcomes, we can motivate the shift toward heterogenization and improve both the replicability and generalizability of preclinical research.

| S-EPMC8168858 | biostudies-literature

Mapping the research trends of third language acquisition: A bibliometric analysis based on Scopus.

Project description:L3 acquisition is gaining prominence in the academic community. The cardinal aim of this study is to conduct a bibliometric analysis of research on L3 acquisition. 425 documents from the Scopus database were analyzed with Bibliometrix. To gain a general and systematic overview of research on L3 acquisition, we grounded our study on three main levels of bibliometric analysis: performance analysis, collaboration analysis, and thematic map. By doing so, we identified the most influential sources, authors, affiliations, countries, and documents, the scientific network among different constituents, as well as the evolution of research trends. The results suggest that L3 acquisition has experienced three periods: initial phase (1984-2008), development phase (2009-2014), and burst phase (2015-2022). The results also indicate that: (1) The International Journal of Multilingualism is the most steady source contributing to this field. (2) Relevant contributors for each period are recognized, including established and emerging researchers. (3) European countries such as Spain, United Kingdom, Norway, Sweden, and Poland are at the forefront of publication. (4) Collaboration increases over time but is becoming increasingly oriented in European and Anglophone countries. (5) The research hotspots have shifted throughout time, encompass a broad range of fields, and continue to grow. The study results provide insights into the evolving trends of L3 acquisition studies and data to assist researchers in identifying research gaps.

| S-EPMC9670133 | biostudies-literature

Short-Term Memory for Serial Order Moderates Aspects of Language Acquisition in Children With Developmental Language Disorder: Findings From the HelSLI Study.

Project description:Previous studies of verbal short-term memory (STM) indicate that STM for serial order may be linked to language development and developmental language disorder (DLD). To clarify whether a domain-general mechanism is impaired in DLD, we studied the relations between age, non-verbal serial STM, and language competence (expressive language, receptive language, and language reasoning). We hypothesized that non-verbal serial STM differences between groups of children with DLD and typically developing (TD) children are linked to their language acquisition differences. Fifty-one children with DLD and sixty-six TD children participated as part of the HelSLI project in this cross-sectional study. The children were 4-6-year-old monolingual native Finnish speakers. They completed several tests of language and cognitive functioning, as well as new game-like tests of visual and auditory non-verbal serial STM. We used regression analyses to examine how serial STM moderates the effect of age on language. A non-verbal composite measure of serial visual and auditory STM moderated cross-sectional development of receptive language in the children with DLD. This moderation was not observed in the TD children. However, we found more rapid cross-sectional development of non-verbal serial STM in the TD children than in the children with DLD. The results suggest that children with DLD may be more likely to have compromised general serial STM processing and that superior non-verbal serial STM may be associated with better language acquisition in children with DLD.

| S-EPMC8096175 | biostudies-literature

Questionable research practices may have little effect on replicability.

Project description:This article examines why many studies fail to replicate statistically significant published results. We address this issue within a general statistical framework that also allows us to include various questionable research practices (QRPs) that are thought to reduce replicability. The analyses indicate that the base rate of true effects is the major factor that determines the replication rate of scientific results. Specifically, for purely statistical reasons, replicability is low in research domains where true effects are rare (e.g., search for effective drugs in pharmacology). This point is under-appreciated in current scientific and media discussions of replicability, which often attribute poor replicability mainly to QRPs.

| S-EPMC7561355 | biostudies-literature

Ignoring non-English-language studies may bias ecological meta-analyses.

Project description:Meta-analysis plays a crucial role in syntheses of quantitative evidence in ecology and biodiversity conservation. The reliability of estimates in meta-analyses strongly depends on unbiased sampling of primary studies. Although earlier studies have explored potential biases in ecological meta-analyses, biases in reported statistical results and associated study characteristics published in different languages have never been tested in environmental sciences. We address this knowledge gap by systematically searching published meta-analyses and comparing effect-size estimates between English- and Japanese-language studies included in existing meta-analyses. Of the 40 published ecological meta-analysis articles authored by those affiliated to Japanese institutions, we find that three meta-analysis articles searched for studies in the two languages and involved sufficient numbers of English- and Japanese-language studies, resulting in four eligible meta-analyses (i.e., four meta-analyses conducted in the three meta-analysis articles). In two of the four, effect sizes differ significantly between the English- and Japanese-language studies included in the meta-analyses, causing considerable changes in overall mean effect sizes and even their direction when Japanese-language studies are excluded. The observed differences in effect sizes are likely attributable to systematic differences in reported statistical results and associated study characteristics, particularly taxa and ecosystems, between English- and Japanese-language studies. Despite being based on a small sample size, our findings suggest that ignoring non-English-language studies may bias outcomes of ecological meta-analyses, due to systematic differences in study characteristics and effect-size estimates between English- and non-English languages. We provide a list of actions that meta-analysts could take in the future to reduce the risk of language bias.

| S-EPMC7381574 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data