Premium
The empirical Bayes estimators of fine‐scale population structure in high gene flow species
Author(s) -
Kitada Shuichi,
Nakamichi Reiichiro,
Kishino Hirohisa
Publication year - 2017
Publication title -
molecular ecology resources
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.96
H-Index - 136
eISSN - 1755-0998
pISSN - 1755-098X
DOI - 10.1111/1755-0998.12663
Subject(s) - estimator , biology , coalescent theory , population , gene flow , statistics , bayes' theorem , genetics , mathematics , genetic variation , gene , bayesian probability , demography , sociology , phylogenetic tree
An empirical Bayes (EB) pairwise F ST estimator was previously introduced and evaluated for its performance by numerical simulation. In this study, we conducted coalescent simulations and generated genetic population structure mechanistically, and compared the performance of the EB F ST with Nei's G ST , Nei and Chesser's bias‐corrected G ST ( G ST_NC ), Weir and Cockerham's θ ( θ WC ) and θ with finite sample correction ( θ WC_F ). We also introduced EB estimators for Hedrick’ G ’ ST and Jost’ D . We applied these estimators to publicly available SNP genotypes of Atlantic herring. We also examined the power to detect the environmental factors causing the population structure. Our coalescent simulations revealed that the finite sample correction of θ WC is necessary to assess population structure using pairwise F ST values. For microsatellite markers, EB F ST performed the best among the present estimators regarding both bias and precision under high gene flow scenarios ( F ST ≤ 0.032 ). For 300 SNPs, EB F ST had the highest precision in all cases, but the bias was negative and greater than those for G ST_NC and θ WC_F in all cases. G ST_NC and θ WC_F performed very similarly at all levels of F ST . As the number of loci increased up to 10 000, the precision of G ST_NC and θ WC_F became slightly better than for EB F ST for cases withF ST ≥ 0.004 , even though the size of the bias remained constant. The EB estimators described the fine‐scale population structure of the herring and revealed that ~56% of the genetic differentiation was caused by sea surface temperature and salinity. The R package finepop for implementing all estimators used here is available on CRAN.