Table 2 RMSE values for all filtering scenarios for LD-based analysis in NeEstimator under a stable population (λ = 1.0)
From: Estimation of contemporary effective population size and population declines using RAD sequence data
LD RAD mutation | 10% missing data | 50% missing data | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
(&P crit level) | (&P crit level) | (&P crit level) | ||||||||
0.01 | 0.02 | 0.05 | 0.01 | 0.02 | 0.05 | 0.01 | 0.02 | 0.05 | ||
N = 250 | n = 15 | 2.73E−03 | 2.73E−03 | 2.95E−03 | 3.41E−03 | 3.41E−03 | 2.73E−03 | 3.68E−03 | 3.68E−03 | 2.70E−03 |
n = 30 | 1.41E−03 | 1.10E−03 | 1.25E−03 | 1.55E−03 | 1.11E−03 | 1.18E−03 | 1.532E−03 | 1.11E−03 | 1.23E−03 | |
n = 60 | 6.88E−04 | 6.17E−04 | 6.10E−04 | 1.55E−03 | 1.11E−03 | 1.18E−03 | 1.53E−03 | 1.11E−03 | 1.23E−03 | |
N = 500 | n = 15 | Inf. | Inf. | 1.60E−03 | Inf. | Inf. | 1.54E−03 | Inf. | Inf. | 1.62E−03 |
n = 30 | 9.65E−04 | 7.98E−04 | 8.41E−04 | 1.16E−03 | 7.79E−04 | 8.06E−04 | 1.16E−03 | 7.79E−04 | 8.15E−04 | |
n = 60 | 4.59E−04 | 4.63E−04 | 4.40E−04 | 4.99E−04 | 4.56E−04 | 4.54E−04 | 5.02E−04 | 4.47E−04 | 4.43E−04 | |
N = 1000 | n = 15 | Inf. | Inf. | 1.99E−03 | Inf. | Inf. | 1.84E− 03 | Inf. | Inf. | 1.87E−03 |
n = 30 | 6.65E−04 | 7.76E−04 | 8.90E−04 | 8.03E−04 | 7.44E−04 | 7.87E−04 | 8.23E−04 | 7.32E−04 | 8.14E−04 | |
n = 60 | 3.01E−04 | 3.14E−04 | 3.04E−04 | 8.03E−04 | 7.44E−04 | 7.87E−04 | 8.23E−04 | 7.32E−04 | 8.14E−04 | |
