In this posting, similar to this previous analysis (over just 70 sims), I use our spectral-based analysis framework to arrive at parameter
constraints derived from the DC 01.xx sim-sets, and compare the results to the
CMB-S4 science book contraints (which were based on scaling the BICEP/Keck
covariance matrix), as well as a new Fisher calculation which uses a BPCM derived from the DC 01.xx sims.
Notes on the method:
Differences from the previous analysis:
mean(sim):
The green line corresponds to the model expectation values calculated
according to the fiducial theory model used for the CMB-S4 Sciencebook
forecasts (and in Data Challenge 01.xx). This model includes dust, sync,
and lensed-CMB, as described on the Data Challenges page, and this forecasting posting.
The blue line corresponds to the mean of the signal + noise sims.
var(simd):
The green line shows variances obtained from the fiducial model BPCM
(which is formed from A_L=1 + noise sims, and then scaled to the
appropriate theory model). The blue line shows variances calculated
directly from the signal + noise sims.
mean(noi):
The green line shows the input baseline \(N_l\) levels as presented in this posting and
as used for the CMB-S4 forecasting. The blue line shows the mean of the
noise-only simulations.
Note: As we can see, while the noise sims
are what is described on the Data Challenge page, the blue line is
somewhat higher than the green. This comes from the weight mask. The
uniform depth region at the center of the field has noise that exactly
matches the \(N_l\) from the posting above, but the noise increases near
the edge of the field. This does mean that the net \(N_l\) is higher than
the model, but how much higher will depend on the weight mask that one
uses. This will not have a biasing effect on our parameters, since in the
analysis the \(N_l\)'s are calculated directly from the sims, but
it will have a net parameter constraint degradation since the sims have
a higher level of noise.
ML hist (9 bins/5 bins):
The blue histograms are the recovered ML values with the red line
marking the recovered mean, and the black line marking the input model
values. Constraints on all the parameters, as well as the recovered
means, are summarized in their respective legends.
Note on the mean of the \(r_{ML}\) distributions: Compared to the previous analysis (over just 70 sims), the biases appear to have gotten larger for \(A_L=0.1\) or larger. This is a bit puzzling, since there should be only a difference in technique. If I compare the recovered ML peaks for r for the first 70 realizations (for the \(A_L=1.0\) case) between the current analysis and the previous one, I see the following histogram.
Note on the width of the \(r_{ML}\)distributions: The results of the pager above are summarized in the table below under the DC01.00 column. As mentioned, I compare the results to the CMB-S4 science book contraints, based on scaling the BICEP/Keck covariance matrix (under the Fisher, BK scaled column), and perform a new Fisher calculation which uses a BPCM derived from the DC 01.00 sims (Fisher, DC 01.00). In addition to this, I also add the values obtained from the previous analysis (over just 70 sims). We expect the DC 01.00 constraints to be more optimistic than the Science Book results due to idealized nature of the simulations, but we expect good agreement between the DC 01.00 contraints and Fisher DC 01.00 up to sample variance (we have 1000 sims, thus \(\sqrt{2/1000}\sigma=0.045 \sigma\)).
\(f_{sky}=0.03\) | Fisher (BK scaled) | DC 01.00 (#70) | Fisher (DC 01.00, #70) | DC 01.00 | Fisher (DC 01.00) | DC 01.01 |
---|---|---|---|---|---|---|
\(\sigma_r(r=0, A_L=1.00), \times 10^{-3}\) | 3.82 | 2.61 | 2.63 | 2.75 | 2.41 | 2.73 |
\(\sigma_r(r=0, A_L=0.30), \times 10^{-3}\) | --- | 1.13 | 1.03 | 1.12 | 1.01 | 1.12 |
\(\sigma_r(r=0, A_L=0.10), \times 10^{-3}\) | 0.91 | 0.67 | 0.56 | 0.62 | 0.59 | 0.62 |
\(\sigma_r(r=0, A_L=0.03), \times 10^{-3}\) | --- | 0.46 | 0.38 | 0.44 | 0.44 | 0.47 |