Maximum likelihood search results for Data Challenge 04b and 04c, model 00 and 07

  B. Racine

First look at the 04b and 04c Data Challenges, that use nominal Chile (b) and Pole (c) masks. We report results for model 00 and 07.
We are using proper bandpass conventions, as explained in this posting, section 3, and a new log-likelihood cut as explained in this posting, section 2.


Introduction

This posting summarizes results from analysis of CMB-S4 Data Challenge 04b and 04c using a BICEP/Keck-style parametrized foreground model. It is analogous to this previous posting, which reports DC4 results for model 00 to 06, where we introduced a method to flag flawed simulations and used fixed bandpass conventions.

In the current posting, we analyse simulations with nominal Chile (DC04b) and Pole (DC04c) masks, as described here, which we compare to the previous circular idealized f_sky 3% mask from the CDT report (DC04). More information can be found in the Experiment Definition page.
For now we only have 300 simulations using Gaussian foregrounds (model 00) for the new masks. Since we are here studying the effect of variations of the sky coverage, it is important to keep in mind that these simulations are uniform over the sky.
A new set of 300 simulations has been produced for model 07, that incorporates a data driven variation of the dust amplitude over the sky (see here).

In section 1, we show the main results concerning the "r" results.
In section 2, we show the ML parameters' distributions, including foreground parameters, as histograms or as "triangle plots".
In section 3, we report tables of r constraints for different sky models, masks, lensing residuals, and with and without decorrelation in the ML search.

Note about the Model:
In this analysis, for each realization, we find the set of model parameters that maximizes the likelihood multiplied by priors on the dust and sync spectral index parameters (\(\beta_d\) and \(\beta_s\)). These priors are based on Planck data, so they are quite weak in comparison with CMB-S4 sensitivity. However, in principle foreground models may violate them potentially leading to biases (e.g. DC4 model 03 where the preferred value of \(\beta_d\) is outside the prior range - see this posting, Figure 2).

The model includes the following parameters:

For the decorrelation model, we assume that the cross-spectrum of dust between frequencies \(\nu_1\) and \(\nu_2\) is reduced by factor \(\exp\{log(\Delta_d) \times [\log^2(\nu_1 / \nu_2) / \log^2(217 / 353)] \times f(\ell)\}\). For the \(\ell\) dependence we fix the scaling to take a linear form (pivot scale is \(\ell\)=80).


1. Summary Plots

Figure 1 shows how the constraints on r evolve for the different observation masks, both for sky model 00 and 07. Figure 2 shows the evolution of \(\sigma(r)\) as a function of residual lensing \(A_L\) for the 3 masks.
While the 07 model has variations of dust amplitude, and an overall higher dust level (see Section 2), the constraints on r are not deteriorated significantly. A real sky with some level of decorrelation would probably take a bigger hit on sensitivity. Future work will help testing this hypothesis.
For reasonable delensing factors, \(A_L=0.3\) for the Chile mask, \(A_L=0.1\) for the Pole mask, it seems like a Pole-like observation leads to tighter constraint, despite the caveat raised above.

Comments on Figure 1:

Figure 1: Summary of the results for different values of \(A_L\). In red, the analysis of the simulations with r=0.003, in green, the r=0 case. On the left, the case without decorrelation in the parametrization, on the right, with linear-\(\ell\) decorrelation. The outer error bars show the standard deviation \(\sigma\) of the \(N_{sims}\) simulations' ML results (\(N_{sims}\)=150), and the inner error bars show \(\sigma/\sqrt{N_{sims}}\).

Comments on Figure 2:

Figure 2: Evolution of \(\sigma(r)\) as a function of \(A_L\), for the 3 masks. In blue the circular 3% mask, in green the nominal Chile mask and red, the nominal Pole mask. The error bars are an estimate of the error on the std, estimated as \(\sigma/\sqrt{2*N_{sims}}\).

2: Parameter distributions

In figure 3, we report the full distribution of the ML parameters, in the form of histograms or of "Triangle plots".
Note the overall level of dust amplitude for 04.07 peaking at 14.8±0.8 \(\mu K^2\), 04b.07 peaking at 72.9±2.5 \(\mu K^2\), and 04c.07 peaking at 22.6±1.8 \(\mu K^2\), compared to 4.3±0.3 \(\mu K^2\) for 04.00. Despite this high level of dust amplitude, \(\sigma(r)\) doesn't significantly change, as we have seen in figure 2. A more realistic model including some level of decorrelation might allow us to test the effect of mask variation more fairly.

Figure 3: Figure representing the ML parameters histograms for models 04.00 to 04.07, using the proper bandpass conventions, as well as taking into account the L-cut, as described in this posting.

3: DC4, DC4b and DC4c results table

00: Gaussian foregrounds

The mean values and standard deviations of \(r\) for simulations with simple Gaussian foregrounds are summarized in Table 00, Table 00b and Table 00c, respectively for the circular 3% mask, the nominal Chile mask and the nominal Pole mask.

Figure 1 shows these results in a plot.

Table 00
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with simple Gaussian foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.804±2.489-0.262±0.897-0.098±0.439-0.036±0.275
linear -0.787±2.554-0.211±1.003-0.047±0.565-0.009±0.404
Input \(r\) = 0.003
none 2.102±2.6182.675±1.0832.868±0.6182.960±0.445
linear2.180±2.8122.768±1.2962.954±0.8113.010±0.609
Table 00b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with simple Gaussian foregrounds, for the nominal Chile mask (04b.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.706±1.698-0.146±0.8270.017±0.5710.081±0.483
linear -0.557±1.9090.014±1.059 0.115±0.8120.120±0.726
Input \(r\) = 0.003
none 2.353±1.7452.903±0.9483.066±0.6753.133±0.564
linear2.441±2.0243.002±1.2193.113±0.9143.126±0.777
Table 00c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with simple Gaussian foregrounds, for the nominal Pole mask (04c.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.416±3.528-0.156±1.266-0.056±0.584-0.015±0.321
linear -0.471±3.639-0.161±1.401-0.035±0.7170.006±0.436
Input \(r\) = 0.003
none3.173±3.2953.003±1.3292.991±0.7082.997±0.484
linear3.150±3.4533.007±1.5883.010±0.9743.017±0.703

07: Amplitude modulated Gaussian foregrounds

The mean values and standard deviations of \(r\) for simulations with amplitude modulated Gaussian foregrounds are summarized in Table 07, Table 07b and Table 07c, respectively for the circular 3% mask, the nominal Chile mask and the nominal Pole mask.

Figure 1 shows these results in a plot.

Table 07
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.949±2.509-0.316±0.900-0.128±0.427-0.056±0.254
linear-0.950±2.620-0.249±1.062-0.054±0.599-0.014±0.417
Input \(r\) = 0.003
none2.438±2.5572.787±1.0782.904±0.6352.959±0.466
linear2.627±2.7232.967±1.3223.051±0.8853.049±0.693
Table 07b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the nominal Chile mask (04b.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.742±1.701-0.149±0.8280.024±0.5710.094±0.482
linear-0.281±1.9690.179±1.125 0.174±0.8630.132±0.763
Input \(r\) = 0.003
none2.345±1.7512.913±0.9543.080±0.6823.148±0.571
linear2.739±2.1813.199±1.3623.201±1.0183.160±0.856
Table 07c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the nominal Pole mask (04c.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.453±3.512-0.164±1.267-0.054±0.587-0.010±0.321
linear-0.512±3.661-0.164±1.435-0.027±0.7360.012±0.444
Input \(r\) = 0.003
none3.170±3.3043.012±1.3342.998±0.7113.000±0.486
linear3.148±3.4643.021±1.6033.027±0.9943.030±0.723