Maximum likelihood search results for Data Challenge 04b and 04c, model 00, 01, 02, 03, 07, 08 and 09

  B. Racine

We now have simulations using the nominal Chile (b) and Pole (c) masks for model 00, 01, 02, 03, 07, 08 and 09.


Introduction

This posting summarizes results from analysis of CMB-S4 Data Challenge 04b and 04c using a BICEP/Keck-style parametrized foreground model. It is an update on this posting, that focused on models 0 and 7.
The method is analogous to this previous posting, which reports DC4 results for model 00 to 09. We are using proper bandpass conventions, as explained in this posting, section 3, and a new log-likelihood cut as explained in this posting, section 2.

In the current posting, we analyse simulations with nominal Chile (DC04b) and Pole (DC04c) masks, as described here, which we compare to the previous circular idealized f_sky 3% mask from the CDT report (DC04). More information about DC4 can be found in the Experiment Definition page.
We are now using models 0, 1, 2, 3, 7, 8 and 9, that are described with a bit more details in this posting, where the analysis on the 3% circular mask is reported.

For now we only have 300 simulations in each case.

In section 1, we show the main results concerning the "r" results.
In section 2, we show the ML parameters' distributions, including foreground parameters, as histograms or as "triangle plots".
In section 3, we report tables of r constraints for different sky models, masks, lensing residuals, and with and without decorrelation in the ML search.

Note about the Model:
In this analysis, for each realization, we find the set of model parameters that maximizes the likelihood multiplied by priors on the dust and sync spectral index parameters (\(\beta_d\) and \(\beta_s\)). These priors are based on Planck data, so they are quite weak in comparison with CMB-S4 sensitivity. However, in principle foreground models may violate them potentially leading to biases (e.g. DC4 model 03 where the preferred value of \(\beta_d\) is outside the prior range - see this posting, Figure 2).

The model includes the following parameters:

For the decorrelation model, we assume that the cross-spectrum of dust between frequencies \(\nu_1\) and \(\nu_2\) is reduced by factor \(\exp\{log(\Delta_d) \times [\log^2(\nu_1 / \nu_2) / \log^2(217 / 353)] \times f(\ell)\}\). For the \(\ell\) dependence we fix the scaling to take a linear form (pivot scale is \(\ell\)=80).


1. Summary Plots

Figure 1 shows how the constraints on r evolve for the different observation masks, for different sky models. Figure 2 shows the evolution of \(\sigma(r)\) as a function of residual lensing \(A_L\) for the 3 masks.

Comments on Figure 1:

Figure 1: Summary of the results for different values of \(A_L\). In red, the analysis of the simulations with r=0.003, in green, the r=0 case. On the left, the case without decorrelation in the parametrization, on the right, with linear-\(\ell\) decorrelation. The outer error bars show the standard deviation \(\sigma\) of the \(N_{sims}\) simulations' ML results (\(N_{sims}\)=150), and the inner error bars show \(\sigma/\sqrt{N_{sims}}\).

Comments on Figure 2:

Figure 2: Evolution of \(\sigma(r)\) as a function of \(A_L\), for the 3 masks. In blue the circular 3% mask, in green the nominal Chile mask and red, the nominal Pole mask. The error bars are an estimate of the error on the std, estimated as \(\sigma/\sqrt{2*N_{sims}}\).

2: Parameter distributions

In figure 3, we report the full distribution of the ML parameters, in the form of histograms or of "Triangle plots".
Note the overall level of dust amplitude for 04.07 peaking at 14.8±0.8 \(\mu K^2\), 04b.07 peaking at 72.9±2.5 \(\mu K^2\), and 04c.07 peaking at 22.6±1.8 \(\mu K^2\), compared to 4.3±0.3 \(\mu K^2\) for 04.00. Despite this high level of dust amplitude, \(\sigma(r)\) doesn't significantly change, as we have seen in figure 2.
Swtiching between 04.09 04b.09, and 04c.09, we see such a brightness variations, but this time, we have a non-negligible decorrelation. This might explain why this model take a larger hit on sensitivity when using wider masks. Somehow, model 8, which also has a strong decorrelation and some realistic bightness variations, doesn't take such a big hit, only an overall increase of \(\sigma(r)\).

Figure 3: Figure representing the ML parameters histograms for models 04.00 to 04.07, using the proper bandpass conventions, as well as taking into account the L-cut, as described in this posting.

3: DC4, DC4b and DC4c results table

00: Gaussian foregrounds

The mean values and standard deviations of \(r\) for simulations with simple Gaussian foregrounds are summarized in Table 00, Table 00b and Table 00c, respectively for the circular 3% mask, the nominal Chile mask and the nominal Pole mask.

Figure 1 shows these results in a plot.

Table 00
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with simple Gaussian foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.804±2.489-0.262±0.897-0.098±0.439-0.036±0.275
linear -0.787±2.554-0.211±1.003-0.047±0.565-0.009±0.404
Input \(r\) = 0.003
none 2.102±2.6182.675±1.0832.868±0.6182.960±0.445
linear2.180±2.8122.768±1.2962.954±0.8113.010±0.609
Table 00b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with simple Gaussian foregrounds, for the nominal Chile mask (04b.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.706±1.698-0.146±0.8270.017±0.5710.081±0.483
linear -0.557±1.9090.014±1.059 0.115±0.8120.120±0.726
Input \(r\) = 0.003
none 2.353±1.7452.903±0.9483.066±0.6753.133±0.564
linear2.441±2.0243.002±1.2193.113±0.9143.126±0.777
Table 00c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with simple Gaussian foregrounds, for the nominal Pole mask (04c.00).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.416±3.528-0.156±1.266-0.056±0.584-0.015±0.321
linear -0.471±3.639-0.161±1.401-0.035±0.7170.006±0.436
Input \(r\) = 0.003
none3.173±3.2953.003±1.3292.991±0.7082.997±0.484
linear3.150±3.4533.007±1.5883.010±0.9743.017±0.703

01: PySM a1d1s1f1

For more details about this model, see this previous posting

Figure 1 shows these results in a plot.

Table 01
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with PySM a1d1f1s1 foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.01).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none 0.225±2.5220.593±0.9310.590±0.4710.526±0.306
linear 0.089±2.6380.494±1.1000.479±0.6380.387±0.445
Input \(r\) = 0.003
none 3.139±2.6093.524±1.0943.569±0.6483.563±0.483
linear3.040±2.7683.469±1.2973.507±0.8453.462±0.654
Table 01b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a1d1f1s1 foregrounds, for the nominal Chile mask (04b.01).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none1.100±1.9081.527±0.9561.649±0.6721.703±0.571
linear0.990±2.0991.284±1.2051.240±0.9201.191±0.805
Input \(r\) = 0.003
none4.252±1.9084.626±1.0624.730±0.7784.777±0.667
linear4.137±2.2634.380±1.4144.312±1.0654.245±0.904
Table 01c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a1d1f1s1 foregrounds, for the nominal Pole mask (04c.01).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none 1.149±3.6231.073±1.3410.749±0.6710.539±0.410
linear0.806±3.6810.819±1.4220.521±0.7470.301±0.471
Input \(r\) = 0.003
none4.664±3.4254.240±1.4263.895±0.7943.695±0.559
linear4.326±3.4663.972±1.5813.660±0.9883.463±0.736

02: PySM a2d4f1s3

For more details about this model, see this previous posting

Figure 1 shows these results in a plot.

Table 02
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with PySM a2d4f1s3 foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.02).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.230±2.5480.210±0.954 0.301±0.4780.316±0.300
linear -0.542±2.716-0.001±1.1560.154±0.6590.177±0.445
Input \(r\) = 0.003
none 2.603±2.5383.142±1.0783.281±0.6453.335±0.480
linear 2.348±2.6602.981±1.2353.162±0.7953.196±0.613
Table 02b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a2d4f1s3 foregrounds, for the nominal Chile mask (04b.02).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.834±1.9230.085±0.918 0.357±0.6230.463±0.520
linear-1.255±2.136-0.126±1.1810.112±0.8750.159±0.759
Input \(r\) = 0.003
none2.293±1.9573.155±1.0243.414±0.7283.516±0.617
linear1.818±2.3372.889±1.3803.121±1.0093.165±0.845
Table 02c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a2d4f1s3 foregrounds, for the nominal Pole mask (04c.02).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none0.196±3.645 0.296±1.3250.249±0.6230.215±0.350
linear-0.123±3.7130.061±1.4160.094±0.7070.084±0.418
Input \(r\) = 0.003
none3.677±3.4373.433±1.3813.322±0.7403.278±0.517
linear3.335±3.4803.137±1.5403.091±0.9313.080±0.678

03: PySM a2d7f1s3

For more details about this model, see this previous posting

Figure 1 shows these results in a plot.

Table 03
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with PySM a2d7f1s3 foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.03).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.073±2.5100.431±0.921 0.512±0.4720.493±0.313
linear-0.972±2.643-0.242±1.1340.028±0.6750.103±0.476
Input \(r\) = 0.003
none 3.102±2.6303.484±1.1113.544±0.6633.542±0.498
linear 2.232±2.7482.826±1.3163.061±0.8723.135±0.680
Table 03b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a2d7f1s3 foregrounds, for the nominal Chile mask (04b.03).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.078±1.8800.728±0.926 0.953±0.645 1.039±0.552
linear-2.276±2.137-0.670±1.246-0.209±0.963-0.079±0.859
Input \(r\) = 0.003
none3.054±1.9293.808±1.0794.018±0.7924.098±0.680
linear0.788±2.3952.325±1.5102.774±1.1452.897±0.975
Table 03c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with PySM a2d7f1s3 foregrounds, for the nominal Pole mask (04c.03).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none 0.359±3.716 0.509±1.373 0.443±0.664 0.367±0.394
linear-0.515±3.828-0.187±1.497-0.057±0.776-0.020±0.484
Input \(r\) = 0.003
none 3.910±3.4303.672±1.4043.540±0.7773.462±0.548
linear3.016±3.5402.902±1.6312.937±1.0182.971±0.750

07: Amplitude modulated Gaussian foregrounds

The mean values and standard deviations of \(r\) for simulations with amplitude modulated Gaussian foregrounds are summarized in Table 07, Table 07b and Table 07c, respectively for the circular 3% mask, the nominal Chile mask and the nominal Pole mask.

Figure 1 shows these results in a plot.

Table 07
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.949±2.509-0.316±0.900-0.128±0.427-0.056±0.254
linear-0.950±2.620-0.249±1.062-0.054±0.599-0.014±0.417
Input \(r\) = 0.003
none2.438±2.5572.787±1.0782.904±0.6352.959±0.466
linear2.627±2.7232.967±1.3223.051±0.8853.049±0.693
Table 07b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the nominal Chile mask (04b.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none -0.742±1.701-0.149±0.8280.024±0.5710.094±0.482
linear-0.281±1.9690.179±1.125 0.174±0.8630.132±0.763
Input \(r\) = 0.003
none2.345±1.7512.913±0.9543.080±0.6823.148±0.571
linear2.739±2.1813.199±1.3623.201±1.0183.160±0.856
Table 07c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with amplitode modulated Gaussian foregrounds, for the nominal Pole mask (04c.07).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none-0.453±3.512-0.164±1.267-0.054±0.587-0.010±0.321
linear-0.512±3.661-0.164±1.435-0.027±0.7360.012±0.444
Input \(r\) = 0.003
none3.170±3.3043.012±1.3342.998±0.7113.000±0.486
linear3.148±3.4643.021±1.6033.027±0.9943.030±0.723

08: MKD model (3D multi-layer)

For more details about this model, see this previous posting

Figure 1 shows these results in a plot.

Table 08
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with multi-layer MKD foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.08).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none5.054±2.7894.741±1.1284.106±0.6293.535±0.432
linear2.948±2.8732.792±1.2922.408±0.8442.071±0.661
Input \(r\) = 0.003
none 8.045±2.7097.584±1.2747.004±0.8266.540±0.634
linear6.094±2.7995.803±1.4965.501±1.0925.260±0.896
Table 08b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with multi-layer MKD foregrounds, for the nominal Chile mask (04b.08).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none13.919±2.07313.514±1.10013.318±0.79813.269±0.693
linear6.479±2.327 6.174±1.388 6.035±1.085 5.982±0.971
Input \(r\) = 0.003
none17.031±1.97616.655±1.18316.479±0.91016.441±0.801
linear9.528±2.365 9.239±1.567 9.088±1.242 9.015±1.092
Table 08c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with multi-layer MKD foregrounds, for the nominal Pole mask (04c.08).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none8.855±4.0707.104±1.6525.267±0.8833.953±0.561
linear4.726±4.2663.459±1.9222.004±1.1381.107±0.757
Input \(r\) = 0.003
none11.956±3.88510.010±1.7168.293±0.9757.135±0.684
linear7.889±3.907 6.488±1.972 5.227±1.3014.429±0.968

09: Vansyngel model

For more details about this model, see this previous posting

Figure 1 shows these results in a plot.

Table 09
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 500\) realizations with Vansyngel foregrounds, for the "CDT" circular idealized f_sky 3% mask (04.09).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none2.856±2.5872.827±1.016 2.396±0.552 1.966±0.370
linear0.100±2.885-0.070±1.327-0.494±0.819-0.736±0.599
Input \(r\) = 0.003
none5.897±2.8075.687±1.2695.304±0.7754.973±0.570
linear3.493±3.0093.145±1.5152.772±1.0252.554±0.828
Table 09b
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with Vansyngel foregrounds, for the nominal Chile mask (04b.09).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none19.799±2.26219.328±1.36019.347±1.06319.460±0.950
linear9.009±2.449 8.154±1.565 7.584±1.265 7.292±1.145
Input \(r\) = 0.003
none22.783±2.16722.508±1.37222.666±1.10422.863±0.996
linear11.822±2.62611.105±1.82710.610±1.48010.356±1.313
Table 09c
Mean \(r \times 10^3\) and \(\sigma(r) \times 10^3\) from sets of \(\simeq 150\) realizations with Vansyngel foregrounds, for the nominal Pole mask (04c.09).
Decorrelation model \(A_L\) = 1 \(A_L\) = 0.3 \(A_L\) = 0.1 \(A_L\) = 0.03
Input \(r\) = 0
none5.573±3.8844.208±1.5282.769±0.7891.724±0.469
linear2.919±4.2281.487±1.8490.122±1.008-0.535±0.607
Input \(r\) = 0.003
none8.797±3.7877.182±1.6365.856±0.9044.939±0.603
linear6.232±3.9444.613±1.9003.407±1.1812.774±0.855