TD-SHE-000006-global-validation

Summary

This testing dataset comprises the input data needed for a run of the SHE Global Validation pipeline on a set of Euclid observations which have been processed by the SHE Analysis pipeline. When the SHE Global Validation pipeline is run, it performs the validation tests associated with this dataset.

The dataset used for this test campaign was a set of 119 simulated Euclid Wide observations, covering a sky area of 59.5 sq. deg.

Relevant Tests and Test Cases

  • T-SHE-000006-shear-bias
  • T-SHE-000007-pdf-eps-s
  • TC-SHE-100009-PSF-res-interp-star-pos-epoch
  • TC-SHE-100027-CTI-PSF-epoch
  • TC-SHE-100032-CTI-gal-epoch

Data Description

The data included in this testing dataset consists of:

  • Simulated Euclid VIS-channel images and associated data for each observation (0.5 sq. deg of spatial coverage each, 59.5 sq. deg total), processed by PF-VIS
  • Object catalogs generated by PF-MER through processing the above VIS-channel images, for all tiles overlapping the selected observations
  • Shear measurement catalogs for each observation, generated by the PF-SHE Analysis pipeline

Of note, we detail here the object selection performed for the tests using this dataset:

  • The SHE Analysis pipeline provides shear estimated for all objects which are labelled in MER's catalog as being detected using only the VIS-channel data, regardless of whether these objects are labelled as stars or galaxies, and regardless of S/N
  • For validation tests, only objects for which the shear estimate is provided without any error flags are used, and these objects are separated into those believed to be galaxies, those believed to be stars, and those of an unknown type

Data Details

All data in this testing dataset is stored in the Euclid Archive Service (EAS), and can be viewed on the DBView web service (https://eas-dps-cus-ops.esac.esa.int/) or retrieved via the DataProductRetrieval.py script through querying it appropriately.

The following sections list the different types of data products required, plus the metadata values which can be used to query for them. In addition to the metadata values listed below, all queries should include Header.ManualValidationStatus.ManualValidationStatus!="INVALID" to properly exclude any invalidated data.

Data from PF-VIS

The following data product is used from PF-VIS:

  • DpdVisCalibratedFrame

The specific products used for this test can be retrieved by querying for the above product with the specific metadata values:

  • Header.DataSetRelease=SC8_MAIN_V0
  • Data.ObservationSequence.ObservationId= Each of the following (requiring a separate query for each):
10351, 10352, 10353, 10354, 10355, 10356, 10357, 10358, 10359, 10389, 10393, 10394, 10395, 10396, 10397, 10401, 10402, 10403,
10404, 10405, 10406, 10409, 10410, 10411, 10413, 10417, 10418, 18347, 18628, 18649, 18650, 18653, 18675, 18676, 18691, 18695,
18704, 18705, 18708, 18709, 18710, 25400, 25401, 25402, 25408, 25410, 25411, 25412, 25413, 25418, 25419, 25420, 25421, 25422,
25423, 25630, 25631, 25632, 25633, 25640, 25641, 25642, 25643, 25644, 25645, 25655, 25656, 25657, 25658, 25659, 25660, 25664,
25665, 25666, 25667, 25668, 25669, 25681, 25682, 25683, 25684, 25685, 25686, 25692, 25693, 25694, 25695, 25696, 25697, 25707,
25708, 25709, 25710, 25711, 25712, 31953, 34923, 34924, 34925, 34926, 34927, 34928, 34929, 34930, 34931, 34932, 34933, 34934,
34959, 40441, 40458, 40470, 40471, 40472, 40480, 40481, 40482, 40495, 40496

This comprises data for all observations which were fully processed by the SHE Analysis pipeline during Science Challenge 8.

Data from PF-MER

The following data product is used from PF-MER:

  • DpdMerFinalCatalog

The specific products used for this test can be retrieved by querying for each of the above products with the specific metadata values:

  • Header.DataSetRelease=SC8_MAIN_V0
  • Data.TileIndex= Each of the following (requiring a separate query for each):
66250, 66588, 66589, 66590, 66594, 66928, 66929, 66931, 66932, 66934, 66935, 67269, 67271, 67272, 67609, 67610, 67951, 68644,
73748, 73749, 73752, 74085, 74086, 74088, 74089, 74091, 74423, 74425, 74426, 74427, 74428, 74429, 74766, 74767, 74769, 75105,
75108, 75110, 75442, 75443, 75444, 75445, 75448, 75451, 75788, 75792, 76125, 76128, 76463, 76464, 76465, 76467, 76468, 76470,
76471, 76805, 76806, 77143, 80181, 80520, 80862, 81199, 81201, 81538, 81539, 81540, 81877, 81878, 81879, 81881, 82218, 82219,
82220, 82221, 82558, 82559, 82560, 82894, 82895, 82897, 82898, 82899, 83233, 83236, 83237, 83252, 83572, 83930, 83931, 84268,
84270, 84947, 90346, 90684, 91023, 91024, 91361, 91362, 91699, 91700, 91701, 91702, 91703, 91705, 91706, 92038, 92039, 92040,
92041, 92043, 92044, 92377, 92378, 92381, 92382, 92716, 92717, 92718, 92719, 92720, 93054, 93055, 93056, 93057, 93058, 93392,
93393, 93394, 93395, 93396, 93730, 93731, 93732, 93733, 93734, 94069, 94070

This comprises data for all tiles overlapping observations listed in the above section.

Data from PF-SHE

The following data product is used from PF-SHE's SHE Analysis pipeline:

  • DpdSheValidatedMeasurements

The specific products used for this test can be retrieved by querying for the above product with the specific metadata values:

  • Header.DataSetRelease=SC8_MAIN_V0
  • Data.ObservationId= Each of the following (requiring a separate query for each):
10351, 10352, 10353, 10354, 10355, 10356, 10357, 10358, 10359, 10389, 10393, 10394, 10395, 10396, 10397, 10401, 10402, 10403,
10404, 10405, 10406, 10409, 10410, 10411, 10413, 10417, 10418, 18347, 18628, 18649, 18650, 18653, 18675, 18676, 18691, 18695,
18704, 18705, 18708, 18709, 18710, 25400, 25401, 25402, 25408, 25410, 25411, 25412, 25413, 25418, 25419, 25420, 25421, 25422,
25423, 25630, 25631, 25632, 25633, 25640, 25641, 25642, 25643, 25644, 25645, 25655, 25656, 25657, 25658, 25659, 25660, 25664,
25665, 25666, 25667, 25668, 25669, 25681, 25682, 25683, 25684, 25685, 25686, 25692, 25693, 25694, 25695, 25696, 25697, 25707,
25708, 25709, 25710, 25711, 25712, 31953, 34923, 34924, 34925, 34926, 34927, 34928, 34929, 34930, 34931, 34932, 34933, 34934,
34959, 40441, 40458, 40470, 40471, 40472, 40480, 40481, 40482, 40495, 40496

This is the same list as for PF-VIS data above, and it comprises data for all observations which were fully processed by the SHE Analysis pipeline during Science Challenge 8.

results matching ""

    No results matching ""