DLP-554: LSST Software Release 4.0 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: DLP-556
• Due: 2014-09-02
• Completed: 2014-09-30

DLP-555: LSST Software Release 5.0 Complete¶

• WBS: 02C.00
• Level: 2
• Due: 2015-02-26
• Completed: 2015-03-06

DLP-559: Mountain - Base Network Functional 1 Gbps¶

• WBS: 02C.00
• Level: 1
• Successors: DM-NET-2
• Due: 2015-06-02
• Completed: 2015-06-01

DLP-556: LSST Software Release 5.1 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-400, DLP-554
• Successors: DLP-557, DLP-566
• Due: 2015-08-31
• Completed: 2015-09-01

DLP-528: Archive Site Ready for Equipment Configuration¶

• WBS: 02C.00
• Level: 1
• Due: 2015-10-01
• Completed: 2015-10-01

This is complete in. data/pmcs/201904-ME.xls.

DLP-566: LSST Software Release 6.0 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-364, DLP-389, DLP-556, DLP-486, DLP-103, DLP-100
• Successors: DLP-557
• Due: 2016-02-29
• Completed: 2016-07-12

DMTC-0000-0020: LSST Software Release X16 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-694
• Due: 2016-05-31
• Completed: 2016-07-12

DLP-541: LSE-68 Camera-DM Image data interfaces - Phase 3¶

• WBS: 02C.00
• Level: 2
• Successors: S17S
• Due: 2016-07-05
• Completed: 2016-10-31

Complete with LCR-1788 June 2019.

DLP-557: LSST Software Release 6.1 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-556, DLP-566, DLP-579
• Successors: DLP-558
• Due: 2016-08-31
• Completed: 2016-08-31

DLP-544: LSE-72 OCS-DM master interface - Phase 3¶

• WBS: 02C.00
• Level: 2
• Successors: DLP-558
• Due: 2016-09-30
• Completed: 2016-10-31

DMTC-0000-0030: LSST Software Release F16 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: DLP-847, DLP-366, DLP-412, DLP-871
• Due: 2016-11-30
• Completed: 2016-11-30

S17S: S17 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-850, DLP-405, DLP-541, DLP-871
• Successors: S17F
• Due: 2016-12-01
• Completed: 2016-12-01

DLP-567: LSST Software Release 7.0 Complete¶

• WBS: 02C.00
• Level: 2
• Due: 2017-02-28
• Completed: 2017-02-28

DLP-538: LSE-130 Data items Exchanged between Cam & DM - Phase 3¶

• WBS: 02C.00
• Level: 2
• Predecessors: DMTC-0000-3000, S17F
• Successors: DLP-558
• Due: 2017-05-31
• Completed: 2017-05-31

approval of LCR-1494 in June 2019 allows this to be closed, LSE-400 [15] covers the items.

DMTC-0000-3000: LSST Software Release S17 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: DLP-538, DLP-736, DLP-472
• Due: 2017-05-31
• Completed: 2017-05-31

S17F: S17 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: S17S
• Successors: DLP-61, DLP-538, DLP-736, DLP-152, DLP-473, DLP-472
• Due: 2017-05-31
• Completed: 2017-05-31

F17S: F17 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-736
• Successors: F17F
• Due: 2017-06-01
• Completed: 2017-06-01

DLP-558: LSST Software Release 7.1 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-544, DLP-557, DLP-538
• Successors: DLP-551
• Due: 2017-08-31
• Completed: 2017-08-31

F17F: F17 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-847, DLP-366, F17S
• Successors: DLP-368, DLP-459, DLP-458, DLP-457, DLP-442, DLP-433, DLP-207, DLP-205, DLP-222, DLP-473, DLP-725, DLP-344, DLP-352
• Due: 2017-11-30
• Completed: 2017-11-30

LDM-503-01: Test report: Science Platform with WISE data in PDAC¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-540 [9] v1.0 S3.1 (LSP-00)
• Predecessors: DM-SUIT-1, DM-SUIT-2, DM-SUIT-3, DM-SUIT-4, DM-DAX-1, DM-SQRE-1
• Successors: LDM-503-07
• Due: 2017-11-30
• Completed: 2018-05-30

This test demonstrates the deployment of the Portal and API Aspects of the LSST Science Platform (LSE-319 [13], LDM-542 [11], LDM-554 [10]) to serve all-sky precursor data, including catalogs totaling of order 50–100 billion rows, in a prototype LSST Data Access Center hosted in the LSST Data Facility at NCSA.

LDM-503-03: Test report: Alert generation validation¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-533 [1] v1.1 S3.1 (AG-00)
• Predecessors: DM-AP-1, DM-AP-2, DM-AP-3, DM-AP-4, DM-AP-5, DM-DAX-6
• Successors: LDM-503-05
• Due: 2017-11-30
• Completed: 2017-12-01

This test demonstrates the successful execution of a prototype Alert Generation science payload (LDM-148 [16], LDM-151 [22]), processing data from precursor surveys at a relatively small scale using compute resources at the LSST Data Facility at NCSA.

S18S: S18 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-368, DLP-412, DLP-459, DLP-458, DLP-457, DLP-207, DLP-205, DLP-222, DLP-725, DLP-352
• Successors: S19S
• Due: 2017-12-01
• Completed: 2017-12-01

LSST-1160: Header Service Integration¶

• WBS: 02C.00
• Level: 2
• Predecessors: DM-NCSA-27
• Successors: LSST-1190
• Due: 2017-12-29
• Completed: 2018-03-31

LSST-1190: Control Interfaces Verification: Single Visit¶

• WBS: 02C.00
• Level: 2
• Predecessors: DM-NCSA-28, LSST-1160
• Successors: LSST-1200, LSST-1220
• Due: 2017-12-29
• Completed: 2018-03-30

LSST-1200: Interface Verification: Single Visit¶

• WBS: 02C.00
• Level: 2
• Predecessors: DM-NCSA-29, LSST-1190
• Successors: F18S, LDM-503-06
• Due: 2017-12-29
• Completed: 2018-04-05

LSST-1220: EFD ETL Under DM Control¶

• WBS: 02C.00
• Level: 2
• Predecessors: LSST-1190
• Successors: LSST-1580
• Due: 2017-12-29
• Completed: 2019-03-29

S18F: S18 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: DLP-864
• Successors: DLP-33, DM-DRP-3, DM-DRP-5, DM-DRP-8, DM-DRP-9, DM-DRP-11, DM-DRP-17, DM-DRP-19, DM-DRP-38
• Due: 2018-05-31
• Completed: 2018-05-31

F18S: F18 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: LSST-1200
• Successors: F19S, LDM-503-05, DM-AP-6, DM-AP-7, DM-AP-9
• Due: 2018-06-01
• Completed: 2018-06-01

DLP-551: LSST Software Release 8.1 Complete, Ready for Commissioning Camera¶

• WBS: 02C.00
• Level: 1
• Predecessors: DLP-558
• Successors: DLP-552, COMC-0100
• Due: 2018-08-31
• Completed: 2018-07-12

F18F: F18 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: DM-NCSA-11, DLP-464, DLP-466, DM-AP-8, DM-DRP-37, DM-DRP-29, DM-DAX-8, DM-DAX-9, DM-DAX-10
• Due: 2018-11-30
• Completed: 2018-11-30

S19S: S19 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: S18S
• Successors: S20S
• Due: 2018-12-01
• Completed: 2018-12-01

LDM-503-02: Test report: HSC reprocessing¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-534 [21] v3.1 S3.1 (DRP-00)
• Predecessors: DM-NCSA-1, DM-NCSA-2, DM-NCSA-3, DM-AP-1, DM-DRP-1, DM-DRP-2
• Successors: DM-NCSA-4, LDM-503-07
• Due: 2019-02-28
• Completed: 2017-12-01

This test demonstrates the successful execution of a prototype Data Release Production science payload (LDM-148 [16], LDM-151 [22]), processing data from precursor surveys at a relatively small scale using compute resources at the LSST Data Facility at NCSA.

LDM-503-04: Test report: Aux Tel DAQ integration functionality test¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-538 [7] v1.0 S4.1 (RAS-00-00)
• Predecessors: DM-NCSA-4
• Successors: LDM-503-10, LDM-503-04b
• Due: 2019-02-28
• Completed: 2018-06-29

This test demonstrates that LSST data acquisition system can capture raw data from instrumentation and construct a well-formed image with proper headers.

LDM-503-07: Test report: Camera data processing¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-112 [19] [DM-16072]
• Predecessors: LDM-503-01, LDM-503-02, DM-DRP-4
• Successors: LSST-1470, DLP-552, LDM-503-09
• Due: 2019-02-28
• Completed: 2019-01-17

This test demonstrates that the LSST Science Pipelines can be successfully used to load and perform basic processing of data from the LSST Camera test systems. In the process, it establishes that data is properly made available at the LSST Data Facility at NCSA, and is accessible through the LSST Science Platform.

LDM-503-04b: Test report: Aux Tel DAQ interface Integration Verification and Spectrograph Operations Rehearsal¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-538 [7] v1.0 S4.4 (RAS-00-20)
• Predecessors: DM-NCSA-27, DM-NCSA-5, DM-NCSA-6, DM-NCSA-7, LDM-503-04
• Successors: LDM-503-08
• Due: 2019-02-28
• Completed: 2018-06-29

This test demonstrates that the well-formed image generated in LDM-503-04 can be written to the permanent record of the survey.

S19F: S19 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: DLP-46, DLP-877, DLP-876, S20S, DM-SUIT-7, DM-SUIT-10
• Due: 2019-05-31
• Completed: 2019-05-31

Time-based milestone marking the completion of the Spring 2019 development cycle.

F19S: F19 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: F18S
• Successors: F19F
• Due: 2019-06-01
• Completed: 2019-06-01

LDM-503-10a: Science Platform: TAP service with federated SSO A&A¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-161 [8] [DM-19211]
• Predecessors: DM-DAX-2
• Successors: LDM-503-10b
• Due: 2019-07-29
• Completed: 2019-12-31 [DM-19209]

This test demonstrates the successful integration of a single-sign-on federated authentication system, and a basic authorization system, with the three Aspects of the LSST Science Platform (Portal, Notebook, and API), with the API Aspect containing at least a TAP service.

DLP-552: LSST Software Release 9.1 Complete, Ready for Full Camera¶

• WBS: 02C.00
• Level: 1
• Predecessors: DM-NCSA-11, DLP-551, LDM-503-07
• Successors: LSST-1470, LDM-503-09
• Due: 2019-08-30
• Completed: 2019-08-30

This pipeline software release will precede LDM-503-12a. This will have all functionality required to process data from LSSTCam. It will not have the full functionality for data release processing.

LDM-503-08b: Small Scale CCOB Data Access¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-102 [6] [DM-16073]
• Predecessors: A5860
• Successors: LDM-503-09
• Due: 2019-11-08
• Completed: 2019-07-15 [DM-17118]

This test demonstrates the integration of the CCOB with the permanent record of the survey.

F19F: F19 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: F19S
• Successors: F20S, S20S, DM-STAFF
• Due: 2019-11-27
• Completed: 2019-11-29

Time-based milestone marking the completion of the Fall 2019 development cycle.

DM-STAFF: Staffing Checkpoint¶

• WBS: 02C.00
• Level: 2
• Predecessors: F19F
• Successors: LDM-503-13
• Due: 2019-11-27
• Completed: 2019-11-29

DM Management evaluate current DM staffing against project schedule and budget. If there is a shortfall through mid-2022 (the “ops gap”), this is the point at which we need to fill it.

S20S: S20 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: S19S, S19F, F19F
• Successors: S21S, S20F, LDM-503-EFDb
• Due: 2019-12-02
• Completed: 2019-12-02

DLP-533: Base Center Integration Complete¶

• WBS: 02C.00
• Level: 1
• Successors: COMC-1564, COMC-0100, COMC-0620-2090
• Due: 2020-05-13
• Completed: 2020-02-28

This milestone represents the availabilitu of the base center in Las Serena. This includes DM staging machines, the comissioning cluster. It also includes the Chilean Data Access center machines. The later will only be deployed after the US DAC is up.

S20F: S20 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: S20S
• Successors: F20S, S21S, DM-AP-18
• Due: 2020-05-29
• Completed: 2020-05-29

Time-based milestone marking the completion of the Spring 2020 development cycle.

LDM-503-05: Test report: Alert distribution validation¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-533 [1] v2.0 SS 4.7–4.9 (test cases LVV-T216, LVV-T217, LVV-T218)
• Predecessors: DM-NCSA-8, DM-NCSA-9, F18S, LDM-503-03
• Successors: LDM-503-09
• Due: 2020-05-29
• Completed: 2018-07-17

This test demonstrates that a full-LSST-scale (10,000 messages every 39 seconds) alert stream can be distributed to end users. It further shows that simple filters based on alert contents can be applied to that stream.

LDM-503-09a: Test report: Pipelines Release Fall 2018¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-111 [20] [DM-16076]
• Predecessors: DM-AP-2, DM-AP-3, DM-AP-6, DM-AP-7, DM-AP-9, DM-DRP-3, DM-DRP-5, DM-DRP-7, DM-DRP-16, DM-DRP-17, DM-DRP-32, DM-DRP-38
• Successors: LDM-503-09, LDM-503-11
• Due: 2020-05-29
• Completed: 2019-04-12 [DM-17121]

This milestone describes a software release of the LSST Science Pipelines in support of activities in late 2018 and early 2019. The contents of the release are described in LDM-564 [17]. The release will be accompanied by a characterization report.

F20S: F20 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: S20F, F19F
• Successors: DM-NCSA-23, F21S, F20F, DM-AP-10, DM-DRP-22, DM-DRP-24
• Due: 2020-06-01
• Completed: 2020-06-01

Time-based milestone marking the start of the Fall 2020 development cycle.

LDM-503-06: Test report: DM ComCam interface verification readiness¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-171 [4] [DM-16074]
• Predecessors: DM-NCSA-10, DM-NCSA-11, LSST-1200, T&SC-6500-9000, T&SC-7900-2430
• Successors: LSST-1510, LDM-503-10, LDM-503-11a
• Due: 2020-06-03
• Completed: 2020-06-30 [DM-17119]

This milestone records successful transfer of an image equivalent to one raft from the DAQ at the summit to reliable storage in the LSST Data Facility at NCSA, from where it will be made available for scientific evaluation through the LSST Science Platform.

LDM-503-08: Test report: Spectrograph data acquisition¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-121 [5] [DM-16455]
• Predecessors: CAMM8300, DM-NCSA-13, DM-NCSA-14, DM-NCSA-15, DM-NET-2, DM-NET-3, DM-NET-6, LDM-503-04b, DM-DRP-6
• Successors: LDM-503-10, LDM-503-11
• Due: 2020-11-30
• Completed: 2019-12-31 [DM-17131]

This test demonstrates data acquisition from the Auxiliary Telescope spectrograph, transmission of all image files with associated metadata to NCSA for screening, and then further processing if needed.

LDM-503-09: Test report: Ops rehearsal for commissioning #1¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-643 [12] [DM-16075]
• Predecessors: DM-NCSA-16, A4680, A4860, DLP-552, LDM-503-05, LDM-503-07, LDM-503-08b, LDM-503-09a, DM-SUIT-5, DM-DAX-2, DM-DAX-5, DM-DAX-9, DM-SQRE-2, A2370
• Successors: LDM-503-11
• Due: 2020-11-30
• Completed: 2019-10-07 [DM-17120]

This milestone represents the completion of a multi-day exercise in which (simulated) observations are performed and data is processed in as close to an operational mode as is possible at this stage in construction. In particular, it will demonstrate transfer, archiving and intestion of raw data; offline processing of calibration and science data; and curation of the resultant data products.

LDM-503-10: Test report: DAQ validation¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-181 [3] [DM-16193]
• Predecessors: IT-725-M, LDM-503-04, LDM-503-06, LDM-503-08
• Successors: LDM-503-11
• Due: 2020-11-30
• Completed: 2020-06-22 [DM-17122]

Test of the extended data acquisition (DAQ) network in Chile from the Summit to the Base Data Center.

LDM-503-11b: Test report: Pipelines Release Fall 2019¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-192 [18] [DM-16197]
• Predecessors: DM-AP-8, DM-DRP-9, DM-DRP-14, DM-DRP-15, DM-DRP-18, DM-DRP-19
• Successors: LDM-503-11, LDM-503-13a, LDM-503-11a
• Due: 2020-12-01
• Completion pending [DM-17126]

This milestone describes a software release of the LSST Science Pipelines in support of activities in late 2019 and early 2020. The contents of the release are described in LDM-564 [17]. The release will be accompanied by a characterization report.

LDM-503-11a: ComCam Ops Readiness¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-16196]
• Predecessors: DM-NCSA-16, DM-NCSA-20, DM-NCSA-21, DM-NCSA-22, LDM-503-06, LDM-503-11b, DM-SUIT-10
• Successors: LDM-503-12
• Due: 2020-12-01
• Completion pending [DM-17125]

Demonstrate that all DM functionality required to support ComCam operations has been delivered.

DLP-526: Archive Center Integration Complete¶

• WBS: 02C.00
• Level: 1
• Successors: COMC-1664
• Due: 2021-01-28
• Completion pending

This milestone represents the availability of an arhcive center to host LSST DR1 dat. This includes an scince platfirm interface with the implied services for Data Access, a portal and Notebooks.

F20F: F20 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: F20S, DM-DRP-11, DLP-837
• Successors: DLP-465, DLP-468, DLP-467, F21S, S21S, LDM-503-11, DM-DRP-30, DM-DRP-25, DM-DRP-34, DM-DAX-12, DM-DAX-14, DM-SQRE-6, DM-SQRE-7
• Due: 2021-06-02
• Completion pending

Time-based milestone marking the completion of the Fall 2020 development cycle.

LDM-503-14a: Science Platform ready for DP0¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-26340]
• Predecessors: S21S
• Successors: DM2, LDM-503-12a
• Due: 2021-06-03
• Completion pending [DM-26349]

Take the output of a DRP-like, BG3-based, SDM-ified data production and, without a great deal of manual labor, make the resulting image and catalog data available to users through the aspects of the LSP. This includes the generation of image metadata table content for the LSP.

LDM-503-11: Ops rehearsal for commissioning #2¶

• WBS: 02C.00
• Level: 2
• Test specification: LDM-643 [12] [DM-16195]
• Predecessors: DM-NCSA-16, DLP-468, DLP-467, DM-NET-4, F20F, LDM-503-08, LDM-503-09, LDM-503-10, LDM-503-11b, LDM-503-09a
• Successors: LDM-503-12
• Due: 2021-06-04
• Completion pending [DM-17124]

Template generation, including code required to build templates in both Data Release and Alert Production science payloads, can now product templates which are corrected for the effects of Differential Chromatic Refraction (DCR), as described in LDM-151 [22] §6.18. Further, noise in image differences can be “decorrelated”, as described in LDM-151 [22] §6.19.1. Both of these represents initial capabilities, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

F21S: F21 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: F20S, S21F, F20F
• Successors: F21F, DM-DRP-23
• Due: 2021-07-05
• Completion pending

S21S: S21 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: S20S, S20F, F20F
• Successors: S22S, S21F, LDM-503-14a
• Due: 2021-07-05
• Completion pending

S21F: S21 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: S21S
• Successors: DM7, F21S, S22S, LDM-503-13a, DM-DAX-13
• Due: 2021-08-30
• Completion pending

Time-based milestone marking the completion of the Spring 2021 development cycle.

LDM-503-13a: Test report: Pipelines Release Fall 2020¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-16200]
• Predecessors: S21F, LDM-503-11b, DM-AP-11, DM-AP-12, DM-AP-13, DM-DRP-22, DM-DRP-26, DM-DRP-27, DM-DRP-28, DM-DRP-30, DM-DRP-25, DM-DRP-34
• Successors: LDM-503-13, LDM-503-14, LDM-503-15a
• Due: 2021-08-30
• Completion pending [DM-17129]

This milestone describes a software release of the LSST Science Pipelines in support of activities in late 2020 and early 2021. The contents of the release are described in LDM-564 [17]. The release will be accompanied by a characterization report.

LDM-503-10b: Large Scale CCOB Data Access¶

• WBS: 02C.00
• Level: 2
• Test specification: DMTR-182 [2] [DM-16194]
• Predecessors: CAMM8040, CAMM8080, CAMM8300, LDM-503-10a
• Successors: LSST-1580
• Due: 2021-08-31
• Completion pending [DM-17123]

Demonstrate the ability to transfer data from the CCOB with 21 rafts from SLAC and ingested at NCSA and make available through an instance of the LSP.

LDM-503-EFDa: Engineering Facility Database at the summit capturing and enabling access to all telemetry with M1/M3 active¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-26342]
• Successors: LDM-503-12a, LDM-503-EFDb
• Due: 2021-10-28
• Completion pending [DM-26348]

An instance of the Engineering and Facility Database at the summit capturing and enabling access to all telemetry, including from an active M1M3. This may be distinct from the Auxiliary Telescope EFD instance. Demonstrate the ability to run for five days, allowing data retrieval and plotting via notebooks.

S22S: S22 Start¶

• WBS: 02C.00
• Level: 2
• Predecessors: S21S, S21F, F21F
• Successors: DM-NCSA-26, DM-PORTAL, DM-CLOUD
• Due: 2021-12-01
• Completion pending

LDM-503-15a: Test report: Pipelines Release Fall 2021¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17136]
• Predecessors: LDM-503-13a, DM-AP-15, DM-AP-16, DM-AP-17
• Successors: DM9, DM11, DM12, LDM-503-17a
• Due: 2021-12-16
• Completion pending [DM-17137]

This milestone describes a software release of the LSST Science Pipelines in support of activities in late 2021 and early 2022. The contents of the release are described in LDM-564 [17]. The release will be accompanied by a characterization report.

LDM-503-12a: LSSTCam Ops Readiness¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-16199]
• Predecessors: CAMM8090, LDM-503-14a, LDM-503-EFDa, COMC-0030
• Successors: LSST-1520, DM1, LDM-503-EFDc
• Due: 2022-03-14
• Completion pending [DM-17128]

Demonstrate that all DM functionality required to support operations with the full LSST Camera has been delivered.

LDM-503-EFDb: EFD/telemetry data replicated at the LDF, stored in InfluxDB. aggregated into parquet files¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-26344]
• Predecessors: S20S, LDM-503-EFDa, COMC-0100
• Successors: LSST-1520
• Due: 2022-03-14
• Completion pending [DM-26347]

Demonstrate that EFD data from the Summit appears at the US Data Facility. Show that the Parquet files generated contain all low frequency EFD values and summaries of high frequency values.

LDM-503-EFDc: EFD data is queriable through TAP in the Science Platform¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-26345]
• Predecessors: LDM-503-12a
• Successors: LSST-1520
• Due: 2022-03-14
• Completion pending [DM-26346]

Demonstrate that engineering data for a specific observation time can be retrieved via TAP on the Science Platform or directly to a TAP tool like TopCat. Test DMS-REQ-0102 (Priority 1a) to permantely archive metadata from OCS and make availble to rights holders. Also test DMS-REQ-0358 (Priority 1a), demonstrating support of simultaneous queries.

F21F: F21 Complete¶

• WBS: 02C.00
• Level: 2
• Predecessors: F21S
• Successors: S22S, LDM-503-12, DM-AP-14
• Due: 2022-03-16
• Completion pending

Time-based milestone marking the completion of the Fall 2021 development cycle.

LDM-503-12: Ops rehearsal for commissioning #3¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-16198]
• Predecessors: F21F, LDM-503-11, LDM-503-11a, DM-SQRE-3
• Successors: LDM-503-13, LDM-503-14
• Due: 2022-03-16
• Completion pending [DM-17127]

This milestone builds upon LDM-503-11, and serves to demonstrate that all necessary procedures and workflows are in place to support commissioning activities.

LDM-503-13: Ops rehearsal for data release processing #1 (ComCam data)¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-16201]
• Predecessors: DM-NCSA-23, LDM-503-12, DM-STAFF, LDM-503-13a, COMC-0100
• Successors: LDM-503-14, LDM-503-15
• Due: 2022-03-16
• Completion pending [DM-17130]

This milestone builds upon LDM-503-12, but with its scope extended beyond procedures which are necessary in commissioning to cover the operational era.

LDM-503-14: Test report: DM Readiness for Science Verification¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17132]
• Predecessors: LDM-503-12, LDM-503-13, LDM-503-13a, DM-SQRE-4
• Successors: COMC-0140, COMC-060200-20960
• Due: 2022-03-16
• Completion pending [DM-17133]

This milestone represents the point at which all code and/or services which are supplied by DM in support of science verification will be tested and demonstrated to meet their requirements.

DM-PORTAL: Resume development of LSP portal aspect¶

• WBS: 02C.00
• Level: 2
• Predecessors: S22S
• Successors: LSST-1580
• Due: 2022-03-17
• Completion pending

DM-CLOUD: Decide on final data facility design for DR1¶

• WBS: 02C.00
• Level: 2
• Predecessors: S22S
• Successors: LSST-1580
• Due: 2022-03-17
• Completion pending

S22F: S22 Complete¶

• WBS: 02C.00
• Level: 2
• Successors: LSST-1590
• Due: 2022-09-14
• Completion pending

Time-based milestone marking the completion of the Spring 2022 development cycle.

LDM-503-15: Ops rehearsal for data release processing #2¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17134]
• Predecessors: DM-NCSA-24, DM-NCSA-25, LDM-503-13
• Successors: DM15, LDM-503-16
• Due: 2022-10-05
• Completion pending [DM-17135]

This milestone builds upon LDM-503-13, and will demonstrate the production of a data release under simulated operational conditions using data from science verification activities.

LDM-503-17a: Test report: Final Pipelines Delivery¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17142]
• Predecessors: LDM-503-15a
• Successors: LDM-503-17
• Due: 2022-10-18
• Completion pending [DM-17143]

This milestone describes the final Science Pipelines release from the DM Construction Project. The contents of the release are described in LDM-564 [17]. The release will be accompanied by a characterization report.

LDM-503-16: Ops rehearsal for data release processing #3¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17138]
• Predecessors: DM-NCSA-26, LDM-503-15
• Successors: LDM-503-17
• Due: 2023-01-05
• Completion pending [DM-17139]

This milestone builds upon LDM-503-15 to demonstrate the production of a complete data release under simulated operational conditions.

LDM-503-17: Final operations rehearsal¶

• WBS: 02C.00
• Level: 2
• Test specification: Undefined [DM-17140]
• Predecessors: LDM-503-16, LDM-503-17a
• Successors: LSST-1590
• Due: 2023-02-03
• Completion pending [DM-17141]

This milestone builds upon LDM-503-16 to demonstrate successful operation of all aspects of the DM subsystem under simulated operational conditions.

DLP-639: Re-design camera geometry classes¶

• WBS: 02C.03.01
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-13

DLP-638: Refactor AFW R&D Code¶

• WBS: 02C.03.05
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-13

DLP-642: Camera Team using DM code¶

• WBS: 02C.03.01
• Level: 3
• Due: 2014-12-10
• Completed: 2014-12-10

DLP-644: Generalized Single Frame Astrometry Pipeline¶

• WBS: 02C.03.08
• Level: 3
• Due: 2015-02-24
• Completed: 2015-02-24

DLP-275: Deliver document on effects of DCR¶

• WBS: 02C.03.04
• Level: 3
• Successors: DLP-276
• Due: 2015-10-29
• Completed: 2016-04-08

DLP-276: Dipole measurement suite¶

• WBS: 02C.03.04
• Level: 3
• Predecessors: DLP-275
• Due: 2016-01-22
• Completed: 2016-07-12

DM-AP-1: Basic single frame measurement pipeline.¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-02, LDM-503-03, DM-AP-10
• Due: 2017-08-31
• Completed: 2017-11-01

DM-AP-2: Alard & Lupton-style image differencing.¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-03, LDM-503-09a, DM-AP-11
• Due: 2017-08-31
• Completed: 2017-11-01

DM-AP-3: Point source & dipole measurement on difference images.¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-03, LDM-503-09a, DM-AP-13
• Due: 2017-08-31
• Completed: 2017-11-01

DM-AP-4: DIASource association¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-03
• Due: 2017-08-31
• Completed: 2017-11-01

DM-AP-5: DIAObject generation¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-03
• Due: 2017-08-31
• Completed: 2017-11-01

DM-AP-7: Basic instrument signature removal (ISR) capability.¶

• WBS: 02C.03
• Level: 3
• Predecessors: F18S, DM-DRP-4
• Successors: LDM-503-09a
• Due: 2018-06-29
• Completed: 2018-06-29

DM-AP-9: JOINTCAL1: Jointcal at a functional level¶

• WBS: 02C.03
• Level: 3
• Predecessors: F18S
• Successors: LDM-503-09a, DM-DRP-17, DM-DRP-21
• Due: 2018-07-20
• Completed: 2018-11-29

DM-AP-8: Advanced ISR, including ghost and linear feature masking, correction for the Brighter-Fatter effect and compensation for pixel response non-uniformity.¶

• WBS: 02C.03
• Level: 3
• Predecessors: F18F
• Successors: LDM-503-11b
• Due: 2019-01-04
• Completed: 2019-01-17

DM-AP-11: Difference imaging includes noise decorrelation and correction for differential chromatic refraction.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM-AP-2
• Successors: LDM-503-13a, DM-AP-12, DM-DRP-28
• Due: 2019-11-27
• Completed: 2019-10-01

Template generation, including code required to build templates in both Data Release and Alert Production science payloads, can now product templates which are corrected for the effects of Differential Chromatic Refraction (DCR), as described in LDM-151 [22] §6.18. Further, noise in image differences can be “decorrelated”, as described in LDM-151 [22] §6.19.1. Both of these represents initial capabilities, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

DM-AP-6: Alert format defined & queue system available.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM-NCSA-8, DM-NCSA-9, F18S
• Successors: LDM-503-09a, DM-AP-14
• Due: 2020-05-29
• Completed: 2018-07-31

DM-AP-18: Alert packet generation¶

• WBS: 02C.03
• Level: 3
• Predecessors: S20F
• Successors: DM-NCSA-8
• Due: 2020-05-29
• Completed: 2020-05-31

The AP Pipeline is now capable of generating per-DIASource alert packets, which comply with the current version of the LSST alert schema. This milestone only covers packet generation; success involves only those serialized alerts being e.g. written to disk, and does not imply that an alert transport system is available.

DM-AP-10: Advanced single frame measurement pipeline for Alert Production.¶

• WBS: 02C.03
• Level: 3
• Predecessors: F20S, DM-AP-1
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

The Single Frame Processing system is now substantially complete and provides all functionality described in LDM-151 [22] §3.1. It supports all expected interfaces, data-flows, and products, but the details of the algorithms are expected to undergo continued refinement.

DM-AP-15: Alert distribution system fully integrated.¶

• WBS: 02C.03
• Level: 3
• Successors: DM16, LDM-503-15a, DM-AP-16
• Due: 2021-03-02
• Completion pending

The Alert Distribution system (LDM-151 [22] §3.3) is now available for deployment at the LSST Data Facility. The system is substantially complete, and supports all expected interfaces, data-flows, and products, but the details of the algorithms may undergo continued refinement.

DM-AP-12: Difference imaging is now agnostic to the PSF of the template image.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM-AP-11
• Successors: LDM-503-13a
• Due: 2021-05-07
• Completion pending

The Alert Generation science payload is now agnostic to the PSF of the template, as described in LDM-151 [22] §3.2.4. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-AP-13: Trailed source measurement on difference images.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM-AP-3
• Successors: LDM-503-13a
• Due: 2021-05-07
• Completion pending

The Alert Generation science payload now provides the capability to fit a trailed point source model to detections made on difference images, as described in LDM-151 [22] §3.2.4. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-AP-16: Full integration of the Alert Production system within the operational environment.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM-AP-15
• Successors: LDM-503-15a
• Due: 2021-10-28
• Completion pending

The Alert Production system (comprising Single Frame Processing, LDM-151 [22] §3.1; Alert Generation, LDM-151 [22] §3.3; and Precovery and Forced Photometry, LDM-151 [22] §3.4) is now available for deployment at the LSST Data Facility. The system is substantially complete, and supports all expected interfaces, data-flows and products, but the details of the algorithms may undergo continued refinement.

DM-AP-17: Moving object processing system (MOPS) available.¶

• WBS: 02C.03
• Level: 3
• Successors: LDM-503-15a, DM-DRP-36
• Due: 2021-12-16
• Completion pending

All of the algorithmic components which comprise the Moving Objects Processing System (MOPS), as described in LDM-151 [22] §§6.25–6.28, are available for integration into science payloads. These components must provide realistic interfaces, data-flows and products, but it is expected that the details of the algorithms will undergo continued refinement.

DM-AP-14: Alert filtering system available.¶

• WBS: 02C.03
• Level: 3
• Predecessors: DM7, F21F, DM-AP-6
• Successors: DM16
• Due: 2022-03-16
• Completion pending

The Alert Filtering Service (LDM-151 [22] §3.3.4; LSE-163 [14] §3.5.2) can now be deployed as part of a prototype Alert Distribution system (LDM-151 [22] §3.3). This service is substantially complete, and supports all expected interfaces, data-flows, and products, but may not yet provide the complete set of filtering capabilities and/or may not perform at the level required to distribute the full LSST alert stream.

DLP-588: AFW R&D code refactored¶

• WBS: 02C.04.01
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-715: Fundamental centroid and shape measurements¶

• WBS: 02C.04.06
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2015-12-04

DLP-697: Single epoch CModel minimization¶

• WBS: 02C.04.06
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-696: Single epoch Sersic model fitting¶

• WBS: 02C.04.06
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-724: Forced per-epoch photometry¶

• WBS: 02C.04.06
• Level: 3
• Due: 2014-09-12
• Completed: 2014-09-12

DLP-716: Fundamental flux measurements¶

• WBS: 02C.04.06
• Level: 3
• Due: 2014-09-12
• Completed: 2014-09-12

DLP-503: Prototype direct coaddition¶

• WBS: 02C.04.04
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-502: Prototype image artifact identification available¶

• WBS: 02C.04.04
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-101: Prototype coadd detection available¶

• WBS: 02C.04.05
• Level: 3
• Due: 2015-11-24
• Completed: 2016-04-11

DLP-73: Footprints redesigned and refactored¶

• WBS: 02C.04.01
• Level: 3
• Due: 2015-11-24
• Completed: 2017-05-09

DLP-700: Galaxy shear fitting parameters available¶

• WBS: 02C.04.06
• Level: 3
• Due: 2015-12-04
• Completed: 2016-05-31

DLP-288: HSC merger complete¶

• WBS: 02C.04.01
• Level: 3
• Due: 2015-12-29
• Completed: 2016-12-07

DLP-486: Prototype merge & deduplication in tract & patch overlaps¶

• WBS: 02C.04.05
• Level: 3
• Successors: DLP-566
• Due: 2016-02-29
• Completed: 2016-04-11

DLP-103: Prototype multi-coadd peak association available¶

• WBS: 02C.04.05
• Level: 3
• Successors: DLP-566
• Due: 2016-02-29
• Completed: 2016-04-11

DLP-100: Consistent multi-band deblending available¶

• WBS: 02C.04.05
• Level: 3
• Successors: DLP-566
• Due: 2016-02-29
• Completed: 2016-04-11

DLP-694: Prototype Brighter-Fatter correction available¶

• WBS: 02C.04.02
• Level: 3
• Successors: DMTC-0000-0020
• Due: 2016-05-31
• Completed: 2016-05-31

DM-DRP-1: HSC merger complete: all functionality deployed for the most recent HSC data release processing is now available within the LSST stack.¶

• WBS: 02C.04
• Level: 3
• Successors: DM-NCSA-1, DM-NCSA-16, LDM-503-02
• Due: 2017-05-31
• Completed: 2017-11-01

DM-DRP-4: Calibration product generation in support of basic ISR.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-07, DM-AP-7, DM-DRP-20
• Due: 2017-05-31
• Completed: 2017-12-01

DLP-736: Performance and capability enhancements in support of catalog use cases¶

• WBS: 02C.04.01
• Level: 3
• Predecessors: DMTC-0000-3000, S17F
• Successors: F17S
• Due: 2017-05-31
• Completed: 2016-12-19

DLP-152: Initial PSF-matched image coaddition available¶

• WBS: 02C.04.04
• Level: 3
• Predecessors: S17F
• Due: 2017-05-31
• Completed: 2016-12-19

DM-DRP-6: Camera package supporting the Auxiliary Telescope.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-08
• Due: 2017-08-31
• Completed: 2018-01-31

DM-DRP-14: Insertion of simulated sources into the data stream to check pipeline performance.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-11b
• Due: 2017-11-30
• Completed: 2017-12-01

DM-DRP-18: Initial multi-band deblending algorithm available.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-11b
• Due: 2017-11-30
• Completed: 2017-12-01

DM-DRP-16: Global photometric fitting (e.g. Burke et al. Forward Global Calibration Method).¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-09a
• Due: 2018-01-31
• Completed: 2018-05-31

DM-DRP-32: Object classification system available.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-09a
• Due: 2018-03-30
• Completed: 2018-10-31

DM-DRP-3: PSF-homogenized coadd construction.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: LDM-503-09a, DM-DRP-37
• Due: 2018-06-29
• Completed: 2017-11-01

DM-DRP-5: Camera package supporting the LSST Camera.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: LDM-503-09a
• Due: 2018-06-29
• Completed: 2018-06-29

DM-DRP-38: Camera package supporting the Commissioning Camera.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: LSST-1513, LDM-503-09a
• Due: 2018-06-29
• Completed: 2018-06-29

DM-DRP-7: Coordinate transformation tool provided for use with the Collimated Beam Projector.¶

• WBS: 02C.04
• Level: 3
• Successors: LDM-503-09a, T&SC-2100-2252
• Due: 2018-07-12
• Completed: 2018-07-05

DM-DRP-17: Simultaneous photometric and astrometric fitting to multiple exposures.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F, DM-AP-9
• Successors: LDM-503-09a
• Due: 2018-07-20
• Completed: 2018-11-29

DM-DRP-9: Data reduction pipeline for the Auxiliary Telescope.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: LDM-503-11b, DM-DRP-23
• Due: 2018-10-15
• Completed: 2019-03-25

DM-DRP-19: QA metrics are generated during pipeline execution.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: LDM-503-11b
• Due: 2018-11-29
• Completed: 2018-12-13

DM-DRP-2: Basic visualization and quality assessment tools operational on HSC-scale data volumes.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-NCSA-3, DM-DAX-5
• Successors: LDM-503-02
• Due: 2019-02-28
• Completed: 2017-11-01

DM-DRP-11: Pipelines code provides supports for database ingestion of results.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F
• Successors: F20F, DM-DAX-5
• Due: 2019-02-28
• Completed: 2019-12-31

The Data Release Production science payload now generates results which are compliant with the LSST Science Data Model, and which are suitable for database ingest.

DM-DRP-12: Background estimation over the full visit.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DAX-8
• Successors: LSST-1580
• Due: 2020-11-30
• Completed: 2020-06-30

DM-DRP-15: All varieties of coadd required for object detection and characterization are now produced during normal pipeline operation (although not necessarily at the ultimately required level of fidelity).¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DAX-9
• Successors: LDM-503-11b
• Due: 2020-11-30
• Completed: 2018-11-30

DM-DRP-8: Calibration product generation for the Auxiliary Telescope.¶

• WBS: 02C.04
• Level: 3
• Predecessors: S18F, COMC-060200-10000
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

The Calibration Products Production science payload is now capable of generating those products which are required to calibrate the Auxiliary Telescope. This represent an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

DM-DRP-13: PSF estimation over the full visit.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DAX-8
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

The Data Release Production science payload now includes code for estimating the PSF over the full focal plane, as described in LDM-151 [22] §6.11.3. This does not require that the PSF model be “physically motivated” (ie, decomposed into atmospheric and optical components). Further, this represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-37: Artifact rejection and background matching during coadd construction.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F18F, DM-DRP-3
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

The Data Release Production science payload now includes code for generating final estimates of the sky background and artifact masks, as described in LDM-151 [22] §5.2.2. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-22: Template generation integrated with Data Release Production pipelines.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F20S
• Successors: LDM-503-13a
• Due: 2020-12-01
• Completion pending

The Data Release Production science payload is now capable of generating templates for use in image differencing, as described in LDM-151 [22] §§5.2.3 & 5.2.4. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-24: Physically motivated PSF model, including separate characterization of contributions from the atmosphere and the telescope system.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F20S
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

Per LDM-151 [22] §6.11.3, the PSF model used by the Data Release Production science payload is now decomposed into separate contributions from the telescope optics and the atmosphere.

DM-DRP-29: Moving point source model fitting now available.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F18F
• Successors: LSST-1580
• Due: 2020-12-01
• Completion pending

The Data Release Production science payload now includes the capability of fitting moving a moving point source model that includes parallax and proper motion as free parameters to all objects, as described in LDM-151 [22] §6.7.2. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

DM-DRP-35: Simultaneous measurement across a suite of coadds representing different bandpasses, epocs, and flavors.¶

• WBS: 02C.04
• Level: 3
• Successors: DM-DRP-31
• Due: 2021-02-23
• Completion pending

The Data Release Production science payload now includes the capability to perform consistent measurement of all Objects in a patch across multiple coadds, as described in LDM-151 [22] §5.3.4. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

DM-DRP-26: Overlap resolution at tract & patch boundaries.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DRP-27
• Successors: LDM-503-13a
• Due: 2021-04-28
• Completion pending

The Data Release Production science payload is now capable of finalizing the definition of Objects which fall within the overlap regions at the edges of tracts and patches, as described in LDM-151 [22] §5.4. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-27: Object generation: association and assembly of (DIA, coadd, etc) sources to form objects.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DRP-28
• Successors: LDM-503-13a, DM-DRP-26
• Due: 2021-04-28
• Completion pending

The Data Release Production science payload now includes the capability to build Objects by cross-matching the Source and DIASource tables, as described in LDM-151 [22] §5.3.2. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-28: Difference images are now a first-class data product during data release processing.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-AP-11
• Successors: LDM-503-13a, DM-DRP-27
• Due: 2021-04-28
• Completion pending

The Data Release Production science payload now includes the capability to generate difference images, and to perform source detection and characterization on those images, as described in LDM-151 [22] §5.2.5. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-21: Integrated image characterization pipeline for Data Release Production.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-AP-9, DM-DAX-8, DM-DAX-9
• Successors: LSST-1580
• Due: 2021-06-02
• Completion pending

The Data Release Production science payload now includes an integrated image characterization pipeline, as described in LDM-151 [22] §5.1, including iterative refinement of the image characterization. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-30: Forced photometry is now performed on individual processed visit images during data releases.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F20F
• Successors: LDM-503-13a
• Due: 2021-06-02
• Completion pending

The Data Release Production science payload now includes the capability of performing “forced” photometry at the positions of known Objects on Processed Visit Images, as described in LDM-151 [22] §5.5.2. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-25: Prototype multi-epoch fitting system available.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F20F, DM-DAX-10
• Successors: DM7, LDM-503-13a
• Due: 2021-06-02
• Completion pending

A prototype of the “MultiFit” multi-epoch fitting is now available for testing. This provides the capabilities described in LDM-151 [22] §5.5.1, but it is not necessarily integrated with the Data Release Production science payload (i.e., it may not be run in regular dataset reprocessing, and it may require separate/additional scripts or ancillary artifacts).

DM-DRP-34: Selection maps are generated during data releases.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F20F
• Successors: LDM-503-13a
• Due: 2021-06-02
• Completion pending

The Data Release Production science payload now includes the capability of generating multi-scale maps that describe LSST’s depth and efficiency at detecting different classes of object as part of a data release, as described in LDM-151 [22] §5.6.3. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithms being used is expected.

DM-DRP-31: A photometric redshift is now provided for each object.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DRP-35
• Successors: DM-DRP-36
• Due: 2021-08-30
• Completion pending

The Data Release Production science payload now includes the capability of calculating photometric redshifts as part of a data release, as (briefly) described in LDM-151 [22] §5.6.5. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-23: Atmospheric characterization based on data from the Auxiliary Telescope now available.¶

• WBS: 02C.04
• Level: 3
• Predecessors: F21S, DM-DRP-9, COMC-060200-10000
• Successors: LSST-1580
• Due: 2021-08-31
• Completion pending

The Calibration Products Production science payload is now capable of producing an atmospheric transmission model based on observations from the Auxiliary Telescope, as described in LDM-151 [22] §4.6.1. This milestone does not presume that the Auxiliary Telescope itself is available for testing: it is satisfied by the availability of a pipeline that can process appropriate simulated or precursor data. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-36: MOPS integrated to data release processing.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-AP-17, DM-DRP-31
• Successors: LSST-1580
• Due: 2021-12-16
• Completion pending

The Data Release Production science payload now generates SSObjects, by delegating to the Moving Objects Processing System (MOPS) being delivered by the Alert Production team, as described in LDM-151 [22] §5.6.1. This represents an initial capability, providing realistic interfaces, data-flows and products; ongoing refinement of the algorithm being used is expected.

DM-DRP-20: Refined set of LSST calibration products.¶

• WBS: 02C.04
• Level: 3
• Predecessors: DM-DRP-4, COMC-0100
• Successors: LSST-1580
• Due: 2022-03-14
• Completion pending

The Calibration Products Production science payload is now capable of generating all calibration products which are required to enter commissioning.

DLP-578: Propose a workspace structure for discussion.¶

• WBS: 02C.05.05
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-574: Evaluate best-of-breed tools. Technology exploration.¶

• WBS: 02C.05.01
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-575: Evaluate best-of-breed tools. Technology exploration.¶

• WBS: 02C.05.02
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-576: Evaluate best-of-breed tools. Technology exploration.¶

• WBS: 02C.05.03
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-577: Evaluate best-of-breed tools. Technology exploration.¶

• WBS: 02C.05.04
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-519: Research the development framework for SUI¶

• WBS: 02C.05.01
• Level: 3
• Due: 2014-10-14
• Completed: 2014-10-14

DLP-520: Access Qserv for catalog search in SUI prototype¶

• WBS: 02C.05.01
• Level: 3
• Due: 2014-12-02
• Completed: 2014-12-02

DLP-521: Define the data access APIs with database team¶

• WBS: 02C.05.01
• Level: 3
• Due: 2015-03-11
• Completed: 2015-03-11

DLP-518: Evaluate best-of-breed tools. Technology exploration.¶

• WBS: 02C.05.05
• Level: 3
• Due: 2015-03-20
• Completed: 2015-03-20

DLP-564: Able to use some data-access APIs developed by database team¶

• WBS: 02C.05.01
• Level: 3
• Due: 2015-07-28
• Completed: 2015-11-17

DLP-256: First draft definition of workspace¶

• WBS: 02C.05.05
• Level: 3
• Due: 2015-07-31
• Completed: 2015-11-17

DLP-218: Provide API for image display in Firefly¶

• WBS: 02C.05.02
• Level: 3
• Due: 2015-08-31
• Completed: 2015-11-17

DLP-216: Provide basic APIs to use Firefly visualization components¶

• WBS: 02C.05.02
• Level: 3
• Due: 2015-08-31
• Completed: 2016-11-02

DLP-872: Convert major portion of GWT in Firefly to pure JavaScript¶

• WBS: 02C.05.01
• Level: 3
• Due: 2016-02-24
• Completed: 2016-04-08

DM-SUIT-3: Time series analysis tool for WISE data¶

• WBS: 02C.05
• Level: 3
• Successors: LDM-503-01
• Due: 2016-09-30
• Completed: 2017-11-30

DLP-871: Firefly server side code refactor¶

• WBS: 02C.05.01
• Level: 3
• Predecessors: DMTC-0000-0030
• Successors: S17S
• Due: 2016-11-30
• Completed: 2017-07-31

DM-SUIT-2: Search WISE coaded data single exposure images in PDAC (the images are from IRSA at IPAC, not NCSA)¶

• WBS: 02C.05
• Level: 3
• Predecessors: DM-DAX-2
• Successors: LDM-503-01
• Due: 2017-07-31
• Completed: 2017-11-30

DM-SUIT-1: Search and display WISE sources (objects) in PDAC¶

• WBS: 02C.05
• Level: 3
• Predecessors: DM-DAX-1
• Successors: LDM-503-01
• Due: 2017-11-30
• Completed: 2017-11-30

DM-SUIT-4: Multiple data traces in chart space¶

• WBS: 02C.05
• Level: 3
• Successors: LDM-503-01
• Due: 2017-11-30
• Completed: 2017-11-30

DLP-207: Extra LSST query capabilities in web UI¶

• WBS: 02C.05.01
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-08-01

DLP-205: LSST web UI search external catalog¶

• WBS: 02C.05.01
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-08-01

DLP-222: Provide time-domain data view¶

• WBS: 02C.05.02
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-08-01

DM-SUIT-8: SUIT portal integrated with workspace¶

• WBS: 02C.05
• Level: 3
• Successors: DM-SUIT-10
• Due: 2018-11-30
• Completed: 2020-05-29

Portal is integrated with LSST-provided WebDAV or VOSpace service exposing the User File Workspace. Portal provides functions for saving image and catalog query results to the logged-in user’s workspace, with the user’s identity correctly applied. Portal provides functions for accessing data in the user’s workspace and displaying it using the Portal’s image and table visualization tools, as well as using data from the workspace in other Portal contexts where a file can be uploaded, e.g., to perform a multi-object query. (NB: Still achievable post-DM-10, though only with WebDAV.).

DM-SUIT-7: Mapping between SUIT systems & NCSA auth system¶

• WBS: 02C.05
• Level: 3
• Predecessors: S19F
• Successors: DM-SUIT-10
• Due: 2019-05-31
• Completed: 2019-05-31

Portal is integrated with NCSA-provided federated-identity authentication and authorization system: the Portal recognizes that a user is logged in and displays that state, and passes the user’s identity along to LSST data services that it accesses. (NB: Still achievable post-DM-10) Claimed in May, based on installation on lsst-lsp-int.

DM-SUIT-10: SUIT deployment procedure¶

• WBS: 02C.05
• Level: 3
• Predecessors: S19F, DM-SUIT-7, DM-SUIT-8
• Successors: LDM-503-11a
• Due: 2019-05-31
• Completed: 2020-06-30

Portal software is adapted for deployment in Kubernetes. The set of container images required for deployment is documented in an LTD-style manner. Configuration files for Kubernetes are provided in Github and documented to a level that permits deployments to be performed by non-IPAC staff. (NB: Still achievable post-DM-10).

DM-SUIT-5: Search and display processed HSC data¶

• WBS: 02C.05
• Level: 3
• Predecessors: DM-NCSA-2, DM-NCSA-3, DM-DAX-2, DM-DAX-5
• Successors: LDM-503-09
• Due: 2020-12-01
• Completion pending

Portal provides access to a collection of public-release HSC data processed by LSST DM, including calibrated single-epoch images, coadds, and catalogs (including at least an Object-like catalog). Access is obtained via IVOA interfaces including TAP for catalogs and ObsTAP for image metadata. (NB: Still achievable post-DM-10).

DLP-836: New logging for DM¶

• WBS: 02C.06.02
• Level: 3
• Predecessors: LSST-1440
• Due: 2014-08-01
• Completed: 2015-11-17

DLP-835: New xrootd client¶

• WBS: 02C.06.02
• Level: 3
• Predecessors: DLP-834
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-834: Automated Testbed for Qserv¶

• WBS: 02C.06.02
• Level: 3
• Predecessors: LSST-1440
• Successors: DLP-835
• Due: 2014-08-01
• Completed: 2014-08-01

DLP-818: CSS¶

• WBS: 02C.06.02
• Level: 3
• Due: 2014-11-25
• Completed: 2015-11-17

DLP-801: Qserv uses C++-based Geometry Code¶

• WBS: 02C.06.02
• Level: 3
• Due: 2014-11-25
• Completed: 2015-11-17

DLP-817: Multi-node Multi-query Integration Testing Harness¶

• WBS: 02C.06.02
• Level: 3
• Due: 2015-05-29
• Completed: 2015-11-17

DLP-800: Data Ingest into MySQL¶

• WBS: 02C.06.01
• Level: 3
• Due: 2015-05-29
• Completed: 2015-11-17

DLP-25: Prototype Web Service for SUI¶

• WBS: 02C.06.02
• Level: 3
• Due: 2015-08-31
• Completed: 2015-09-01

DLP-805: Distributed Database and Table Management¶

• WBS: 02C.06.02
• Level: 3
• Due: 2015-10-29
• Completed: 2015-10-29

DLP-635: Qserv Query Cancellation¶

• WBS: 02C.06.02
• Level: 3
• Due: 2015-11-25
• Completed: 2016-01-12

DLP-649: Shared Scans¶

• WBS: 02C.06.02
• Level: 3
• Due: 2016-02-24
• Completed: 2017-05-26

DLP-472: Qserv Data Distribution¶

• WBS: 02C.06.02
• Level: 3
• Predecessors: DMTC-0000-3000, S17F
• Due: 2017-05-31
• Completed: 2018-06-29

DM-DAX-2: Query service supporting IVOA TAP protocol, w/ support for asynchronous queries¶

• WBS: 02C.06
• Level: 3
• Successors: LDM-503-09, LDM-503-10a, DM-SUIT-2, DM-SUIT-5
• Due: 2017-07-31
• Completed: 2019-11-29

An IVOA TAP service supporting both synchronous and asynchronous query models, integrated with the LSP authentication architecture, and able to access catalog data hosted in a downstream in Qserv instance.

DM-DAX-1: WISE data ingest to PDAC¶

• WBS: 02C.06
• Level: 3
• Successors: LDM-503-01, DM-SUIT-1
• Due: 2017-11-30
• Completed: 2017-11-01

DM-DAX-6: Prototype level 1 database¶

• WBS: 02C.06
• Level: 3
• Successors: DM-NCSA-9, LDM-503-03
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-473: Async Queries in Qserv¶

• WBS: 02C.06.02
• Level: 3
• Predecessors: S17F, F17F
• Successors: DLP-725
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-725: Working Prototype of AP/L1 Database¶

• WBS: 02C.06.01
• Level: 3
• Predecessors: F17F, DLP-473
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-837: AP-ready Butler Framework¶

• WBS: 02C.06.02
• Level: 3
• Successors: F20F
• Due: 2017-12-01
• Completed: 2019-08-30

DM-DAX-11: Transformed EFD schema¶

• WBS: 02C.06
• Level: 3
• Successors: LSST-1580
• Due: 2018-03-30
• Completed: 2018-05-31

DM-DAX-10: Per-object gather support in Butler¶

• WBS: 02C.06
• Level: 3
• Predecessors: F18F
• Successors: DM-DRP-25
• Due: 2018-11-30
• Completed: 2019-11-29

Demonstrate Butler configuration able to gather all data pertaining to a particular object, such as retrieving cutous from all warps at a given bbox on a skymap.

DM-DAX-7: Generation 3 Butler, running on a POSIX file-system provided by NCSA¶

• WBS: 02C.06
• Level: 3
• Predecessors: DM-DAX-12
• Due: 2020-11-30
• Completed: 2020-06-30

Given a stood-up data backbone instance, demonstrate instantiation/configuration of a Butler Gen3 instance capable of retrieving images from that backbone instance. (As currently conceived, the data backbone is either a GPFS filesystem or object store, in combination with metadata that is a superset of that maintained in a Butler Gen3 registry. Depending on particular technologies and implementation strategies chosen for the data backbone, this may be either a “simple matter of configuration” of existing Butler connectors, or may require some additional custom connectors to be written.).

DM-DAX-8: Scatter-gather support in PipelineTask¶

• WBS: 02C.06
• Level: 3
• Predecessors: F18F, DM-DAX-12
• Successors: DM-DRP-12, DM-DRP-13, DM-DRP-21
• Due: 2020-11-30
• Completed: 2020-06-30

Demonstrate a functional PipelineTask with scatter/gather functionality, such as Jointcal, SkyCorrect, or FGCM.

DM-DAX-5: Database ingest in support of HSC reprocessing (ie, large catalog ingest)¶

• WBS: 02C.06
• Level: 3
• Predecessors: DM-DRP-11
• Successors: DM-NCSA-3, LDM-503-09, DM-SUIT-5, DM-DRP-2
• Due: 2020-12-01
• Completion pending

Existing Qserv ingest tooling is highly manual and poorly parallellized. Develop new tooling to address these issues and support ingest campaigns at the scale needed for DRP.

DLP-802: Alert Production Database (APDB) design¶

• WBS: 02C.06.01
• Level: 3
• Due: 2020-12-01
• Completion pending

DM-DAX-9: Provenance system¶

• WBS: 02C.06
• Level: 3
• Predecessors: F18F, DM-DAX-12, DM-DAX-14
• Successors: LDM-503-09, DM-DRP-15, DM-DRP-21
• Due: 2021-06-02
• Completion pending

DM-DAX-12: Generation 3 middleware at feature parity with Generation 2¶

• WBS: 02C.06
• Level: 3
• Predecessors: F20F
• Successors: DM-NCSA-15, DM-NCSA-22, DM-DAX-7, DM-DAX-8, DM-DAX-9, DM-DAX-13
• Due: 2021-06-02
• Completion pending

Generation 3 middleware, consisting of Butler updates and the PipelineTask framework, are now able to support existing science payloads with no loss of functionality over previous versions. That is, Gen 3 may not be feature complete, but Gen 2 can be retired with no functionality regressions across the subsystem.

DM-DAX-14: Provenance system review completed¶

• WBS: 02C.06
• Level: 3
• Predecessors: F20F
• Successors: DM-DAX-9
• Due: 2021-06-02
• Completion pending

DM-DAX-13: Generation 2 middleware retired¶

• WBS: 02C.06
• Level: 3
• Predecessors: S21F, DM-DAX-12
• Successors: LSST-1580
• Due: 2021-08-30
• Completion pending

The Generation 2 middleware is deprecated, and may be removed from the codebase. No current science payload and no current execution service makes use of it.

DLP-359: Improve fault tolerance in AP simulator¶

• WBS: 02C.07.01
• Level: 3
• Due: 2014-11-19
• Completed: 2014-11-19

DLP-360: Prepare for OCS Middleware integration with AP DMCS¶

• WBS: 02C.07.01
• Level: 3
• Due: 2014-11-21
• Completed: 2014-11-21

DLP-422: Evaluate OpenStack as a development environment¶

• WBS: 02C.07.03
• Level: 3
• Due: 2015-01-29
• Completed: 2015-01-29

DLP-450: Support lsst-dev for developers¶

• WBS: 02C.07.04
• Level: 3
• Due: 2015-02-02
• Completed: 2015-02-02

DLP-449: Upgrade storage server hardware¶

• WBS: 02C.07.04
• Level: 3
• Due: 2015-02-02
• Completed: 2016-07-15

DLP-400: Refactor basic event services¶

• WBS: 02C.07.02
• Level: 3
• Successors: DLP-556
• Due: 2015-05-28
• Completed: 2015-01-26

DLP-441: Base Center requirements document¶

• WBS: 02C.07.04
• Level: 3
• Due: 2015-05-29
• Completed: 2015-05-29

DLP-451: Deploy OpenStack capability¶

• WBS: 02C.07.04
• Level: 3
• Due: 2015-07-30
• Completed: 2015-07-30

DLP-356: Set up Joint Coordination Council (JCC) for coordination with satellite processing center¶

• WBS: 02C.07.00
• Level: 3
• Due: 2015-08-26
• Completed: 2015-08-26

DLP-361: Build prototype AP DMCS, including events¶

• WBS: 02C.07.01
• Level: 3
• Due: 2015-08-26
• Completed: 2015-08-26

DLP-355: Establish MOA with CC-IN2P3 satellite processing center¶

• WBS: 02C.07.00
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-404: Identify candidate security packages¶

• WBS: 02C.07.02
• Level: 3
• Due: 2015-08-31
• Completed: 2016-06-07

DLP-410: Implement Puppet for system configuration management¶

• WBS: 02C.07.02
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-415: Evaluate iRODS, Datacat, and similar file system management technologies¶

• WBS: 02C.07.02
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-423: DevOps assessment¶

• WBS: 02C.07.03
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-430: Initial refinement of facility integration plan¶

• WBS: 02C.07.04
• Level: 3
• Due: 2015-08-31
• Completed: 2015-08-31

DLP-357: Initial refinement of facility integration plan¶

• WBS: 02C.07.01
• Level: 3
• Successors: DLP-358
• Due: 2015-09-29
• Completed: 2016-06-15

DLP-389: Implement advanced logging functionality, including event-based logging¶

• WBS: 02C.07.01
• Level: 3
• Successors: DLP-566
• Due: 2015-09-29
• Completed: 2015-09-29

DLP-452: Support datasets on basic file system infrastructure with apropos policies¶

• WBS: 02C.07.04
• Level: 3
• Due: 2016-01-22
• Completed: 2016-07-15

DLP-411: Monitor OpenStack¶

• WBS: 02C.07.02
• Level: 3
• Successors: DLP-412
• Due: 2016-02-05
• Completed: 2016-06-07

DLP-850: Prototype authentication/authorization system complete¶

• WBS: 02C.07.02
• Level: 3
• Successors: S17S
• Due: 2016-02-22
• Completed: 2016-06-07

DLP-405: Investigate CAS integration with Internet2 AAA tools¶

• WBS: 02C.07.02
• Level: 3
• Successors: S17S
• Due: 2016-02-22
• Completed: 2016-07-15

DLP-469: Coordination with NCSA/CC-IN2P3 JCC¶

• WBS: 02C.07.00
• Level: 3
• Successors: DLP-864
• Due: 2016-02-24
• Completed: 2016-06-07

DLP-358: Refinement of facility integration plan and traceability of science and operational requirements¶

• WBS: 02C.07.01
• Level: 3
• Predecessors: DLP-357
• Due: 2016-02-24
• Completed: 2016-04-08

DLP-364: Build prototype production sequence for the DMCS¶

• WBS: 02C.07.01
• Level: 3
• Successors: DLP-566
• Due: 2016-02-24
• Completed: 2016-06-07

DLP-471: Refresh sizing model¶

• WBS: 02C.07.04
• Level: 3
• Due: 2016-02-24
• Completed: 2016-06-07

DLP-431: Refinement of facility integration plan and traceability of science and operational requirements¶

• WBS: 02C.07.04
• Level: 3
• Due: 2016-02-24
• Completed: 2016-07-15

DLP-424: Integration of DevOps to OpenStack¶

• WBS: 02C.07.03
• Level: 3
• Due: 2016-02-29
• Completed: 2016-07-15

DLP-847: Meet camera DAQ/OCS milestones for FY16¶

• WBS: 02C.07.01
• Level: 3
• Predecessors: DMTC-0000-0030
• Successors: F17F
• Due: 2016-11-30
• Completed: 2017-09-01

DLP-366: Mid-scale processing of eligible camera data¶

• WBS: 02C.07.01
• Level: 3
• Predecessors: DMTC-0000-0030
• Successors: F17F
• Due: 2016-11-30
• Completed: 2017-11-01

DLP-412: Monitor development cluster¶

• WBS: 02C.07.02
• Level: 3
• Predecessors: DLP-411, DMTC-0000-0030
• Successors: S18S
• Due: 2016-11-30
• Completed: 2017-09-01

DM-NCSA-1: Provide regular reprocessing service for HSC data¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-DRP-1
• Successors: DM-NCSA-2, LDM-503-02
• Due: 2017-05-31
• Completed: 2017-11-01

DM-NCSA-2: Provide access to results of regular reprocessing (NB the form this takes depends upon available DAX functionality)¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-NCSA-1
• Successors: LDM-503-02, DM-SUIT-5
• Due: 2017-05-31
• Completed: 2017-11-01

DM-NCSA-28: IIP control code¶

• WBS: 02C.07
• Level: 3
• Successors: DM-NCSA-29, LSST-1190
• Due: 2017-09-29
• Completed: 2017-11-01

DLP-864: Coordination with NCSA/CC-IN2P3 JCC¶

• WBS: 02C.07.00
• Level: 3
• Predecessors: DLP-469
• Successors: S18F
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-368: Initial AP DMCS¶

• WBS: 02C.07.01
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-459: Qserv capability to hold data reduced at NCSA¶

• WBS: 02C.07.04
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-07-25

DLP-458: Ingest of bulk data from real cameras to ComCam scale¶

• WBS: 02C.07.04
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-10-18

DLP-457: Support runs on real cameras data and ImSim data¶

• WBS: 02C.07.04
• Level: 3
• Predecessors: F17F
• Successors: S18S
• Due: 2017-11-30
• Completed: 2017-11-01

DLP-442: Procure infrastructure for Base Center to meet FY18 goals¶

• WBS: 02C.07.04
• Level: 3
• Predecessors: F17F
• Due: 2017-11-30
• Completed: 2018-04-30

DLP-433: Procure infrastructure for Archive Center to FY18 scale¶

• WBS: 02C.07.04
• Level: 3
• Predecessors: F17F
• Due: 2017-11-30
• Completed: 2018-04-30

DMTC-4500-0010: Start NCSA S18¶

• WBS: 02C.07
• Level: 3
• Due: 2017-12-01
• Completed: 2017-12-01

Time-based milestone marking the start of NCSA’s Spring 2018 development cycle.

DM-NCSA-27: Deliver header service code¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-04b, LSST-1160
• Due: 2017-12-29
• Completed: 2017-12-01

DM-NCSA-29: Deliver IIP image client code¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-NCSA-28
• Successors: LSST-1200
• Due: 2017-12-29
• Completed: 2018-03-31

DM-NCSA-6: Ability to transfer files originating from Tucson to NCSA and ingest files at NCSA, including metadata and provenance¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-04b
• Due: 2018-03-05
• Completed: 2018-10-31

DM-NCSA-5: Level 1 archiving system able to acquire pixel data from the Aux Tel DAQ, header metadata via OCS, assemble FITS image,¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-04b
• Due: 2018-03-30
• Completed: 2018-05-31

DM-NCSA-7: Capability to paint displays for Tucson and NCSA¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-04b
• Due: 2018-03-30
• Completed: 2018-06-29

DM-NCSA-9: Test instance of alert distribution hosting service and L1 database in Development & Integration Enclave¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-DAX-6
• Successors: LDM-503-05, DM-AP-6
• Due: 2018-08-31
• Completed: 2019-05-31

Hosting an instance of the alert distribution service delivered from University of Washington on our test containerized application management service platform, running feeds from the pipeline to the distribution services. Note: This was informally tied to LDM-503-05, which was de-scoped to a small demonstration of running an instance of Kafka at NCSA, so no L1 database was needed. We believe this was completed in August 2018.

DM-NCSA-10: Sustained archiving service that is OCS commandable¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-06
• Due: 2018-09-25
• Completed: 2019-05-31

The capability to use the existing OCS/CCS to command data acquisition and hand-off to a test Observatory Operations Data Service (OODS).

DM-NCSA-3: Provide database for metadata, provenance, location and demonstrate ingest at small scale¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-DAX-5
• Successors: DM-NCSA-4, LDM-503-02, DM-SUIT-5, DM-DRP-2
• Due: 2019-02-28
• Completed: 2017-11-01

DM-NCSA-4: Minimal support for the small operational schema including file metadata and provenance for every file, and record of in¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-NCSA-3, LDM-503-02
• Successors: LDM-503-04
• Due: 2019-02-28
• Completed: 2018-06-29

DM-NCSA-16: Perform ISR processing on ComCam-scale data.¶

• WBS: 02C.07
• Level: 3
• Predecessors: DM-DRP-1
• Successors: LDM-503-09, LDM-503-11, LDM-503-11a
• Due: 2019-03-29
• Completed: 2019-06-13

Process ComCam-scale data through the ISR pipeline to generate QC parameters used by the observatory.

A5090: Expected Arrival of ComCam Systems to NCSA¶

• WBS: 02C.07.09
• Level: 4
• Predecessors: T&SC-6500-8100
• Due: 2019-05-08
• Completed: 2019-04-30

Arrival at NCSA of hardware to support ComCam testing and integration.

DM-NCSA-13: Header Writing Service for Spectrograph use case¶

• WBS: 02C.07
• Level: 3
• Successors: LDM-503-08
• Due: 2019-05-14
• Completed: 2019-05-31

The Header builder integrated into OCS and demonstrated. Header builder has identified sources of information for all modes of observing with the Spectrograph.

A4640: Ship ComCam Hardware to Tucson¶

• WBS: 02C.07.09
• Level: 4
• Due: 2019-06-20
• Completed: 2019-06-27

Date for ComCam support systems to ship from NCSA to Tucson.

A2330: Ship AA System to Chile¶

• WBS: 02C.07.09
• Level: 4
• Due: 2019-06-28
• Completed: 2019-06-28

Date for Authenticaton and Authorization hardware to ship from NCSA to Chile.

A4369.9: Ship Hardware to BDC¶

• WBS: 02C.07.09
• Level: 4
• Successors: A4670
• Due: 2019-07-15
• Completed: 2019-07-17

Date for Base Data Center hardware to ship from NCSA to Chile.

DM-NCSA-11: Verified acquisition of raw and crosstalk-corrected exposures at raft scale, incl. correct metadata¶

• WBS: 02C.07
• Level: 3
• Predecessors: F18F, T&SC-5900-0400
• Successors: DLP-552, LDM-503-06
• Due: 2019-07-29
• Completed: 2020-06-30

Exercise the handoff between the L1 archiving and data backbone endpoint, including a monitoring service that tracks files that have been transfered and received.

A4860: ComCam Systems in Tucson ready for NCSA¶

• WBS: 02C.07.09
• Level: 4
• Successors: LDM-503-09, A5860
• Due: 2019-08-14
• Completed: 2019-08-01

ComCam Test Stand ready for access by NCSA staff.

A4680: June 2019 Travel to Chile - Travel End¶

• WBS: 02C.07.09
• Level: 4
• Successors: LDM-503-09
• Due: 2019-08-16
• Completed: 2019-08-24

End of travel to Chile to install hardware and systems at the Base Data Center.

A4670: June 2019 Travel to Chile - Travel Start¶

• WBS: 02C.07.09
• Level: 4
• Predecessors: A4369.9
• Due: 2019-08-17
• Completed: 2019-08-17

Start of travel to Chile to install hardware and systems at the Base Data Center.

A4750: Summit AA Systems Installed at the Summit¶

• WBS: 02C.07.09
• Level: 4
• Due: 2019-08-29
• Completed: 2019-08-29