Science Data Model Schemas

This schema browser provides a view on a curated subset of the Rubin Observatory’s database schemas for user-facing data products (the Science Data Model, or SDM). These pages are rendered directly from the latest revisions of schema definition YAML files maintained in the sdm_schemas GitHub repository.

Schemas available here for browsing include:

  • Release Notes

    v29.0.0 (2025-03-31)

    Data Release

    • Ensure (tract, patch) are always displayed, visually, in that order in DP catalogs. (DM-43996)

    Science Pipelines

    • Updated description of extendedness column. (DM-46681)
    • Added dipoleFitAttempted flag. (DM-48106)
    • Separated EDGE and NO_DATA pixel flags. (DM-45621)
    • Removed STREAK mask columns. (DM-46933)
    • Removed calib_detected column from Source table. (DM-46991)
    • Removed localWcs and localPhotoCalib columns from ImSim Sources table. (DM-48117)
    • Added contributor documentation for DRP schemas. (DM-48178)
    • Added multiprofit two-Gaussian PSF and Sersic columns. (DM-48591)

    Alert Production

    • Updated description of extendedness column. (DM-46681)
    • Added dipoleFitAttempted flag. (DM-48106)
    • Separated EDGE and NO_DATA pixel flags. (DM-45621)
    • Added nDiaSources column to DiaObjectLast table. (DM-44098)
    • Added column with is_negative flag. (DM-48437)

    Consolidated Database

    • Added several missing ConsDB schemas to the schema browser. (DM-46895)
    • Added pixelScale and PSF model delta metric columns. (DM-47002)
    • Updated units in cdb_lsstcomcam.visit1_quicklook. (DM-47044)
    • Added electron UCDs in cdb_lsstcomcam. (DM-47308)
    • Moved mount and jitter columns to exposure_quicklook table. (DM-47443)

    Miscellaneous

    • Added Python packaging with support for resource paths. (DM-46273)
    • Improved the schema browser. (DM-41867)
    • Added toggle for table pagination in the schema browser. (DM-46982)
    • Add EUPS and SCons configuration for resource path support. (DM-47069)
    • Moved YAML files into Python source tree. (DM-47147)
    • Fixed problems with GitHub build workflow. (DM-47403)
    • Added workflow to perform schema comparisons and check for changes to deployed schemas. (DM-46158)
    • Added GitHub workflow that runs extra validation checks. (DM-47844)
    • Added contribution guide and pull request template. (DM-48013)
    • Changed the TAP_SCHEMA build to use the new Felis command load-tap-schema. (DM-46957)
    • Added api_created field to tap_schema.schemas table definition. (DM-48979)
    • Added the sdm_tools dependency, which provides a new command line utility for processing schema files. Ported the script for generating the Datalink snippets to the new repository. (DM-41290)
    • Added support for towncrier. (DM-49711)

    v28.0.0 (2025-01-23)

    Data Release

    • Added missing primary keys to DP0.2. (DM-43115)
    • Removed DP0.1 from TAP_SCHEMA and DataLink builds. (DM-44884)
    • Fixed lengths and datatypes of string columns. (DM-43946)
    • Added missing precision values on timestamps. (DM-44825)
    • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
    • Removed length fields and type overrides from timestamp columns. (DM-44059)
    • Removed unused mysql:datatype overrides on string columns. (DM-44637)
    • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
    • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
    • Removed redundant mysql:datatype overrides for Felis boolean types. (DM-43958)
    • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

    Science Pipelines

    • Fixed lengths and datatypes of string columns. (DM-43946)
    • Migrated from ccdVisitId to (visit, detectors). (DM-42435)
    • Added invalidPsfFlag column. (DM-44167)
    • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
    • Removed length fields and type overrides from timestamp columns. (DM-44059)
    • Added pixelScale to visitSummary and ccdVisit tables. (DM-44854)
    • Added psfApCorrDelta and psfApFluxDelta metrics to exposure summaries. (DM-37952)
    • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
    • Added normalized, compensated tophat fluxes to Source tables. (DM-38632)
    • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
    • Removed redundant mysql:datatype overrides for Felis boolean types. (DM-43958)
    • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

    Alert Production

    • Corrected column value fields to use correct type, so 0 instead of "0". (DM-46073)
    • Migrated from ccdVisitId to (visit, detectors). (DM-42435)
    • Added individual flag fields. (DM-41530)
    • Removed placeholder time series feature columns from DiaObject table. (DM-44092)
    • Removed length fields and type overrides from timestamp columns. (DM-44059)
    • Added ra and dec and removed x and y from DiaForcedSource. (DM-44470)
    • Added psfApCorrDelta and psfApFluxDelta metrics to exposure summaries. (DM-37952)
    • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
    • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
    • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

    Consolidated Database

    • Implemented multi-column primary key wth day_obs and seq_num. (DM-46073)
    • Added exposure_quicklook table to LATISS and ComCam. (DM-46628)
    • Added StarTracker schemas. (DM-45893)
    • Added mount jitter to LATISS and ComCam. (DM-46009)
    • Added magnitude limit columns from exposure summary stats. (DM-45573)
    • Added postisr_pixel_median columns. (DM-45848)
    • Made constraint names unique. (DM-45623)
    • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
    • Added vignette columns. (DM-44967)
    • Updated descriptions for eff_time_*_scale columns. (DM-44958)
    • Updated descriptions for eff_time metric columns. (DM-44955)
    • Added a representative ConsDB schema. (DM-44161)
    • Added CcdExposure tables and LSSTComCamSim schema. (DM-44429)
    • Added visit1 and ccdvisit1 tables. (DM-44489)

    Miscellaneous

    • Changed the TAP_SCHEMA workflow to set the schema index with a command line argument to Felis. (DM-42935)
    • Added redundant datatype checks to validation workflow. (DM-44058)
    • Deleted UWS creation script from tap-schema/sql directory. (DM-45099)
    • Removed DP0.1 from TAP_SCHEMA on IDF int and dev. (ÄDM-44884Å(https://jira.lsstcorp.org/browse/DM-44884))
    • Added database tests to GitHub workflows. (DM-44158)
    • Updated the schema browser to use LTD. (DM-41310)
  • Data Preview 0.3

    Data Preview 0.3 (ten-year version): Contains the catalog products of a Solar System Science Collaboration simulation of the results of SSO analysis of the wide-fast-deep data from the full LSST ten-year dataset.

  • Data Preview 0.2

    Data Preview 0.2 contains the image and catalog products of the Rubin Science Pipelines v23 processing of the DESC Data Challenge 2 simulation, which covered 300 square degrees of the wide-fast-deep LSST survey region over 5 years.

  • Alert Production Database

    The Alert Production Database (APDB) contains the catalogs resulting from image differencing during nightly Prompt Processing as well as the results of daily Solar System Processing.

  • HyperSuprimeCam

    The HyperSuprimeCam (HSC) Schema describes the outputs of the latest data release production pipelines for HyperSuprimeCam. This schema is used by ci_hsc, which verifies the schema of the pipeline output files.

  • LSSTCam ImSim

    The ImSim Schema describes the Science Pipelines outputs for on Imsim simulated full-focal-plane LSSTCam data. The data preview dataset schemas (e.g. DP01, DP02) are derived from this one, but are fixed at the time of that data release.

  • ConsDB - LATISS

    The Consolidated Database for LATISS schema contains information for each exposure and visit taken by the instrument, an imaging slitless spectrometer mounted on the Rubin Observatory Auxiliary Telescope. This includes observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

  • ConsDB - LSSTComCam

    The Consolidated Database for LSSTComCam schema contains information for each exposure and visit (and each detector within those) taken by the instrument, a 9-detector camera for commissioning the Vera C. Rubin Observatory. This includes observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

  • ConsDB - LSSTComCamSim

    The Consolidated Database for LSSTComCamSim schema contains information for each exposure and visit (and each detector within those) taken by the simulated instrument. This information was recorded during an Operations Rehearsal. This includes simulated observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

  • ConsDB - StarTrackerFast

    The Consolidated Database for StarTrackerFast schema contains information for each exposure taken by the instrument, a fast star tracker mounted on the Simonyi Survey Telescope. This includes observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

  • ConsDB - StarTrackerNarrow

    The Consolidated Database for StarTrackerNarrow schema contains information for each exposure taken by the instrument, a narrow-field star tracker mounted on the Simonyi Survey Telescope. This includes observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

  • ConsDB - StarTrackerWide

    The Consolidated Database for StarTrackerWide schema contains information for each exposure taken by the instrument, a wide-field star tracker mounted on the Simonyi Survey Telescope. This includes observatory data from the FITS image header metadata and measurements and metrics from Rapid Analysis and other data processing.

SDM Schemas is maintained by Rubin Observatory.