Release Notes

Changes in SDM Schemas are generally organized by the type of schema which was affected:

Data Releases - Data Release and Data Preview schemas, having names that typically start with dp or dr (e.g., dp02_dc2)

Science Pipelines - Schemas which are managed through continuous integration with the Science Pipelines (imsim, hsc)

Alert Production - Alert Production Database and Prompt Products Database used in nightly data processing (apdb)

ConsDB - Consolidated Database of Image Metadata schema, having names that start with cdb (e.g., cdb_lsstcam)

Miscellaneous - Catch-all category for changes which are not related to particular schemas, typically involving changes to GitHub workflows, project scripts, etc.

v29.0.0 (2025-03-31)

Data Releases

  • Ensured (tract, patch) are always displayed, visually, in that order in DP catalogs. (DM-43996)

Science Pipelines

  • Updated description of extendedness column. (DM-46681)
  • Added dipoleFitAttempted flag. (DM-48106)
  • Separated EDGE and NO_DATA pixel flags. (DM-45621)
  • Removed STREAK mask columns. (DM-46933)
  • Removed calib_detected column from Source table. (DM-46991)
  • Removed localWcs and localPhotoCalib columns from ImSim Sources table. (DM-48117)
  • Added contributor documentation for DRP schemas. (DM-48178)
  • Added multiprofit two-Gaussian PSF and Sersic columns. (DM-48591)

Alert Production

  • Updated description of extendedness column. (DM-46681)
  • Added dipoleFitAttempted flag. (DM-48106)
  • Separated EDGE and NO_DATA pixel flags. (DM-45621)
  • Added nDiaSources column to DiaObjectLast table. (DM-44098)
  • Added column with is_negative flag. (DM-48437)

Consolidated Database

  • Added several missing ConsDB schemas to the schema browser. (DM-46895)
  • Added pixelScale and PSF model delta metric columns. (DM-47002)
  • Updated units in cdb_lsstcomcam.visit1_quicklook. (DM-47044)
  • Added electron UCDs in cdb_lsstcomcam. (DM-47308)
  • Moved mount and jitter columns to exposure_quicklook table. (DM-47443)

Miscellaneous

  • Added Python packaging with support for resource paths. (DM-46273)
  • Improved the schema browser. (DM-41867)
  • Added toggle for table pagination in the schema browser. (DM-46982)
  • Add EUPS and SCons configuration for resource path support. (DM-47069)
  • Moved YAML files into Python source tree. (DM-47147)
  • Fixed problems with GitHub build workflow. (DM-47403)
  • Added workflow to perform schema comparisons and check for changes to deployed schemas. (DM-46158)
  • Added GitHub workflow that runs extra validation checks. (DM-47844)
  • Added contribution guide and pull request template. (DM-48013)
  • Changed the TAP_SCHEMA build to use the new Felis command load-tap-schema. (DM-46957)
  • Added api_created field to tap_schema.schemas table definition. (DM-48979)
  • Added the sdm_tools dependency, which provides a new command line utility for processing schema files. Ported the script for generating the Datalink snippets to the new repository. (DM-41290)
  • Added support for towncrier. (DM-49711)

v28.0.0 (2025-01-23)

Data Releases

  • Added missing primary keys to DP0.2. (DM-43115)
  • Removed DP0.1 from TAP_SCHEMA and DataLink builds. (DM-44884)
  • Fixed lengths and datatypes of string columns. (DM-43946)
  • Added missing precision values on timestamps. (DM-44825)
  • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
  • Removed length fields and type overrides from timestamp columns. (DM-44059)
  • Removed unused mysql:datatype overrides on string columns. (DM-44637)
  • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
  • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
  • Removed redundant mysql:datatype overrides for Felis boolean types. (DM-43958)
  • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

Science Pipelines

  • Fixed lengths and datatypes of string columns. (DM-43946)
  • Migrated from ccdVisitId to (visit, detectors). (DM-42435)
  • Added invalidPsfFlag column. (DM-44167)
  • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
  • Removed length fields and type overrides from timestamp columns. (DM-44059)
  • Added pixelScale to visitSummary and ccdVisit tables. (DM-44854)
  • Added psfApCorrDelta and psfApFluxDelta metrics to exposure summaries. (DM-37952)
  • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
  • Added normalized, compensated tophat fluxes to Source tables. (DM-38632)
  • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
  • Removed redundant mysql:datatype overrides for Felis boolean types. (DM-43958)
  • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

Alert Production

  • Corrected column value fields to use correct type, so 0 instead of "0". (DM-46073)
  • Migrated from ccdVisitId to (visit, detectors). (DM-42435)
  • Added individual flag fields. (DM-41530)
  • Removed placeholder time series feature columns from DiaObject table. (DM-44092)
  • Removed length fields and type overrides from timestamp columns. (DM-44059)
  • Added ra and dec and removed x and y from DiaForcedSource. (DM-44470)
  • Added psfApCorrDelta and psfApFluxDelta metrics to exposure summaries. (DM-37952)
  • Removed unused mysql:datatype overrides on numeric columns. (DM-44241)
  • Removed redundant mysql:datatype overrides for Felis numeric types. (DM-43716)
  • Removed redundant mysql:datatype overrides for Felis fixed length strings. (DM-43956)

Consolidated Database

  • Implemented multi-column primary key wth day_obs and seq_num. (DM-46073)
  • Added exposure_quicklook table to LATISS and ComCam. (DM-46628)
  • Added StarTracker schemas. (DM-45893)
  • Added mount jitter to LATISS and ComCam. (DM-46009)
  • Added magnitude limit columns from exposure summary stats. (DM-45573)
  • Added postisr_pixel_median columns. (DM-45848)
  • Made constraint names unique. (DM-45623)
  • Removed datatype overrides on timestamp columns and specified precision. (DM-44825)
  • Added vignette columns. (DM-44967)
  • Updated descriptions for eff_time_*_scale columns. (DM-44958)
  • Updated descriptions for eff_time metric columns. (DM-44955)
  • Added a representative ConsDB schema. (DM-44161)
  • Added CcdExposure tables and LSSTComCamSim schema. (DM-44429)
  • Added visit1 and ccdvisit1 tables. (DM-44489)

Miscellaneous

  • Changed the TAP_SCHEMA workflow to set the schema index with a command line argument to Felis. (DM-42935)
  • Added redundant datatype checks to validation workflow. (DM-44058)
  • Deleted UWS creation script from tap-schema/sql directory. (DM-45099)
  • Removed DP0.1 from TAP_SCHEMA on IDF int and dev. (DM-44884)
  • Added database tests to GitHub workflows. (DM-44158)
  • Updated the schema browser to use LTD. (DM-41310)

SDM Schemas is maintained by Rubin Observatory.