- create inventory files
- create master dark file
- create master flat file
- average data in science files with the same wavelength, gain mode, etc.
- apply dark/flat correction
- demodulation
- apply distortion
- continuum subtraction
- combine cameras
- promote issues in observing plan that prevent calibration to errors from warnings
- C implementation of demodulation
- handle epochs with no OCCLTR-{X,Y} values in FITS headers
- option to write only center wavelength intensity or all extensions
- use non-matching exposure time flats
- fix hot pixels
- fixes for hot pixel correction
- ucomp cat --header option
- fixes for hot pixel correction
- fixes for large temperature values promoted to doubles
- iquv image panels
- normalizing by NUMSUM during averaging
- end-of-day check for data/machine log
- fix for crash when T_C{0,1}{ARR,PCB} are not present
- normalize by NUMSUM by extension
- fix typo
- handle undefined temperatures in GBU checks
- remove normalization by NUMSUM when creating darks and flats
- fix bugs with calculating demodulation matrix
- fix continuum subtraction step for wave regions that don't subtract continuum
- adjust display parameters
- typo
- handle missing OCCLTR-{X,Y} values
- send emails from ucomp-pipeline@ucar.edu
- epoch for bad level 0 FITS on 20211202
- handle no raw directory
- new two-part method to find occulter
- V crosstalk metric
- adding/removing FITS keywords from level 0 to level 1
- fixed logic of when to mark date as processed
- basic metadata for ucomp_sci database table
- consistency in database table for wave_region
- handle odd science files with no center wavelength
- fix sign error in Q
- new all wavelengths, all polarization states plot for each science file
- experimental NRGF product
- compress level 0 .tgz files
- creates level 0 tarball, not .tgz, for archive
- new high gain hot pixel data
- average flats over polarization state
- save only averaged darks/flats in files
- config option to not interpolate darks
- fix for V crosstalk metric calculation
- fix for intensity GIF colors
- new demodulation matrix
- fix for verify sub-command
- fixes for weekly verification
- changing order of hot pixel correction
- add more geometry FITS keywords like [XY]OFFSET[01], POST_ANG
- prepping for realtime processing launch
- handle display of all wavelengths in files with many wavelengths
- fixes for realtime processing launch
- fix for BUNIT value, actually 1.0E-6 B/Bsun units
- V crosstalk plot by wave region
- log memory usage
- initial implementation of verification
- fix for crashing in memory plot creation routine
- fix for crashing in SGS plot creation routine
- fix for crashing in V crosstalk plot creation routine
- cyan-pink color table for polarization image display
- email notification handles files that don't pass quality
- fix GBU conditions listed in notification email
- full implementation of verification
- fix bugs in quality check
- intensity and IQUV movies
- quality logs
- better listing of quality/GBU issues in notification email
- fix verification bug examining scripts/ directory
- handle days with no raw files in verification
- make mp4 creation optional
- add IMAGESCL and MED_BACK FITS keywords
- updated display min/max values
- adding more information to ucomp_sci table and creating rolling synoptic maps
- add library dependency
- add library dependencies
- add ssw dependencies
- handle selecting files to put into ucomp_sci if there are no OK files
- plot centering information
- use processed flag for a file to determine if OK to use
- typo in processed flag
- linear polarization synoptic maps
- synoptic maps at 1.08 Rsun
- typo in synoptic map database field name
- radial azimuth and doppler velocity synoptic maps
- plot centering information by wave region
- improved performance for distortion correction
- make sure files to include in movies were fully processed
- fix for post angle reporting
- fix SGS plot colors/formatting
- using custom FITS writer to control keyword comments better
- allow flats in the future to be used
- slightly more general method for doppler calculation
- fix for database adding when no V crosstalk or doppler velocity
- add ability to inherit options in another config file
- add wind speed/direction to ucomp_file database table
- check for extra files, allow up to verification/max_missing missing files in verification, if they are not on the collection server
- flat interpolation option (default ON)
- creating partial level 2 dynamics files
- level 1 header updates: promoting common keywords to primary header
- write intensity only FITS files
- create dynamics and polarizations FITS and PNG files
- fix for creating dynamics/polarization files from less than 3 wavelengths
- handle masking files when post angle was not found
- fix for images where the post angle is not found
- better display of level 2 products
- handle no center wavelengths in a level 1 file
- put NULL for out-of-range V crosstalk metric values in the database
- handle raw files with no extensions
- allow quality to be turned off
- check cal quality: flats must have occulter out and diffuser in
- create enhanced intensity GIFs
- colorbars on all GIFs and PNGs except the all wavelength IQUV PNG
- handle missing SGS FITS keywords
- handle quality check for before 20210726
- handle missing
T_andTU_FITS keywords
- fix for handling occulter ID of NONE
- handle file for ucomp_sci database table which does not have center wavelength
- handle NaN values for total I, Q, U in ucomp_sci database table
- fix bugs in dark count/temperature engineering plots
- verification fixes
- new hot pixel file for high gain mode
- level 2 individual images
- level 2 movies
- flat engineering plots
- adding missing file
- fix bug if no flats for a given wavelength/onband combination
- add median line center and continuum values to database
- make plots of dark and flat medians over time from the database
- fix for graphics issue with dark/flat median plots over time from database
- storing median background of each file in database
- fix minor issues with dark/flat plots
- make plot of median backgrounds over mission
- use wave region display options to display synoptic maps
- minor changes to title of rolling dark plot
- change to epoch based wave region options
- fix for cal file quality check
- add check for consistent data types for cal file extensions
- combine MFLTEXT{1,2} keyword values for subtracted continuum extensions
- better messages for verification log
- allow flat/cal combined datatype files
- quality check on median dark value
- add occulter and quality fields to ucomp_cal database table
- adjust ranges in dark plots
- all quality check for any extension being identically zero
- add in/out quality check for cal files
- making mp4s in /tmp directory
- fix for missing ssh key in checking for missing files in verification
- potential fix for low background values (sum over pol state instead of mean)
- new demodulation coefficients
- fix for bug in previous fix for low background values
- change valid dark value range by epoch
- create averages of level 1 files
- adjust background plot ranges for some wave regions
- updated ranges for rolling dark and flat plots
- archive and distribute level 1 and 2 data
- use background I instead of sum of pol states for backgrounds
- fix error in display of synoptic maps
- fix for log message when not archiving level 0 data
- fix for typo in module name in ucomp script
- fix for creating quick invert of non-existent average file
- rolling flat plot annotation improvements
- check for level 1 files before using them in creating averages
- change enhanced intensity parameters
- additions to rolling dark plots
- display adjustments for intensity
- fixes for averaging
- fix for no OK files to average rolling plot of dark corrected flats
- added O1ID entry to ucomp_eng database table
- added new lines: 670, 761, 802, 991
- a fix for the new wave regions added this week
- fix reversed XOFFSET{0,1} FITS keyword
- add DEMOD FITS keyword
- new demodulation coefficient file with temporary 670, 761, 802, 991 values
- change DEMOD to DEMOD_C including a better date format in comment
- fix for handling rolling background plot with only a single value
- skipping trying to make movies with only a single frame
- new display ranges for new lines
- fix center wavelength for 991 wave region
- fix center wavelength for more new wave regions: 670, 802, 991
- fix for typo in machine log validation that caused crashes
- change center wavelength by epoch for new lines
- fix typo
- add backgrounds to level 1 FITS files
- fix MED_BACK FITS keyword calculation
- subtract rest wavelength in velocity calculation
- fix for RAWEXTS, FLTFILE{1,2}, and MFLTEXT{1,2} keywords
- improved center finding
- ignore data under post for radial derivative
- better initial guesses for center and radius
- find mean over polarization state of background used for center finding
- center and rotate in a single interpolation
- add "vectorized" option for demodulation
- add CONFIG_DIR CMake variable
- allow config files to inherit from another config file
- fix for finding dark when not interpolating (find nearest instead of previous)
- move the dark correction to before the camera correction
- change extension names from "sci [WWWW.WW nm]" to "Stokes IQUV [WWWW.WW nm]"
- add scheme to convert cookbook names to better user names for average files
- updating radial azimuth color table to match CoMP
- report eccentricity/angle in FITS header, database, and daily plot
- handle missing files for composite images
- handle missing files for composite images
- using CIRCFIT for occulter center finding
- fix for finding configuration file for verification script
- fix for finding post
- horizontal debanding
- change display min/max for radial azimuth to +/- 50.0
- improved GBU
- ability to remove bad frames
- creating quick invert FITS and PNGs
- adding backgrounds to average files
- fixed post finding
- adding mean/median and quick invert files to ucomp_file database table
- can specify dates in options/dates in config file for eod, rt, cal, clearday, reprocess, regression, script, and archive sub-commands
- fixed temperature composite images
- produce image scale plot for evaluating changes in plate scale
- updating FITS keywords
- change quality conditions checked in early mission
- option to not perform noise masking in level 2 products
- handle extra files in the raw directory with ".fts" in the filename
- report correct quality in ucomp_raw database table
- FITS header changes
- FITS header changes
- change filenames to full words
- updated image annotations/display parameters
- remove threshold masking in enhanced intensity
- polarization/dynamics and quicklook distribution
- mask 706 nm level 1 quicklook images
- scale radial azimuth from -90 to 90 degrees with band on Van Vleck angle
- create individual quicklook images from quick invert extensions
- change Q, U, and V color table to linear black/white
- option to do centering before the gain correction
- track saturated pixels and pixels in the non-linear region of the camera
- update engineering plot filenames to include "mission" if over entire mission
- option to create engineering difference images when combining cameras
- publish individual mean/median and quick invert FITS files along with tarballs
- publish quick invert line width and velocity individual quicklook images
- fix bugs in temperature map creation and publishing
- change quality condition for non-dark corrected pixels in non-linear regime to 3200 DN (normalized by NUMSUM)
- fix crash with saturated pixel check when only a single extension for a given camera
- scale velocity images for all wave regions to -5 to 5
- publish azimuth PNGs/mp4s from polarization files
- update num_ucomp field in mlso_numfiles database
- update display parameters for temperature maps
- fix azimuth image from polarization file
- put Q, U, L not Q/I, U/I, and L/I in quick invert FITS file
- pipeline control command infrastructure
- ucomp versions reports days in progress
- fix L / I annotation for quick invert quicklook
- fix for crash in rolling flat plot with exactly one day
- epoch file additions
- check that wavelengths in science file match the wave region of the file
- fix in cal quality check for days where many flats don't pass quality
- fix for intensity FITS file extension names
- add intensity FITS files to ucomp_file database table
- categorizing program names into synoptic, waves, and do-not-use
- better program name construction
- fix bugs in filtering bad level 1 files out of level 2
- fixes for level 1 publishing only good files
- put number of good level 1 FITS files in num_ucomp field of mlso_numfiles
- put only written level 1 FITS files into ucomp_file database table
- put only good level 1 FITS files into ucomp_sci database table
- make daily engineering plots more consistent
- create new mission length engineering plots
- implement median difference GBU check
- update all level 1 and 2 image annotations
- change masking thresholds
- change line width display min/max
- updated method to compute enhanced peak intensity
- added
--tailoption to log sub-command - fix for mysterious hang when process finished
- new level 2 file format and filenames
- change to FWHM for line width
- better averaging criteria (no gap larger than 30 min)
- new tarball/zip file organization for distribution to website
- split ucomp_sci into dynamics and polarization tables
- rest wavelength model for 1074 nm data
- complete set of WCS FITS keywords specifying location
- user documentation
- fixed bug in "image" rest wavelength calculation method
- use "image" rest wavelength calculation method for 1074 nm files
- fix display for 789 nm enhanced intensity quicklook images
- over mask occulter for pixels used in rest wavelength calculation
- fix script updating database plots that removed UCoMP entry in mlso_numfiles
- fix display of 706 nm IQUV (all wavelengths) quicklook images
- hot pixel list for new camera
- improved hot pixel list and more generic application
- distortion for new camera
- move distortion files to directory specified by config file
- improved ordering of level 1 FITS keywords
- config file options to turn off distortion/hot pixel corrections
- handle SGSDIMV value of 0.0
- display 3 decimal points for wavelengths in IQUV all images
- fix for hot pixel correction
- more epoch updates for the eclipse data
- new program synonym names
- more epoch updates for the eclipse data
- thumbnails for the website
- update display min for 637 nm enhanced intensity
- change OBS_PLAN to a synoptic program for a 20240330 1074 nm file
- fix for creating temperature map on 20240330
- added angle grid on quicklooks
- adding DISTORTF and HOTPIXF FITS keywords
- improved post finding
- improved quality check for too many missing frames
- option to perform Gaussian fit to calculate peak intensity, LOS velocity, and line width
- use reference wavelengths for 3-point analytic Gaussian calculation
- added quality thresholds for flats
- updated distortion and hot pixels
- changes for new wave regions
- fix for crash in creating mission image scale plot
- fix for crash in creating mission image scale plot
- update documentation
- fix for days with unprocessed, ambiguous wave region level 0 files
- log messages about files that fail inventory
- check if wave region is published for number of good files for a day
- fix for unknown wave region of file
- fix for weekly verification