LMTOY>> seq_pipeline: 2-feb-2022
LMTOY>> READING lmtoy_functions 24-dec-2021 via /lma1/teuben/lmtoy/examples/seq_pipeline.sh
Working directory ./2018-S1-MU-64/92177
LMTOY>> Hang on, creating a bootstrap lmtoy_92177.rc from path=/n/lma1/lmt/data_lmt/
#
# version=2-feb-2022
# ifproc="/n/lma1/lmt/data_lmt//ifproc/ifproc_2020-03-06_092177_00_0001.nc"
date_obs="2020-03-06T01:49:06"
# skytime=1243.64 sec
# inttime=847.378 sec
obsnum="92177"
calobsnum="92176"
obspgm="Map"
obsgoal="Science"
ProjectId="2018-S1-MU-64"
# SkyOff=0 0
# HPBW=12 arcsec
# XYLength=150 150 arcsec
# XYRamp=0 0 arcsec
# XYoff=0 0 arcsec
# XYstep=1 0.4
numbands=1
vlsr=315 # km/s
skyfreq=115.1450648228087 # GHz
restfreq=115.271204 # Ghz
src="SEXTANS-A"
resolution=11 # arcsec
cell=5.5 # arcsec
x_extent=150 # arcsec
y_extent=150 # arcsec
instrument="SEQ"
#
LMTOY>> this is your startup lmtoy_92177.rc file:
# seq_pipeline: 2-feb-2022
# DATE: 2022-02-03T22:20:34.392613260
# obsnum=92177
# Using ifproc=/n/lma1/lmt/data_lmt//ifproc/ifproc_2020-03-06_092177_00_0001.nc
# path=/n/lma1/lmt/data_lmt/
#
# version=2-feb-2022
# ifproc="/n/lma1/lmt/data_lmt//ifproc/ifproc_2020-03-06_092177_00_0001.nc"
date_obs="2020-03-06T01:49:06"
# skytime=1243.64 sec
# inttime=847.378 sec
obsnum="92177"
calobsnum="92176"
obspgm="Map"
obsgoal="Science"
ProjectId="2018-S1-MU-64"
# SkyOff=0 0
# HPBW=12 arcsec
# XYLength=150 150 arcsec
# XYRamp=0 0 arcsec
# XYoff=0 0 arcsec
# XYstep=1 0.4
numbands=1
vlsr=315 # km/s
skyfreq=115.1450648228087 # GHz
restfreq=115.271204 # Ghz
src="SEXTANS-A"
resolution=11 # arcsec
cell=5.5 # arcsec
x_extent=150 # arcsec
y_extent=150 # arcsec
instrument="SEQ"
#
# based on vlsr=315, dv=100, dw=250
b_order=0
b_regions=[[-35,215],[415,665]]
l_regions=[[215,415]]
slice=[-35,665]
v_range=215,415
pix_list=0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
rmax=3
otf_a=1.1
otf_b=4.75
otf_c=2
sample=-1
otf_cal=0
edge=0
LMTOY>> Sleeping for 5 seconds, you can abort, edit lmtoy_92177.rc, then continuing
LMTOY>> process_otf_map2 in 2 seconds
{'--b_order': '0',
'--b_regions': '[[-35,215],[415,665]]',
'--bank': '0',
'--eliminate_list': '0',
'--help': False,
'--l_regions': '[[215,415]]',
'--obsnum': '92177',
'--output': 'SEXTANS-A_92177.nc',
'--path': '/n/lma1/lmt/data_lmt/',
'--pix_list': '0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15',
'--restfreq': None,
'--sample': None,
'--save_tsys': False,
'--slice': '[-35,665]',
'--stype': '2',
'--tsys': '250.0',
'--use_cal': True,
'--use_otf_cal': False,
'--x_axis': 'VLSR'}
program process_otf_map options
obsnum = 92177
pix_list = [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
tsys = 250.0
eliminate_list = [0]
path = /n/lma1/lmt/data_lmt/
b_order = 0
use_cal = True
use_otf_cal = False
data_path = /n/lma1/lmt/data_lmt/
stype = 2
slice = [-35, 665]
output = SEXTANS-A_92177.nc
l_regions = [[215, 415]]
bank = 0
output_file_name = SEXTANS-A_92177.nc
x_axis = VLSR
b_regions = [[-35, 215], [415, 665]]
2020-03-06T01:49:06 begin /n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092177_00_0001.nc
2020-03-06T02:09:50 end /n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092177_00_0001.nc
BufPos 1 11.4 sec 92177
BufPos 0 18.5 sec 92177
BufPos 1 21.5 sec 92177
BufPos 0 18.2 sec 92177
BufPos 1 21.5 sec 92177
BufPos 0 17.9 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 17.8 sec 92177
BufPos 1 21.2 sec 92177
BufPos 0 16.4 sec 92177
BufPos 1 21.4 sec 92177
BufPos 0 16.6 sec 92177
BufPos 1 24.2 sec 92177
BufPos 0 17.7 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 16.6 sec 92177
BufPos 1 21.4 sec 92177
BufPos 0 16.8 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 17.5 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 17.7 sec 92177
BufPos 1 21.5 sec 92177
BufPos 0 17.5 sec 92177
BufPos 1 21.1 sec 92177
BufPos 0 17.3 sec 92177
BufPos 1 21.3 sec 92177
BufPos 0 17.5 sec 92177
BufPos 1 21.4 sec 92177
BufPos 0 17.3 sec 92177
BufPos 1 21.4 sec 92177
BufPos 0 17.2 sec 92177
BufPos 1 22.6 sec 92177
BufPos 0 17.4 sec 92177
BufPos 1 21.8 sec 92177
BufPos 0 16.9 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 17.1 sec 92177
BufPos 1 21.9 sec 92177
BufPos 0 17.3 sec 92177
BufPos 1 21.3 sec 92177
BufPos 0 17.1 sec 92177
BufPos 1 21.8 sec 92177
BufPos 0 17.0 sec 92177
BufPos 1 21.2 sec 92177
BufPos 0 17.1 sec 92177
BufPos 1 21.2 sec 92177
BufPos 0 17.0 sec 92177
BufPos 1 21.6 sec 92177
BufPos 0 17.0 sec 92177
BufPos 1 21.8 sec 92177
BufPos 0 16.9 sec 92177
BufPos 1 21.9 sec 92177
BufPos 0 17.0 sec 92177
BufPos 1 21.9 sec 92177
BufPos 0 17.3 sec 92177
BufPos 1 22.1 sec 92177
BufPos 0 17.2 sec 92177
BufPos 1 22.0 sec 92177
BufPos 0 17.1 sec 92177
BufPos 1 22.1 sec 92177
BufPos 0 17.1 sec 92177
BufPos 1 21.8 sec 92177
BufPos 0 17.0 sec 92177
BufPos 1 7.5 sec 92177
before read npix
from pixels npix = 16
from xlen npix = 16
TRACKING Sequoia PIXEL 10
Map Parameters: Ra Continuous
HPBW= 12.0 XLength= 150.0 YLength= 150.0 XStep= 1.00 YStep= 0.40
/n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092177_00_0001.nc does not have bs parameters
92177 is a Map observation
get chop
'Data.Msip1mm.BeamChopperActPos'
no chop
2020-03-06T01:48:45 begin /n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092176_00_0001.nc
2020-03-06T01:48:52 end /n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092176_00_0001.nc
BufPos 3 4.6 sec 92176
BufPos 2 2.6 sec 92176
before read npix
from pixels npix = 16
from xlen npix = 16
TRACKING Sequoia PIXEL 10
/n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092176_00_0001.nc does not have map parameters
/n/lma1/lmt/data_lmt/ifproc/ifproc_2020-03-06_092176_00_0001.nc does not have bs parameters
92176 is a Cal observation
get chop cal
'Data.Msip1mm.BeamChopperActPos'
no chop cal
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach0/roach0_92177_0_1_SEXTANS-A_2020-03-06_064903.nc nspec,nchan=35504,2048
r:0 inp:0 pix:0 time_offset:-0.030000
r:0 inp:1 pix:1 time_offset:-0.030000
r:0 inp:2 pix:2 time_offset:-0.030000
r:0 inp:3 pix:3 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach1/roach1_92177_0_1_SEXTANS-A_2020-03-06_064903.nc nspec,nchan=35612,2048
r:1 inp:0 pix:4 time_offset:-0.030000
r:1 inp:1 pix:5 time_offset:-0.030000
r:1 inp:2 pix:6 time_offset:-0.030000
r:1 inp:3 pix:7 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach2/roach2_92177_0_1_SEXTANS-A_2020-03-06_064903.nc nspec,nchan=35840,2048
r:2 inp:0 pix:8 time_offset:-0.030000
r:2 inp:1 pix:9 time_offset:-0.030000
r:2 inp:2 pix:10 time_offset:-0.030000
r:2 inp:3 pix:11 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach3/roach3_92177_0_1_SEXTANS-A_2020-03-06_064903.nc nspec,nchan=35996,2048
r:3 inp:0 pix:12 time_offset:-0.030000
r:3 inp:1 pix:13 time_offset:-0.030000
r:3 inp:2 pix:14 time_offset:-0.030000
r:3 inp:3 pix:15 time_offset:-0.030000
RESTFREQ 115.271 GHz
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach0/roach0_92176_0_1_SEXTANS-A_2020-03-06_064844.nc nspec,nchan=232,2048
r:0 inp:0 pix:0 time_offset:-0.030000
r:0 inp:1 pix:1 time_offset:-0.030000
r:0 inp:2 pix:2 time_offset:-0.030000
r:0 inp:3 pix:3 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach1/roach1_92176_0_1_SEXTANS-A_2020-03-06_064844.nc nspec,nchan=232,2048
r:1 inp:0 pix:4 time_offset:-0.030000
r:1 inp:1 pix:5 time_offset:-0.030000
r:1 inp:2 pix:6 time_offset:-0.030000
r:1 inp:3 pix:7 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach2/roach2_92176_0_1_SEXTANS-A_2020-03-06_064844.nc nspec,nchan=236,2048
r:2 inp:0 pix:8 time_offset:-0.030000
r:2 inp:1 pix:9 time_offset:-0.030000
r:2 inp:2 pix:10 time_offset:-0.030000
r:2 inp:3 pix:11 time_offset:-0.030000
read_roach /n/lma1/lmt/data_lmt/spectrometer/roach3/roach3_92176_0_1_SEXTANS-A_2020-03-06_064844.nc nspec,nchan=240,2048
r:3 inp:0 pix:12 time_offset:-0.030000
r:3 inp:1 pix:13 time_offset:-0.030000
r:3 inp:2 pix:14 time_offset:-0.030000
r:3 inp:3 pix:15 time_offset:-0.030000
TSYS[0] = 217.55 +/- 12.551 (2048 channels)
TSYS[1] = 183.751 +/- 8.81898 (2048 channels)
TSYS[2] = 229.364 +/- 13.126 (2048 channels)
TSYS[3] = 172.994 +/- 8.89344 (2048 channels)
TSYS[4] = 187.766 +/- 11.2726 (2048 channels)
TSYS[5] = 180.441 +/- 10.8806 (2048 channels)
TSYS[6] = 213.561 +/- 15.7052 (2048 channels)
TSYS[7] = 183.136 +/- 9.42293 (2048 channels)
TSYS[8] = 172.91 +/- 9.57197 (2048 channels)
TSYS[9] = 183.295 +/- 8.70772 (2048 channels)
TSYS[10] = 178.509 +/- 9.54173 (2048 channels)
TSYS[11] = 181.875 +/- 9.41422 (2048 channels)
TSYS[12] = 166.118 +/- 8.35541 (2048 channels)
TSYS[13] = 204.063 +/- 9.2715 (2048 channels)
TSYS[14] = 190.501 +/- 9.339 (2048 channels)
TSYS[15] = 191.046 +/- 10.6882 (2048 channels)
Spectral Band velocity range: -724.795 1354.8 km/s
Total Number of OTF Spectra = 64756
NSPEC: 64756
NCHAN: 689
FAST_NC: True
Looping over 16 pixel list [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]:
Processing 1 CAL's for Tsys
Pix Nspec Mean Std MAD_std Min Max RMS_max Warnings
TSYS[0] slice: 217.465 (4.54419) minmax: 209.351 225.474
0 4046 0.002 1.125 1.124 -5.616 6.182 1.124 1.265
TSYS[1] slice: 183.815 (3.37822) minmax: 177.1 190.408
1 4046 0.000 0.952 0.952 -4.638 4.710 0.951 1.057
TSYS[2] slice: 229.198 (4.31669) minmax: 219.494 238.434
2 4046 0.000 1.186 1.186 -5.956 5.649 1.185 1.333
TSYS[3] slice: 173.024 (3.14834) minmax: 166.699 179.318
3 4046 -0.000 0.895 0.895 -4.246 4.545 0.894 0.991
TSYS[4] slice: 188.761 (3.87916) minmax: 180.744 195.723
4 4048 -0.000 0.976 0.976 -4.955 5.028 0.975 1.088
TSYS[5] slice: 180.866 (5.21697) minmax: 162.312 188.986
5 4048 -0.003 0.962 0.956 -6.566 5.064 0.967 1.313 *M 1.7
TSYS[6] slice: 214.086 (5.10043) minmax: 203.056 223.182
6 4048 0.000 1.108 1.106 -5.813 6.051 1.106 1.225 Traceback (most recent call last):
File "/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/ifproc/ifproc.py", line 536, in __init__
self.chop = self.nc.variables['Data.Msip1mm.BeamChopperActPos'][:]
KeyError: 'Data.Msip1mm.BeamChopperActPos'
Traceback (most recent call last):
File "/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/ifproc/ifproc.py", line 667, in __init__
self.chop = self.nc.variables['Data.Msip1mm.BeamChopperActPos'][:]
KeyError: 'Data.Msip1mm.BeamChopperActPos'
/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/numpy/core/fromnumeric.py:748: UserWarning: Warning: 'partition' will ignore the 'mask' of the MaskedArray.
a.partition(kth, axis=axis, kind=kind, order=order)
/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/spec/spec.py:547: RuntimeWarning: invalid value encountered in true_divide
self.tsys_spectrum = 280 * sky_spectrum / (hot_spectrum -
/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/spec/spec.py:547: RuntimeWarning: divide by zero encountered in true_divide
self.tsys_spectrum = 280 * sky_spectrum / (hot_spectrum -
/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/spec/spec.py:392: RuntimeWarning: invalid value encountered in true_divide
spectra.append((self.raw_spec[i,:] - ref) / ref)
/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/spec/spec.py:392: RuntimeWarning: divide by zero encountered in true_divide
spectra.append((self.raw_spec[i,:] - ref) / ref)
/lma1/teuben/lmtoy/SpectralLineReduction/lmtslr/spec/spec.py:434: RuntimeWarning: invalid value encountered in multiply
self.reduced_spectra = np.array(spectra) * tsys_spectrum
TSYS[7] slice: 183.447 (3.42698) minmax: 176.663 189.492
7 4048 0.000 0.950 0.949 -4.585 5.134 0.948 1.070
TSYS[8] slice: 173.438 (3.43191) minmax: 167.005 179.511
8 4047 -0.001 0.897 0.898 -4.302 5.081 0.897 1.011
TSYS[9] slice: 183.715 (3.29444) minmax: 177.374 189.859
9 4047 -0.000 0.951 0.950 -4.746 4.866 0.950 1.055
TSYS[10] slice: 178.908 (3.46936) minmax: 172.123 185.026
10 4047 -0.000 0.926 0.927 -4.360 4.939 0.925 1.033
TSYS[11] slice: 182.167 (3.39685) minmax: 175.5 188.383
11 4047 0.001 0.943 0.942 -4.708 5.026 0.941 1.049
TSYS[12] slice: 166.241 (2.90877) minmax: 160.476 172.261
12 4048 -0.000 0.863 0.863 -4.368 4.482 0.862 0.963
TSYS[13] slice: 204.459 (3.72622) minmax: 197.728 211.487
13 4048 -0.000 1.059 1.058 -5.798 5.386 1.057 1.196
TSYS[14] slice: 190.855 (3.21974) minmax: 184.289 197.273
14 4048 0.000 0.990 0.989 -5.078 5.371 0.988 1.112
TSYS[15] slice: 191.136 (3.70378) minmax: 183.864 198.228
15 4048 -0.001 0.991 0.990 -4.928 4.755 0.990 1.091
CPU TIME: 34.1166 sec
CPU TIME: 34.2107 sec
Warnings:
*P ratio: ratio of std/mad too high for data
*M ratio: ratio of std/mad too high for RMS
X-range: -148.459 110.208 Y-range: -137.793 121.657 arcsec
Written SEXTANS-A_92177.nc
LMTOY>> view_spec_file
{'--help': False,
'--input': 'SEXTANS-A_92177.nc',
'--pix_list': '0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15',
'--plot_range': '-1,3',
'--plots': 'SEXTANS-A_92177_specviews',
'--rms_cut': '-4',
'--show_pixel': None,
'--skip_tsys': False}
SLR Plots initialized with 1 method=SEXTANS-A_92177_specviews
Max sequence=4048
Plots saving in SEXTANS-A_92177_specviews.1.png
Plots saving in SEXTANS-A_92177_specviews.2.png
Plots saving in SEXTANS-A_92177_specviews.3.png
Plots saving in SEXTANS-A_92177_specviews.4.png
Plots saving in SEXTANS-A_92177_specviews.5.png
NEW TSYS PIC
SHAPE (1, 16, 689)
PIXEL: 0 [ 0 1 2 ... 4043 4044 4045]
PIXEL: 1 [4046 4047 4048 ... 8089 8090 8091]
PIXEL: 2 [ 8092 8093 8094 ... 12135 12136 12137]
PIXEL: 3 [12138 12139 12140 ... 16181 16182 16183]
PIXEL: 4 [16184 16185 16186 ... 20229 20230 20231]
PIXEL: 5 [20232 20233 20234 ... 24277 24278 24279]
PIXEL: 6 [24280 24281 24282 ... 28325 28326 28327]
PIXEL: 7 [28328 28329 28330 ... 32373 32374 32375]
PIXEL: 8 [32376 32377 32378 ... 36420 36421 36422]
PIXEL: 9 [36423 36424 36425 ... 40467 40468 40469]
PIXEL: 10 [40470 40471 40472 ... 44514 44515 44516]
PIXEL: 11 [44517 44518 44519 ... 48561 48562 48563]
PIXEL: 12 [48564 48565 48566 ... 52609 52610 52611]
PIXEL: 13 [52612 52613 52614 ... 56657 56658 56659]
PIXEL: 14 [56660 56661 56662 ... 60705 60706 60707]
PIXEL: 15 [60708 60709 60710 ... 64753 64754 64755]
Plots saving in SEXTANS-A_92177_specviews.6.png
/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/numpy/core/fromnumeric.py:748: UserWarning: Warning: 'partition' will ignore the 'mask' of the MaskedArray.
a.partition(kth, axis=axis, kind=kind, order=order)
SLR Plots initialized with 3 method=SEXTANS-A_92177_specpoint,png,1
MAD: 0 1.1239898 0.035169572444145564 1.2646681102569288
MAD: 1 0.9505496 0.030533374073058926 1.0726830988007807
MAD: 2 1.1848404 0.037701283960404695 1.3356455765917408
MAD: 3 0.89422685 0.02963359095118554 1.0127612128838743
MAD: 4 0.974181 0.031808022644056924 1.101413086994227
MAD: 5 0.9547372 0.03767150327762417 1.1054231995423813
MAD: 6 1.1060781 0.034450240818526885 1.243879111162291
MAD: 7 0.9484739 0.029791287177956614 1.0676390194660683
MAD: 8 0.89663863 0.027919080811819368 1.0083149550679562
MAD: 9 0.9491823 0.02970804265813686 1.068014442589945
MAD: 10 0.92441535 0.028678178927797796 1.0391280656715183
MAD: 11 0.94078636 0.029644946493432717 1.059366147668067
MAD: 12 0.86269003 0.027097460935997547 0.9710798752724631
MAD: 13 1.0562737 0.03438564236418693 1.1938162682635105
MAD: 14 0.98783803 0.032224333613134266 1.1167353643139872
MAD: 15 0.9890958 0.03226021182443663 1.118136654373247
Plots saving in SEXTANS-A_92177_specpoint.1.png
/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/numpy/core/fromnumeric.py:748: UserWarning: Warning: 'partition' will ignore the 'mask' of the MaskedArray.
a.partition(kth, axis=axis, kind=kind, order=order)
SLR Plots initialized with 3 method=SEXTANS-A_92177_specpoint,png,2
MAD: 0 1.1239898 0.035169572444145564 1.2646681102569288
MAD: 1 0.9505496 0.030533374073058926 1.0726830988007807
MAD: 2 1.1848404 0.037701283960404695 1.3356455765917408
MAD: 3 0.89422685 0.02963359095118554 1.0127612128838743
MAD: 4 0.974181 0.031808022644056924 1.101413086994227
MAD: 5 0.9547372 0.03767150327762417 1.1054231995423813
MAD: 6 1.1060781 0.034450240818526885 1.243879111162291
MAD: 7 0.9484739 0.029791287177956614 1.0676390194660683
MAD: 8 0.89663863 0.027919080811819368 1.0083149550679562
MAD: 9 0.9491823 0.02970804265813686 1.068014442589945
MAD: 10 0.92441535 0.028678178927797796 1.0391280656715183
MAD: 11 0.94078636 0.029644946493432717 1.059366147668067
MAD: 12 0.86269003 0.027097460935997547 0.9710798752724631
MAD: 13 1.0562737 0.03438564236418693 1.1938162682635105
MAD: 14 0.98783803 0.032224333613134266 1.1167353643139872
MAD: 15 0.9890958 0.03226021182443663 1.118136654373247
Plots saving in SEXTANS-A_92177_specpoint.2.png
LMTOY>> make_spec_fits (waterfall)
pix [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Min nsamp 4046
Binning [1, 1]
FITS file will be 4046 x 689 x 16
Written waterfall cube to SEXTANS-A_92177.wf.fits
pix [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Min nsamp 4046
Binning [10, 1]
FITS file will be 404 x 689 x 16
New shape: (16, 689, 404)
Written waterfall cube to SEXTANS-A_92177.wf10.fits
LMTOY>> grid_data
{'--cell': '5.5',
'--edge': '0',
'--help': False,
'--input': 'SEXTANS-A_92177.nc',
'--n_samples': '256',
'--noise_sigma': '1',
'--otf_a': '1.1',
'--otf_b': '4.75',
'--otf_c': '2',
'--otf_select': '1',
'--output': 'SEXTANS-A_92177.fits',
'--pix_list': '0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15',
'--program_path': 'spec_driver_fits',
'--resolution': '11',
'--rmax': '3',
'--rms_cut': '-4',
'--sample': '-1',
'--weight': 'SEXTANS-A_92177.wt.fits',
'--x_extent': '150',
'--y_extent': '150'}
STDOUT ****************************
spec_driver_fits LMTSLR 26-jan-2022
CMD: spec_driver_fits -i SEXTANS-A_92177.nc -o SEXTANS-A_92177.fits -w SEXTANS-A_92177.wt.fits -l 11 -c 5.5 -u [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15] -z -4 -s 1 -x 150 -y 150 -f 1 -r 3 -n 256 -0 1.1 -1 4.75 -2 2 -b -1 -e 0
file list=SEXTANS-A_92177.nc
DEBUG:5.5
sample_list=-1
Warning: sample list is not a multiple of 3
nsamples=1
Processing 1 SpecFiles:
Opening SpecFile file SEXTANS-A_92177.nc
file: SEXTANS-A_92177.nc nspec= 64756 nchan= 689
SpecFile version 6-mar-2021
X-range: -148.459 110.208 Y-range: -137.793 121.657 arcsec
X-ramp: -65.0589 26.8084 Y-ramp: -54.3931 38.257 arcsec
MapSize: 258.667 x 259.45 arcsec
92177
SEXTANS-A
DATE-OBS 2020-03-06T01:49:06
CF.n_cells= 7 delta=0.129412 cell=5.5 resol=11 oft_select=1
C-AXIS 2 starts at 664.985
C-AXIS 1 starts at -148.5
C-AXIS 0 starts at -148.5
P-AXIS 1 starts at -148.5
P-AXIS 0 starts at -148.5
P-AXIS 1 starts at -148.5
P-AXIS 0 starts at -148.5
WARNING fuzzy_edge=0
pixel: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
used?: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
rms_stats: n=64756 rms_cutoff=-4
Cube Completed, 64584/64756 Spectra accepted = 0.997
Weighting Completed, fuzzy_edge=0
Weight at 0.000000 0.000000 is 139.393982
write to SEXTANS-A_92177.fits
write weights to SEXTANS-A_92177.wt.fits
STDERR ****************************
Exit Code: 0
LMTOY>> Some NEMO post-processing
### nemo Debug Info: FITS file: Image size 55 55 689
### Warning [fitsccd]: Setting map minimum from 0 to -1.69032
### Warning [fitsccd]: Setting map maximum from 0 to 2.09658
### nemo Debug Info: There were 651794 blank values in the image (31.272727 %)
### nemo Debug Info: FITS file: Image size 55 55
### Warning [fitsccd]: Setting map minimum from 0 to -1.51596
### Warning [fitsccd]: Setting map maximum from 0 to 146.237
### nemo Debug Info: There were no blank values set in the image
LMTOY>> STATS SEXTANS-A_92177.ccd centerbox robust
### Warning [ccdsub]: Sampling will be done
### Warning [ccdsub]: Attempting to fix the WCS
### nemo Debug Info: WCS Corner: 152.764 -4.68478 664985
Number of points : 540176
Min and Max : -0.765880 0.751332
Mean and dispersion : -0.000241 0.104832
Skewness and kurtosis : 0.006390 0.734246
Sum and Sum*Dx*Dy*Dz* : -130.167451 -0.308662
Points per beam (map) : 1
N Robust : 531258
Mean Robust : -0.000219
Sigma Robust : 0.097031
Median Robust : -0.000311
0/540176 out-of-range points discarded
LMTOY>> STATS SEXTANS-A_92177.wt.ccd centerbox robust
### Warning [ccdsub]: Sampling will be done
### Warning [ccdsub]: Attempting to fix the WCS
### nemo Debug Info: WCS Corner: 152.764 -4.68478 0
Number of points : 784
Min and Max : 16.813690 146.237152
Mean and dispersion : 91.801382 31.490066
Skewness and kurtosis : -0.133841 -0.954592
Sum and Sum*Dx*Dy* : 71972.283718 -0.167991
Points per beam (map) : 1
N Robust : 784
Mean Robust : 91.801382
Sigma Robust : 31.490066
Median Robust : 91.340893
0/784 out-of-range points discarded
### nemo Debug Info: Keeping 55*55*689 cube
### Warning [ccdfits]: Replacing header from SEXTANS-A_92177.wt.fits
SLABS: [[-35,215],[415,665]] == -35,215,415,665
### Warning [ccdslice]: axis=1 not fully supported yet
### nemo Debug Info: Axis: 689 0 664985 -1015.92
### nemo Debug Info: Axis min/max: 664985 -33968.8
### nemo Debug Info: slab -35 215 -> 689 442
### nemo Debug Info: slab 415 665 -> 246 0
### nemo Debug Info: Total planes: 495
### Warning [ccdslice]: Code not converted to fix reference pixel value
### Warning [ccdfits]: Replacing header from SEXTANS-A_92177.wt.fits
### Warning [ccdfits]: Replacing header from SEXTANS-A_92177.wt.fits
### Warning [ccdfits]: Replacing header from SEXTANS-A_92177.fits
[0;31mQAC_STATS: SEXTANS-A_92177-full -2.66132e-05 0.19232 -1.69032 2.09658 -38.1216 -0.00019427[0m
### Warning [ccdsub]: Sampling will be done
### Warning [ccdsub]: Attempting to fix the WCS
### nemo Debug Info: WCS Corner: 152.764 -4.68478 664985
[0;31mQAC_STATS: SEXTANS-A_92177-cent -0.000240972 0.104832 -0.76588 0.751332 -130.167 -0.00295273[0m
### nemo Debug Info: FITS file: Image size 55 55 689
### Warning [fitsccd]: Setting map minimum from 0 to -0.0461024
### Warning [fitsccd]: Setting map maximum from 0 to 0.0588112
### nemo Debug Info: There were no blank values set in the image
spectab : # 27 27 689 min/mean/sig/max -0.296971 0.00224804 0.0774696 0.208806 -9.12606e-05 0.106802 0.974844
specstab: # 27 27 689 min/mean/sig/max -0.0327336 2.51246e-05 0.00923026 0.0299699 -7.98542e-06 0.00358118 0.274346
Traceback (most recent call last):
File "/lma1/teuben/lmtoy/examples/fitsplot.py", line 21, in
f = aplpy.FITSFigure(fitsfile)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/decorators.py", line 28, in wrapper
return f(*args, **kwargs)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 232, in __init__
self._get_hdu(data, hdu, north, convention=convention,
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 309, in _get_hdu
raise IOError("File not found: " + filename)
OSError: File not found: SEXTANS-A_92177.mom0.fits
Traceback (most recent call last):
File "/lma1/teuben/lmtoy/examples/fitsplot.py", line 21, in
f = aplpy.FITSFigure(fitsfile)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/decorators.py", line 28, in wrapper
return f(*args, **kwargs)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 232, in __init__
self._get_hdu(data, hdu, north, convention=convention,
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 309, in _get_hdu
raise IOError("File not found: " + filename)
OSError: File not found: SEXTANS-A_92177.mom1.fits
Traceback (most recent call last):
File "/lma1/teuben/lmtoy/examples/fitsplot.py", line 21, in
f = aplpy.FITSFigure(fitsfile)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/decorators.py", line 28, in wrapper
return f(*args, **kwargs)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 232, in __init__
self._get_hdu(data, hdu, north, convention=convention,
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 309, in _get_hdu
raise IOError("File not found: " + filename)
OSError: File not found: SEXTANS-A_92177.mom2.fits
INFO: Auto-setting vmin to -1.531e+01 [aplpy.core]
INFO: Auto-setting vmax to 1.596e+02 [aplpy.core]
INFO: Auto-setting vmin to -1.531e+01 [aplpy.core]
INFO: Auto-setting vmax to 1.596e+02 [aplpy.core]
Writing SEXTANS-A_92177.wt.png
INFO: Auto-setting vmin to -1.852e+01 [aplpy.core]
INFO: Auto-setting vmax to 2.056e+02 [aplpy.core]
INFO: Auto-setting vmin to -1.852e+01 [aplpy.core]
INFO: Auto-setting vmax to 2.056e+02 [aplpy.core]
Writing SEXTANS-A_92177.wt2.png
INFO: Auto-setting vmin to -5.638e+03 [aplpy.core]
INFO: Auto-setting vmax to 6.258e+04 [aplpy.core]
INFO: Auto-setting vmin to -5.638e+03 [aplpy.core]
INFO: Auto-setting vmax to 6.258e+04 [aplpy.core]
Writing SEXTANS-A_92177.wt3.png
Traceback (most recent call last):
File "/lma1/teuben/lmtoy/examples/fitsplot.py", line 21, in
f = aplpy.FITSFigure(fitsfile)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/decorators.py", line 28, in wrapper
return f(*args, **kwargs)
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 232, in __init__
self._get_hdu(data, hdu, north, convention=convention,
File "/lma1/teuben/lmtoy/anaconda3/lib/python3.8/site-packages/aplpy/core.py", line 309, in _get_hdu
raise IOError("File not found: " + filename)
OSError: File not found: SEXTANS-A_92177.wtn.fits
INFO: Auto-setting vmin to -1.118e-01 [aplpy.core]
INFO: Auto-setting vmax to 1.241e+00 [aplpy.core]
INFO: Auto-setting vmin to -1.118e-01 [aplpy.core]
INFO: Auto-setting vmax to 1.241e+00 [aplpy.core]
Writing SEXTANS-A_92177.wtr.png
WARNING: FITSFixedWarning: RADECSYS= 'FK5 ' /
the RADECSYS keyword is deprecated, use RADESYSa. [astropy.wcs.wcs]
INFO: Setting slices=[0] [aplpy.core]
INFO: Auto-setting vmin to -4.823e+03 [aplpy.core]
INFO: Auto-setting vmax to 4.497e+03 [aplpy.core]
INFO: Auto-setting vmin to -4.823e+03 [aplpy.core]
INFO: Auto-setting vmax to 4.497e+03 [aplpy.core]
Writing SEXTANS-A_92177.mom0.png
LMTOY>> Created SEXTANS-A_92177.nf.fits and SEXTANS-A_92177.nfs.fits
LMTOY>> ADMIT post-processing
LMTOY>> lmtoy_admit: 31-oct-2021
/lma1/teuben/lmtoy/examples/lmtoy_admit.sh: line 33: export: `SEXTANS-A_92177.nfs.fits': not a valid identifier
No PDIR directory used, all work in the current directory
ADMIT = /lma1/teuben/lmtoy/admit
version = 1.0.8.5
CASA_PATH = /n/astromake/opt/casa/58 linux admit lma.astro.umd.edu
CASA_ROOT = /n/astromake/opt/casa/58
prefix = /an/terra_astromake/opt/casa/casa-release-5.8.0-109.el7
version = 5.8.0-rel-109
revision = 1
Trying CASA6, no worries if this fails
Traceback (most recent call last):
File "", line 1, in
ImportError: No module named casatools
LMTOY>> ADMIT post-processing
### (1/1) : processing SEXTANS-A_92177.nfs.fits
SEXTANS-A_92177.nfs.fits [55, 55, 689] SEXTANS-A 152.7838 -4.704639 0.0006649848 0.008
/lma1/teuben/lmtoy/admit/admit/test/admit1.py --basename x SEXTANS-A_92177.nfs.fits
101.852u 3.101s 1:59.17 88.0% 0+0k 5992+107144io 0pf+0w
Logfile: SEXTANS-A_92177.nfs.fits.log
LMTOY>> lmtoy_admit: 31-oct-2021
/lma1/teuben/lmtoy/examples/lmtoy_admit.sh: line 33: export: `SEXTANS-A_92177.nf.fits': not a valid identifier
No PDIR directory used, all work in the current directory
ADMIT = /lma1/teuben/lmtoy/admit
version = 1.0.8.5
CASA_PATH = /n/astromake/opt/casa/58 linux admit lma.astro.umd.edu
CASA_ROOT = /n/astromake/opt/casa/58
prefix = /an/terra_astromake/opt/casa/casa-release-5.8.0-109.el7
version = 5.8.0-rel-109
revision = 1
Trying CASA6, no worries if this fails
Traceback (most recent call last):
File "", line 1, in
ImportError: No module named casatools
LMTOY>> ADMIT post-processing
Found 33 Xvfb
1350224 Sl Xvfb
1349440 Sl Xvfb
1346223 Sl Xvfb
1345275 Sl Xvfb
### (1/1) : processing SEXTANS-A_92177.nf.fits
SEXTANS-A_92177.nf.fits [55, 55, 689] SEXTANS-A 152.7838 -4.704639 0.0006649848 0.008
/lma1/teuben/lmtoy/admit/admit/test/admit1.py --basename x SEXTANS-A_92177.nf.fits
40.176u 1.886s 0:52.89 79.5% 0+0k 312+70256io 0pf+0w
Logfile: SEXTANS-A_92177.nf.fits.log
LMTOY>> Created SEXTANS-A_92177.fits and SEXTANS-A_92177.wt.fits
LMTOY>> Parameter file used: lmtoy_92177.rc
LMTOY>> Making summary index.html:
Making index.html for obsnum=92177
SEXTANS-A_92177_?
SEXTANS-A_92177_?_specviews
SEXTANS-A_92177_?_specpoint
Writing index.html
Writing index_pipeline.html
cp: cannot stat 'SEXTANS-A_92177_?_specviews.1.png': No such file or directory