[2020-02-12 11:29:17,776] : PID 16233 : DEBUG : viirs_l1b2gtiff : main : Starting script with arguments: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/common/ShellB3/lib/python2.7/site-packages/polar2grid/glue.py viirs_l1b gtiff -p true_color false_color --png-quicklook --grid-configs ./proj4.config -g texasSVI -f . -vv [2020-02-12 11:29:17,777] : PID 16233 : INFO : viirs_l1b2gtiff : main : Initializing reader... [2020-02-12 11:29:17,777] : PID 16233 : DEBUG : polar2grid.readers.viirs_l1b : __init__ : Day fraction set to 0.100000 [2020-02-12 11:29:17,777] : PID 16233 : DEBUG : polar2grid.readers.viirs_l1b : __init__ : Night fraction set to 0.100000 [2020-02-12 11:29:17,777] : PID 16233 : DEBUG : polar2grid.readers.viirs_l1b : __init__ : SZA threshold set to 100.000000 [2020-02-12 11:29:17,777] : PID 16233 : DEBUG : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/mnt/r6/Software/SSEC/polar2grid_v_2_2_1/etc' [2020-02-12 11:29:17,777] : PID 16233 : DEBUG : polar2grid.core.roles : find_files_with_extensions : Searching '.' for useful files [2020-02-12 11:29:17,779] : PID 16233 : DEBUG : satpy.readers : read_reader_config : Reading ['/mnt/r6/Software/SSEC/polar2grid_v_2_2_1/common/ShellB3/lib/python2.7/site-packages/satpy-0.7.5-py2.7.egg/satpy/etc/readers/viirs_l1b.yaml', '/mnt/r6/Software/SSEC/polar2grid_v_2_2_1/etc/readers/viirs_l1b.yaml', '/mnt/r6/Software/SSEC/polar2grid_v_2_2_1/etc/readers/viirs_l1b.yaml'] [2020-02-12 11:29:18,368] : PID 16233 : DEBUG : satpy.readers.yaml_reader : create_filehandlers : Assigning to viirs_l1b: ['/data/VIIRS/j01.20200210.1842.nrt/polar2gridSTexas/VL1BM_J01_d20200210_t184800_c20200212112900.nc', '/data/VIIRS/j01.20200210.1842.nrt/polar2gridSTexas/VL1BI_J01_d20200210_t184800_c20200212112900.nc', '/data/VIIRS/j01.20200210.1842.nrt/polar2gridSTexas/VGEOM_J01_d20200210_t184800_c20200212112900.nc', '/data/VIIRS/j01.20200210.1842.nrt/polar2gridSTexas/VGEOI_J01_d20200210_t184800_c20200212112900.nc'] [2020-02-12 11:29:18,577] : PID 16233 : DEBUG : satpy.composites : load_sensor_composites : Looking for composites config file viirs.yaml [2020-02-12 11:29:18,740] : PID 16233 : DEBUG : satpy.composites : load_sensor_composites : Looking for composites config file visir.yaml [2020-02-12 11:29:18,822] : PID 16233 : DEBUG : polar2grid.core.script_utils : rename_log_file : Log renamed from '/data/VIIRS/j01.20200210.1842.nrt/polar2gridSTexas/viirs_l1b2gtiff_fail.log' to 'viirs_l1b2gtiff_20200210_184800.log' [2020-02-12 11:29:18,822] : PID 16233 : INFO : viirs_l1b2gtiff : main : Initializing remapping... [2020-02-12 11:29:18,822] : PID 16233 : DEBUG : polar2grid.grids.manager : __init__ : Loading grid configuration './proj4.config' [2020-02-12 11:29:18,823] : PID 16233 : INFO : viirs_l1b2gtiff : main : Initializing backend... [2020-02-12 11:29:18,823] : PID 16233 : DEBUG : polar2grid.core.rescale : __init__ : Loading rescale configuration files: polar2grid.core:rescale_configs/rescale.ini [2020-02-12 11:29:18,824] : PID 16233 : DEBUG : polar2grid.core.roles : open_config_file : Loading package provided configuration file: 'polar2grid.core:rescale_configs/rescale.ini' [2020-02-12 11:29:18,899] : PID 16233 : INFO : viirs_l1b2gtiff : main : Initializing compositor objects... [2020-02-12 11:29:18,899] : PID 16233 : INFO : viirs_l1b2gtiff : main : Extracting swaths from data files available... [2020-02-12 11:29:18,899] : PID 16233 : DEBUG : polar2grid.readers : create_scene : Loading scene data... [2020-02-12 11:29:19,051] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='i_lat', wavelength=None, resolution=371, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:29:23,223] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='m_lat', wavelength=None, resolution=742, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:29:24,212] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='i_lon', wavelength=None, resolution=371, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:29:28,521] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='m_lon', wavelength=None, resolution=742, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:29:30,043] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : File units and output units are the same (degrees) [2020-02-12 11:29:30,950] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:34,927] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:35,965] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:36,840] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:37,554] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : File units and output units are the same (degrees) [2020-02-12 11:29:38,478] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:39,430] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : File units and output units are the same (degrees) [2020-02-12 11:29:40,387] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : Adjusting scaling factors to convert '1' to '%' [2020-02-12 11:29:41,263] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : File units and output units are the same (degrees) [2020-02-12 11:29:41,320] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:29:41,793] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:29:44,374] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 3.1 (sec) [2020-02-12 11:29:44,389] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:30:35,020] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:30:35,502] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:30:38,098] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 3.1 (sec) [2020-02-12 11:30:38,116] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:31:28,136] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:31:28,609] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:31:31,405] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 3.3 (sec) [2020-02-12 11:31:31,414] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:31:31,905] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:31:34,673] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 3.3 (sec) [2020-02-12 11:31:34,689] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:31:35,189] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:31:37,897] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 3.2 (sec) [2020-02-12 11:31:37,921] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:32:26,335] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:33:11,446] : PID 16233 : DEBUG : satpy.composites : __call__ : Applying sun zen correction [2020-02-12 11:33:11,698] : PID 16233 : DEBUG : satpy.composites : __call__ : Interpolating coszen calculations for higher resolution band [2020-02-12 11:33:14,278] : PID 16233 : DEBUG : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2020-02-12 11:33:25,284] : PID 16233 : DEBUG : satpy.composites : __call__ : Sun-zenith correction applied. Computation time: 13.8 (sec) [2020-02-12 11:33:25,305] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:34:07,240] : PID 16233 : DEBUG : satpy.composites.crefl_utils : run_crefl : Interpolating CREFL calculations for higher resolution bands [2020-02-12 11:34:51,976] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Sharpening image with high resolution blue band [2020-02-12 11:35:00,668] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Loading CREFL averaged elevation information from: /mnt/r6/Software/SSEC/polar2grid_v_2_2_1/bin/CMGDEM.hdf [2020-02-12 11:35:52,269] : PID 16233 : DEBUG : satpy.composites.viirs : __call__ : Sharpening image with high resolution red band [2020-02-12 11:36:10,182] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='m_lat', wavelength=None, resolution=742, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:36:14,687] : PID 16233 : DEBUG : satpy.readers.yaml_reader : _load_dataset_area : No coordinates found for DatasetID(name='m_lon', wavelength=None, resolution=742, polarization=None, calibration=None, modifiers=()) [2020-02-12 11:36:17,179] : PID 16233 : DEBUG : satpy.readers.viirs_l1b : adjust_scaling_factors : File units and output units are the same (degrees) [2020-02-12 11:36:17,466] : PID 16233 : DEBUG : polar2grid.readers.viirs_l1b : _calc_percent_day : Fraction of scene that is valid day pixels: 100.000000% [2020-02-12 11:36:17,467] : PID 16233 : DEBUG : polar2grid.readers.viirs_l1b : _calc_percent_day : Fraction of scene that is valid night pixels: 0.000000% [2020-02-12 11:36:26,418] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:30,733] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:34,559] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:38,358] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:42,796] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:47,082] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:36:50,357] : PID 16233 : DEBUG : viirs_l1b2gtiff : main : Writer known grids: None [2020-02-12 11:36:50,357] : PID 16233 : DEBUG : viirs_l1b2gtiff : main : Forced Grids: ['texasSVI'] [2020-02-12 11:36:50,358] : PID 16233 : DEBUG : viirs_l1b2gtiff : main : Grids that will be mapped to: ['texasSVI'] [2020-02-12 11:36:50,358] : PID 16233 : INFO : viirs_l1b2gtiff : main : Remapping to grid texasSVI [2020-02-12 11:36:50,479] : PID 16233 : DEBUG : polar2grid.remap.remap : remap_scene : Remap scene being run with method 'ewa' [2020-02-12 11:36:50,486] : PID 16233 : DEBUG : polar2grid.remap.remap : remap_scene : Running ll2cr on the highest resolution swath to determine if it fits [2020-02-12 11:36:50,486] : PID 16233 : DEBUG : polar2grid.remap.remap : run_ll2cr : Swath 'viirs_6432_6400_i_lon_i_lat' -> Grid 'texasSVI' [2020-02-12 11:36:51,458] : PID 16233 : DEBUG : polar2grid.remap.ll2cr : ll2cr : Copying longitude and latitude arrays because inplace processing could not be done [2020-02-12 11:36:52,200] : PID 16233 : DEBUG : polar2grid.remap.ll2cr : ll2cr : Running static version of ll2cr... [2020-02-12 11:36:53,641] : PID 16233 : DEBUG : polar2grid.remap.ll2cr : ll2cr : Copying result arrays back to provided inplace array [2020-02-12 11:36:54,299] : PID 16233 : DEBUG : polar2grid.remap.remap : run_ll2cr : Grid information: grid_name: texasSVI proj4_definition: +proj=latlong +datum=WGS84 +ellps=WGS84 +no_defs cell_width: 0.0039 cell_height: -0.0034 width: 3590 height: 3530 origin_x: -107.0 origin_y: 37.0 [2020-02-12 11:36:54,300] : PID 16233 : DEBUG : polar2grid.remap.remap : run_ll2cr : Data fits in grid texasSVI and uses 16.891346% of the swath [2020-02-12 11:36:57,487] : PID 16233 : INFO : polar2grid.remap.remap : remap_scene : Grid information: grid_name: texasSVI proj4_definition: +proj=latlong +datum=WGS84 +ellps=WGS84 +no_defs cell_width: 0.0039 cell_height: -0.0034 width: 3590 height: 3530 origin_x: -107.0 origin_y: 37.0 [2020-02-12 11:36:57,495] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : Running ll2cr on the geolocation data for the following products: false_color_rgb_0 false_color_rgb_1 false_color_rgb_2 true_color_rgb_0 true_color_rgb_1 true_color_rgb_2 [2020-02-12 11:36:57,495] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : Running fornav for the following products: false_color_rgb_0 false_color_rgb_1 false_color_rgb_2 true_color_rgb_0 true_color_rgb_1 true_color_rgb_2 [2020-02-12 11:36:57,496] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : Running fornav with D=40 and d=1 [2020-02-12 11:36:57,513] : PID 16233 : DEBUG : polar2grid.remap.fornav : group_iter : Yielding group of size 6 because group size is 6 [2020-02-12 11:36:57,514] : PID 16233 : DEBUG : polar2grid.remap.fornav : fornav : Processing 6 of 6 input arrays [2020-02-12 11:37:22,192] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for true_color_rgb_1 [2020-02-12 11:37:22,192] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for true_color_rgb_0 [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for true_color_rgb_2 [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for false_color_rgb_1 [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for false_color_rgb_0 [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _remap_scene_ewa : EWA resampling found 71.745942% of the grid covered for false_color_rgb_2 [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _safe_remove : Removing intermediate file 'll2cr_rows_texasSVI_viirs_6432_6400_i_lon_i_lat.dat'... [2020-02-12 11:37:22,193] : PID 16233 : DEBUG : polar2grid.remap.remap : _safe_remove : Removing intermediate file 'll2cr_cols_texasSVI_viirs_6432_6400_i_lon_i_lat.dat'... [2020-02-12 11:37:22,335] : PID 16233 : DEBUG : viirs_l1b2gtiff : main : Putting RGBs back together again [2020-02-12 11:37:22,335] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'grid_definition' [2020-02-12 11:37:22,335] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:37:23,310] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_true_color_rgb_0.dat' [2020-02-12 11:37:23,340] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_true_color_rgb_1.dat' [2020-02-12 11:37:23,371] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_true_color_rgb_2.dat' [2020-02-12 11:37:23,402] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'grid_definition' [2020-02-12 11:37:23,403] : PID 16233 : DEBUG : polar2grid.core.containers : set_persist : Setting persist to False for child 'swath_definition' [2020-02-12 11:37:27,400] : PID 16233 : INFO : viirs_l1b2gtiff : main : Creating output from data mapped to grid texasSVI [2020-02-12 11:37:27,409] : PID 16233 : DEBUG : polar2grid.gtiff_backend : create_output_from_product : Scaling true_color data to fit in geotiff... [2020-02-12 11:37:27,420] : PID 16233 : DEBUG : polar2grid.core.roles : get_config_section : Key 'true_color:uint1:true_color:jpss-1:viirs:texasSVI:True:%:viirs_l1b' matched config regular expression '^.*:.*:true_color:.*:.*:.*:.*:.*:.*$' [2020-02-12 11:37:27,420] : PID 16233 : DEBUG : polar2grid.core.roles : get_config_options : Using configuration section: rescale:default_true_color [2020-02-12 11:37:27,449] : PID 16233 : DEBUG : polar2grid.core.rescale : get_rescale_options : Product true_color found in rescale config: {'satellite': 'jpss-1', 'units': '%', 'data_type': 'uint1', 'instrument': 'viirs', 'product_name': 'true_color', 'inc_by_one': True, 'separate_rgb': 'False', 'min_in': -1.0, 'grid_name': 'texasSVI', 'max_in': 110.0, 'reader': 'viirs_l1b', 'data_kind': 'true_color', 'method': 'lookup'} [2020-02-12 11:37:28,226] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.0, 'max_out': 254, 'data_kind': 'true_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'true_color'} [2020-02-12 11:37:28,325] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:28,325] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:28,325] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.000000 [2020-02-12 11:37:28,326] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.297297, b=2.297297 [2020-02-12 11:37:28,602] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:28,602] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:28,602] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:28,644] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:28,871] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:29,094] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.0, 'max_out': 254, 'data_kind': 'true_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'true_color'} [2020-02-12 11:37:29,192] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:29,192] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:29,193] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.000000 [2020-02-12 11:37:29,193] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.297297, b=2.297297 [2020-02-12 11:37:29,450] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:29,451] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:29,451] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:29,493] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:29,720] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:29,943] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.0, 'max_out': 254, 'data_kind': 'true_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'true_color'} [2020-02-12 11:37:30,042] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:30,042] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:30,042] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.000000 [2020-02-12 11:37:30,042] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.297297, b=2.297297 [2020-02-12 11:37:30,299] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:30,300] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:30,300] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:30,342] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:30,568] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:31,460] : PID 16233 : INFO : polar2grid.gtiff_backend : create_geotiff : Creating geotiff 'jpss-1_viirs_true_color_20200210_184800_texasSVI.tif' [2020-02-12 11:37:31,466] : PID 16233 : DEBUG : polar2grid.gtiff_backend : create_geotiff : Creation Geotiff with options ['PHOTOMETRIC=RGB', 'COMPRESS=LZW'] [2020-02-12 11:37:31,708] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:37:32,151] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:37:32,265] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:37:49,857] : PID 16233 : DEBUG : polar2grid.gtiff_backend : create_output_from_product : Scaling false_color data to fit in geotiff... [2020-02-12 11:37:49,857] : PID 16233 : DEBUG : polar2grid.core.roles : get_config_section : Key 'false_color:uint1:false_color:jpss-1:viirs:texasSVI:True:%:viirs_l1b' matched config regular expression '^.*:.*:false_color:.*:.*:.*:.*:.*:.*$' [2020-02-12 11:37:49,857] : PID 16233 : DEBUG : polar2grid.core.roles : get_config_options : Using configuration section: rescale:default_false_color [2020-02-12 11:37:49,858] : PID 16233 : DEBUG : polar2grid.core.rescale : get_rescale_options : Product false_color found in rescale config: {'satellite': 'jpss-1', 'units': '%', 'data_type': 'uint1', 'instrument': 'viirs', 'product_name': 'false_color', 'inc_by_one': True, 'separate_rgb': 'False', 'min_in': -1.0, 'grid_name': 'texasSVI', 'max_in': 110.1, 'reader': 'viirs_l1b', 'data_kind': 'false_color', 'method': 'lookup'} [2020-02-12 11:37:50,574] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.1, 'max_out': 254, 'data_kind': 'false_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'false_color'} [2020-02-12 11:37:50,672] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:50,672] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:50,672] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.100000 [2020-02-12 11:37:50,672] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.295230, b=2.295230 [2020-02-12 11:37:50,927] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:50,927] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:50,928] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:50,970] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:51,196] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:51,419] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.1, 'max_out': 254, 'data_kind': 'false_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'false_color'} [2020-02-12 11:37:51,517] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:51,517] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:51,517] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.100000 [2020-02-12 11:37:51,517] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.295230, b=2.295230 [2020-02-12 11:37:51,776] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:51,776] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:51,776] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:51,818] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:52,045] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:52,269] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Scaling data with method lookup and arguments {'satellite': 'jpss-1', 'data_type': 'uint1', 'separate_rgb': 'False', 'min_in': -1.0, 'fill_out': 0, 'max_in': 110.1, 'max_out': 254, 'data_kind': 'false_color', 'instrument': 'viirs', 'grid_name': 'texasSVI', 'min_out': 0, 'reader': 'viirs_l1b', 'units': '%', 'product_name': 'false_color'} [2020-02-12 11:37:52,366] : PID 16233 : DEBUG : polar2grid.core.rescale : lookup_scale : Running 'lookup_scale' with LUT 'crefl' [2020-02-12 11:37:52,367] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 255.000000)... [2020-02-12 11:37:52,367] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: -1.000000, Input maximum: 110.100000 [2020-02-12 11:37:52,367] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=2.295230, b=2.295230 [2020-02-12 11:37:52,625] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Running 'linear_flexible_scale' with (min_out: 0.000000, max_out: 254.000000)... [2020-02-12 11:37:52,626] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Input minimum: 0.000000, Input maximum: 255.000000 [2020-02-12 11:37:52,626] : PID 16233 : DEBUG : polar2grid.core.rescale : linear_flexible_scale : Linear parameters: m=0.996078, b=0.000000 [2020-02-12 11:37:52,668] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Clipping data between 0.000000 and 254.000000 [2020-02-12 11:37:52,894] : PID 16233 : DEBUG : polar2grid.core.rescale : _rescale_data : Incrementing data by 1 so 0 acts as a fill value [2020-02-12 11:37:53,788] : PID 16233 : INFO : polar2grid.gtiff_backend : create_geotiff : Creating geotiff 'jpss-1_viirs_false_color_20200210_184800_texasSVI.tif' [2020-02-12 11:37:53,788] : PID 16233 : DEBUG : polar2grid.gtiff_backend : create_geotiff : Creation Geotiff with options ['PHOTOMETRIC=RGB', 'COMPRESS=LZW'] [2020-02-12 11:37:53,790] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:37:53,909] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:37:54,023] : PID 16233 : DEBUG : polar2grid.core.dtype : clip_to_data_type : Clipping data to a 0 - 255 data range [2020-02-12 11:38:12,642] : PID 16233 : INFO : viirs_l1b2gtiff : main : Processing data for grid texasSVI complete [2020-02-12 11:38:12,682] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'true_color_rgb_1.dat' [2020-02-12 11:38:12,779] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'true_color_rgb_0.dat' [2020-02-12 11:38:12,876] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'true_color_rgb_2.dat' [2020-02-12 11:38:12,974] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'false_color_rgb_1.dat' [2020-02-12 11:38:13,074] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'false_color_rgb_0.dat' [2020-02-12 11:38:13,176] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'false_color_rgb_2.dat' [2020-02-12 11:38:13,275] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_true_color.dat' [2020-02-12 11:38:13,379] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_false_color_rgb_0.dat' [2020-02-12 11:38:13,411] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_false_color_rgb_1.dat' [2020-02-12 11:38:13,441] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_false_color_rgb_2.dat' [2020-02-12 11:38:13,471] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'grid_texasSVI_false_color.dat' [2020-02-12 11:38:13,472] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'viirs_6432_6400_i_lon_i_lat_lon.dat' [2020-02-12 11:38:13,527] : PID 16233 : DEBUG : polar2grid.core.containers : cleanup : Removing associated file that is no longer needed: 'viirs_6432_6400_i_lon_i_lat_lat.dat'