[2025-10-11 20:30:22,939] : DEBUG : abi_l1b_geotiff : _prepare_initial_logging : Starting script with arguments: -r abi_l1b -w geotiff -p true_color_night -f /input/OR_ABI-L1b-RadC-M6C01_G19_s20252842026179_e20252842028552_c20252842029016.nc /input/OR_ABI-L1b-RadC-M6C02_G19_s20252842021179_e20252842023552_c20252842023578.nc /input/OR_ABI-L1b-RadC-M6C02_G19_s20252842026179_e20252842028552_c20252842028579.nc /input/OR_ABI-L1b-RadC-M6C03_G19_s20252842026179_e20252842028552_c20252842028589.nc -vv [2025-10-11 20:30:22,940] : INFO : abi_l1b_geotiff : _run_processing : Sorting and reading input files... [2025-10-11 20:30:22,940] : DEBUG : abi_l1b_geotiff : _set_preferred_chunk_size : Setting preferred chunk size to 1356 pixels or 14MiB [2025-10-11 20:30:22,951] : DEBUG : satpy.readers.yaml_reader : load_yaml_configs : Reading ('/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/etc/readers/abi_l1b.yaml',) [2025-10-11 20:30:23,032] : DEBUG : satpy.readers.yaml_reader : create_filehandlers : Assigning to abi_l1b: ['/input/OR_ABI-L1b-RadC-M6C01_G19_s20252842026179_e20252842028552_c20252842029016.nc', '/input/OR_ABI-L1b-RadC-M6C02_G19_s20252842026179_e20252842028552_c20252842028579.nc', '/input/OR_ABI-L1b-RadC-M6C02_G19_s20252842021179_e20252842023552_c20252842023578.nc', '/input/OR_ABI-L1b-RadC-M6C03_G19_s20252842026179_e20252842028552_c20252842028589.nc'] [2025-10-11 20:30:23,288] : PID 82 : DEBUG : polar2grid.core.script_utils : rename_log_file : Log renamed from '/output/abi_l1b_geotiff_fail.log' to 'abi_l1b_geotiff_20251011_202117.log' [2025-10-11 20:30:23,289] : PID 82 : INFO : abi_l1b_geotiff : _run_processing : Loading product metadata from files... [2025-10-11 20:30:23,289] : PID 82 : DEBUG : satpy.composites.config_loader : load_compositor_configs_for_sensor : Looking for composites config file abi.yaml [2025-10-11 20:30:24,181] : PID 82 : DEBUG : satpy.composites.config_loader : load_compositor_configs_for_sensor : Looking for composites config file visir.yaml [2025-10-11 20:30:24,270] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,278] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_azimuth_angle', calibration='reflectance') [2025-10-11 20:30:24,278] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,279] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_azimuth_angle', calibration='reflectance') [2025-10-11 20:30:24,280] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,283] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,292] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_azimuth_angle', calibration='reflectance') [2025-10-11 20:30:24,292] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,293] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_azimuth_angle', calibration='reflectance') [2025-10-11 20:30:24,293] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,297] : PID 82 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-10-11 20:30:24,300] : PID 82 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C03. [2025-10-11 20:30:24,380] : PID 82 : WARNING : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c14' not found or loaded for 'C14' [2025-10-11 20:30:24,381] : PID 82 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C02. [2025-10-11 20:30:24,437] : PID 82 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C02. [2025-10-11 20:30:24,506] : PID 82 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C01. [2025-10-11 20:30:24,568] : PID 82 : DEBUG : satpy.modifiers.geometry : __call__ : Applying sun zen correction [2025-10-11 20:30:24,569] : PID 82 : DEBUG : satpy.modifiers.geometry : __call__ : Computing sun zenith angles. [2025-10-11 20:30:24,584] : PID 82 : DEBUG : satpy.modifiers.geometry : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2025-10-11 20:30:24,602] : PID 82 : DEBUG : h5py._conv : : Creating converter from 7 to 5 [2025-10-11 20:30:24,603] : PID 82 : DEBUG : h5py._conv : : Creating converter from 5 to 7 [2025-10-11 20:30:24,603] : PID 82 : DEBUG : h5py._conv : : Creating converter from 7 to 5 [2025-10-11 20:30:24,604] : PID 82 : DEBUG : h5py._conv : : Creating converter from 5 to 7 [2025-10-11 20:30:24,764] : PID 82 : INFO : satpy.modifiers.atmosphere : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'rayleigh_only' for 'C02' [2025-10-11 20:30:24,766] : PID 82 : INFO : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard [2025-10-11 20:30:24,768] : PID 82 : DEBUG : pyspectral.rayleigh : __init__ : LUT filename: /software/geo2grid_v_1_1/pyspectral_data/rayleigh_only/rayleigh_lut_us-standard.h5 [2025-10-11 20:30:24,769] : PID 82 : DEBUG : pyspectral.rsr_reader : _get_filename : Filename: /software/geo2grid_v_1_1/pyspectral_data/rsr_abi_GOES-19.h5 [2025-10-11 20:30:24,769] : PID 82 : DEBUG : pyspectral.rsr_reader : _check_filename_exist : Filename: /software/geo2grid_v_1_1/pyspectral_data/rsr_abi_GOES-19.h5 [2025-10-11 20:30:24,771] : PID 82 : DEBUG : h5py._conv : __getitem__ : Creating converter from 3 to 5 [2025-10-11 20:30:24,772] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,774] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,776] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,778] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,779] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,781] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,783] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,785] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,787] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,788] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,790] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,792] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,793] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,795] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,797] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,799] : PID 82 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-10-11 20:30:24,804] : PID 82 : DEBUG : pyspectral.rayleigh : _get_effective_wavelength_and_band_name : Band name: ch2 Effective wavelength: 0.635401um [2025-10-11 20:30:24,808] : PID 82 : ERROR : abi_l1b_geotiff : exc_handler : Unexpected error. Enable debug messages (-vvv) or see log file for details. [2025-10-11 20:30:24,808] : PID 82 : DEBUG : abi_l1b_geotiff : exc_handler : Unexpected error exception: Traceback (most recent call last): File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 494, in sys.exit(main()) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 277, in main ret = processor() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 331, in __call__ return self._run_processing() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 362, in _run_processing scn.generate_possible_composites(True) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1417, in generate_possible_composites keepables = self._generate_composites_from_loaded_datasets() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1436, in _generate_composites_from_loaded_datasets return self._generate_composites_nodes_from_loaded_datasets(needed_comp_nodes) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1442, in _generate_composites_nodes_from_loaded_datasets self._generate_composite(node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1500, in _generate_composite composite = compositor(prereq_datasets, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/modifiers/atmosphere.py", line 71, in __call__ refl_cor_band = corrector.get_reflectance(sunz, satz, ssadiff, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 270, in get_reflectance res = _map_blocks_or_direct_call(self._relax_rayleigh_refl_correction_where_cloudy, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 59, in _map_blocks_or_direct_call return da.map_blocks(func, *args, **kwargs) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/core.py", line 873, in map_blocks out = blockwise( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/blockwise.py", line 269, in blockwise raise ValueError( ValueError: Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks [2025-10-11 20:30:24,811] : PID 82 : ERROR : traceback : exc_handler : Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks Traceback (most recent call last): File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 494, in sys.exit(main()) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 277, in main ret = processor() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 331, in __call__ return self._run_processing() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 362, in _run_processing scn.generate_possible_composites(True) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1417, in generate_possible_composites keepables = self._generate_composites_from_loaded_datasets() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1436, in _generate_composites_from_loaded_datasets return self._generate_composites_nodes_from_loaded_datasets(needed_comp_nodes) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1442, in _generate_composites_nodes_from_loaded_datasets self._generate_composite(node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1500, in _generate_composite composite = compositor(prereq_datasets, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/modifiers/atmosphere.py", line 71, in __call__ refl_cor_band = corrector.get_reflectance(sunz, satz, ssadiff, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 270, in get_reflectance res = _map_blocks_or_direct_call(self._relax_rayleigh_refl_correction_where_cloudy, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 59, in _map_blocks_or_direct_call return da.map_blocks(func, *args, **kwargs) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/core.py", line 873, in map_blocks out = blockwise( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/blockwise.py", line 269, in blockwise raise ValueError( ValueError: Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks