Changelog
Version 0.1.5¤
- moved summary logging from pipeline into each step
- removed temporal fusion from preprocessing pipeline
- added option to disable exact shape cropping in the preprocessing pipeline
maskis now able to process different src resolutions in combnination with a different mask resolution- switched
mergingandcroppingin the preprocessing pipeline mergeis now optimized for huge files by processing in tiles, restricting the maximum RAM usageresampleis now optimized for huge files by processing in tiles, restricting the maximum RAM usage- fixed CDSE collections
- fixed (1) from 0.1.0
resampleis now calculating the largest extends for self reference- implemented
monthlytemporal fusion - implemented
quarterlytemporal fusion - implemented
meancalculation during temporal fusion - CUPY is now optional, installation is possible on machines without a NVIDIA GPU
- CDSE removed naming filter option (obsolete)
Version 0.1.4¤
- The copy function now skips already existing files
- The EOSDIS retrieve parameter "shapefile_path" is now optional
- Fixed a bug where the HDF projection parameters where mandatory in input metadata files
- Fixed a bug where the optional parameter end_date in the EOSDIS search was not optional and resulted into a error
- Fixed EOSDIS download of uncompressed files
- Fixed a bug where the enhance function did not create the output directory
- Fixed a bug where Landsat Lvl 1 metadata was not supported
- The copy function now skips the extraction of HDF files if a folder with the same name already exists in the output directory
- The resampling function can now handle reference files with a different band count
- Fixed a bug in the resampling function which resulted in an output overwriting nodata pixels
- Teh copy function is now able to copy file types other than .tif lik .xml for further processing
(1) and (2) from 0.1.0 are still open
Version 0.1.3¤
- Removed cloud filter for USGS data retrieval
- added min and max masked area filter function
- implemented STARFM for automated directory processing
- collection for EOSDIS is now the entry title not the short name
- added temporal fusion method CONNECTED_AND_NEXT
- added parallel downloads for EOSDIS
- the crop function now optionally deletes or not copies results which have no data (values != 0)
Version 0.1.2¤
- Optimizted cropping
- Fixed crashes with multitprocessing (failsafe and restart mechanism with less workers)
- Implemented multiprocessing for masking
- Implemented multiprocessing for resampling
- Implemented multiprocessing for temporal fusion
- Removed GPU support for merge and temporal fusion (no advantage)
- Fixed 1 pixel diff in resolution after pipeline execution
Version 0.1.1¤
- Fixed caching of already downloaded files for USGS
- Increased masking performance by up to 70%
- Switched cropping and resampling in preprocessing pipeline
- Added temporal fusion to preprocessing pipeline
Version 0.1.0¤
- Performance improvement of the
mergefunction by bringing it to the GPU - Implementation of temporal fusion
- Implementation of simple fusion of different data sources (same resolution)
- Moved masking to first step in preprocessing pipeline
Known Issues
-
(1) The resampling implementation of Rasterio does not care about nodata areas causing a black border if interpolation methods other then NN are used. This is the case for the resampling step in the pipeline. Therefore if fused with other sources black or nearly black pixels can occure inside the image. This will be fixed with our own resampling implementation.
-
(2) Fusion of images taken at different sun angles causing the result to show darker and lighter areas
Version 0.0.9 and earlier¤
no changelog available