dataDWD: gracefully handle links with https base (instead of ftp)readDWD.hyras: initial releasereadDWD.multia: new argument tryenc to try different encodingsreadDWD.data: convert timestamp to as.DatereadDWD.grib2: pack option rgdal removed.raster/rgdal/sp code replaced with terra codedataDWD: dir default set to locdir()findID+selectDWD: new argument failempty to stop instead of warn if name does not matchreadDWD.grib2: rgdal retirement warning addeddataDWD + readDWD: new argument hr to auto-merge historical and recent filescreateIndex: speed and correctness improvedrunLocalTests: tests expanded, internally restructuredreadDWD: new argument quietreadplotDWDlocdir (will replace fixed "DWDdata" folder in dataDWD)readDWD.derivreadDWD.rklimreadDWD.pdfvalidFileTypes (charstring vector)selectDWD: is completely rewritten and now vectorizes expandinglydataDWD: new argument method, new default for overwritemetaInfo: accepts custom indexreadDWD.radar: new argument dividebytenreadDWD.grib2: new argument packreadVars: new argument quiet (for updateIndexes)readDWD.grib2: initial releaseprojectRasterDWD: new argument adjust05dataDWD: new default: dbin=TRUEreadDWD.data: fread checks for system command unzip, prints final value in messagedataDWD: unfound URL messages also link to website fileIndex in German localeupdateRdwd: version and date comparison improved, print local version if newer than on githubcreateIndex: improved recognition of "Beschreibung_Stationen" meta filesdwdparams + updateIndexes: missing/duplicate 'Kurz' entry messages improvedreadDWD: subfunction names in elegant message outside the loop to avoid interrupted progbars.indexFTP + dirDWD: trailing slashes removed with regexpfileType: more informative message for failed type determinationDEU: now derived from NUTS regions and with new CRS (along with EUR)runLocalTests: improved logfiles, false positive messages removeddataDWD: argument file renamed to url to avoid confusion with local file namesreadDWD: fread default set to NA. This is an experiment, see issue #22readDWD: now has argument type (determined by new function fileType) to replace the ever growing list of typesdataDWD, readDWD, selectDWD: order of arguments changed to reflect importanceplotRadar: gains arguments axes, las, zlim, col, mar, keeppar. main now defaults to (and correctly keeps) x@title.selectDWD: gains argument remove_dupli to ignore DWD file upload errorsreadDWD.*: All subfunctions message their identity and have a quiet argumentrdwdquiet()readDWD.meta: station and bundesland names are now char instead of factor (since R 4.0.0)indexFTP: new argument fast to read file tree with data.tablecreateIndex: gains argument checklogrunLocalTests: new arguments for devtools::check and checkIndexreadVars: params now an explicit argument (defaults to dwdparams)EUR: extends further east for plots with large width compared to heightupdateRdwd: unloads package before installation and informs about the need to re-loadcheckIndex: new check for duplicate meta files, writes to logfile (append, no overwrite), nicer path print, logs modification time of index fileslldist: fix error that occurred when a df with a single row was givenrunLocalTests: warning logfile cleared before writing, checkIndex results included, false positives removed, on githubreadDWD.*)metaInfo: from/to columns date conversion correctedindexFTP + dataDWD: up to date and centralized sleep informationdataDWD: Download failure message improved, refer to fileIndex section on homepage if applicable.readDWD.nc: ncdf warning suppressedselectDWD: combines all warnings within the loop to a single messageplotRadar used for nice mapsquiet=TRUE all the timeprojectRasterDWD: latlon=T/F replaced with targetprojreadDWD.binary: output list element renamed to 'dat' (from 'data') for consistency with other functionsdataDWD: new argument dbinupdateRdwd, plotRadarreadDWD.data: now correctly reads 10 minute timestampsreadDWD.meta: column widths identified more elegantly and safelyindexFTP: warn about requests to https instead of ftp servers, new argument exclude.latest.binaddBorders: added sp to 'Suggests', moved DEU + EUR to inst/extdata to handle CRAN build+check on systems without sp installedreadRadarFile expanded + moved to own package (dwdradar) with proper tests and better warningsreadDWD.binary: untarring improvedprojectRasterDWD: default extents + projs added for seasonal + ncreadDWD: order and documentation of method selection improvedmetaIndex + fileIndex: date columns are now of class DatedataDWD: force can now be number of hours after which to re-downloadreadDWD.radar + readDWD.nc + readDWD.standcheckSuggestedPackagesEUR + addBordersformatIndexrunLocalTestsupdateIndexes (not exported)readDWD subfunctions now have their own documentationdataDWD: arguments to readDWD removed (can be passed with ...)dataDWD: gains joinbf argument to join base and relative url pathreadDWD: can expand DWD abbreviations in column names (varnames=TRUE)readDWD: source code structure is improved.readDWD.multia: ignores EndOfFile characters in multiannual data on UnixreadDWD.raster: accepts gunzip arguments, reads faster on second callsreadDWD.data: informatively handles empty filesreadDWD.binary+raster+asc: overlay Germany maps in example plotsreadDWD.binary: unzips into a given exdir (and reads faster on second calls)readDWD.binary: transforms output to a raster stackselectDWD: suggests only available data in interactive optionselectDWD and nearbyStations: fail informatively for typical errorsfileIndex: loses the unnnecessary leading slashesindexFTP: uses tree of files at new FTP servernewColumnNamesdwdparams (renamed from parameter_abreviations)gridbasegridIndexprojectRasterDWDlocaltestdir (though mainly for internal usage)readDWD.ascreadRadarfile + bin2num + FORTRAN codecheckIndexFirst major version increase!
selectDWD got a very noticable performance boost and an interactive res/var/per selection.dataDWD: dots now passed to readDWD, download errors checked and returned as informative warningreadDWD: reading functions added for binary, raster and multi_annual files, MESS_DATUM POSIXct column added in monthly data, list output now namedindexFTP: now removes duplicates from file list, sped up in default 1min/prec usagereadVars: parameter abbreviations completed, output now visibleselectDWD: order of arguments changed, interactive res/var/per selection enabled, computing speed extremely increasedlocaltests.R heavily expanded, examples reduced and refinednearbyStations examplereadMeta, dwdbase (central package base url)dataDWD: argument force can now be NA to download files older than 24 hoursindexFTP: got much smarter in discerning files from foldersreadVars, along with parameter_abreviationsselectDWDdataDWD,readDWD,selectDWD: file ending checks more elegantcreateIndex: updated to handle the new filesreadDWD: readDWD.data and readDWD.meta are now separate (non-exported) functionsreadDWD: fread default is now FALSEdataDWD: fread and overwrite arguments addedindexFTP: ftp blockage chance reduced, data loss avoided, progress bar addedmetaInfo: tells about non-public filescreateIndex + readDWD: read meta files in German locale to handle Umlauterenamed: indexDWD -> indexFTP
added: lldist, maxlldist, nearbyStations
no longer exported in NAMESPACE: rowDisplay, dirDWD
removed: fileDWD, geoIndexAll
geoIndexfileDWD and dirDWDmetaInfo: printout greatly improvedrowDisplaygeoIndexAllmapDWD (to reduce package size)Initial release of the package, development can be seen at https://github.com/brry/rdwd/compare/master@{2016-10-19}...master@{2017-01-24}
selectDWD: uses index information to find files matching a path or station criteria.dataDWD and readDWD download and read data.dirDWD and fileDWD: control that no file will be overwritten and path messages are useful.indexDWD: lists all the files on the FTP server with DWD data.createIndex: uses that list to create fileIndex, metaIndex and geoIndex.mapDWD: is an interactive leaflet map also useful to explore datasets.Note: dataDWD and readDWD were started in June 2016 within my misc package berryFunctions, from which they will be deleted after rdwd is on CRAN