isd()now using a new packageisdparserto parse NOAA ISD files. We still fetch the file withinrnoaa, but the file parsing is done byisdparser(#176) (#177) (#180) thanks @mrubayet for the push
- Fixed precipitation units in docs for
meteo_*functions (#178) thanks @mrubayet
- Fixed bug in
ghcnd()where internal unexported function was not found (#179) - Fix to
isd_stations()andisd_stations_search()to work correctly on Windows (#181) thanks @GuodongZhu - Changed base URL for all NOAA NCDC functions (those starting with
ncdc) tohttpsfromhttp(#182) thanks @maspotts - Changed base URL for all NOAA HOMR functions (those starting with
homr) tohttpsfromhttp(#183)
- Added notes to docs of functions that do file caching - where to find cached files.
meteo_clear_cachegains parameterforceto controlforceparameter inunlink()- Removed
lubridateusage inseaiceurls()function, just using base R functions.
- Fixed bug which was affecting binary installs only. We accidentally determined a path on package build, such that the user of the CRAN binary build machine got inserted into the path. This is now fixed. (#173)
- New function
isd_read()to read ISD output fromisd()manually instead of lettingisd()read in the data. This is useful when you useisd()but need to read the file in later when it's already cached. (#169) - Some functions in
rnoaacache files that are downloaded from various NOAA web services. File caching is usually done when data comes from FTP servers. In some of these functions where we cache data, we used to write to your home directory, but have now changed all these functions to write to a proper cache directory in a platform independent way. We determine the cache directory usingrappdirs::user_cache_dir(). Note that this may change your workflow if you'd been depending on cached files to be a in particular place on your file system. In addition, thepathparameter in the changed functions is now defunct, but you get an informative warning about it (#171)
storm_data()now returns a tibble/data.frame not inside of a list. We used to return a list with a single slotdatawith a data.frame, but this was unnecessary.ghcnd_stations()now outputs a data.frame (tbl_df) by itself, instead of a data.frame nested in a list. This may change how you access data from this function. (#163)- Improved docs on token usage for NCDC functions (with prefix
ncdc_*()) (#167) - Added note to
isd()docs that when you get an error similar toError: download failed for ftp://ftp.ncdc.noaa.gov/pub/data/noaa/1955/011490-99999-1955.gz, the file does not exist on NOAA's ftp servers. If your internet is down, you'll get a different error saying as much (#170)
- A large PR was merged with a suite of functions. Most functions added
a prefixed with
meteo_*, and are meant to find weather monitors near locations (meteo_nearby_stations), find all monitors within a radius of a location (meteo_distance), calculate the distances between a location and all available stations (meteo_process_geographic_data), calculate the distance between two locations (meteo_spherical_distance), pull GHCND weather data for multiple weather monitors (meteo_pull_monitors), create a tidy GHCND dataset from a single monitor (meteo_tidy_ghcnd), and determine the "coverage" for a station data frame (meteo_coverage()). In addition,vis_miss()added to visualize missingness in a data.frame. See the PR diff against master for all the changes. (#159) Thanks a ton to @geanders et al. (@hrbrmstr, @maelle, @jdunic, @njtierney, @leighseverson, @RyanGan, @mandilin, @jferreri, @cpatrizio88, @ryan-hicks, @Ewen2015, @mgutilla, @hakessler, @rodlammers)
isd_stations_search()changed internal structure. We replaced usage ofgeojsonioandlawnfor fasterdplyr::filterfor bbox inputs, andmeteo_distance()forlat/long/radiusinputs . This speeds up this function significantly. Thanks to @lukas-rokka (#157)isd_stations_search()andisd_stations()now return tibble's instead of data.frame's- Removed cached ISD stations dataset within package to reduce
package size. Only change is now that on first use of the function
the user has to download the entire thing, but on subsquent
uses it will pull from the cached version on the users machine.
isd_stations_search()now caches usingrappdirs(#161) - Convert all
is()uses toinherits()
- Fixed
seaiceeurls()function that's used to generate urls for theseaice()function - due to change in NOAA urls (#160) - Fix to function
ghncd_split_vars()to not fail ondplyr::containscall (#156) thanks @lawinslow !
- Fixes for new
httrversion to call encoding explicitly (#135) - Fix to broken link for reference to source code used in
gefsfunctions (#121) - Speed ups implemented for the
isd()function - it's a time consuming task as we have to parse a nasty string of characters line by line - more speed ups to come in future versions (#146) - Replace
dplyr::rbind_all()withdplyr::bind_rows()as the former is being deprecated (#152)
- Fix for
isd()function - was failing on some station names that had leading zeros. (#136) - Fix for
ncdc_stations()- used to allow more than one station id to be passed in, but internally only handled one. This is a restriction due to the NOAA NCDC API. Documentation now shows an example of how to deal with many station ids (#138) - Fixes to the suite of
ncdc_*()functions to allow multiple inputs to those parameters where allowed (#139) - Fixed bug in
ncdc_plot()due to newggplot2version (#153) - Fixed bugs in
argo()functions: a) with newhttr, box input of a vector no longer works, now manually make a character vector; b) errant file param being passed into the http request, removed (#155)
- New data source added: ARGO buoy data. See functions starting with
argo()(#123) for more, see http://www.argo.ucsd.edu/ - New data source added: CO-OPS tide and current data. See function
coops_search()(#111) for idea from @fmichonneau (#124) for implementing @jsta See http://co-ops.nos.noaa.gov/api/ also (#126) (#128)
rgdalmoved to Suggests to make usage easier (#125)- Changes to
ncdc_plot()- made default brakes to just default to whatggplot2does, but you can still pass in your own breaks (#131)
- New data source added: NOAA Global Ensemble Forecast System (GEFS) data.
See functions
gefs(),gefs_dimension_values(),gefs_dimensions(),gefs_latitudes(),gefs_longitudes(), andgefs_variables()(#106) (#119) thanks @potterzot - he's now an author too - New data source added: NOAA Extended Reconstructed Sea Surface Temperature
(ERSST) data. See function
ersst()(#96) - New function
isd_stations()to get ISD station data. - Added code of conduct to code repository
- Swapped
ncdfpackage forncdf4package. Windows binaries weren't availiable forncdf4prior to now. (#117) - Proper license info added for javascript modules used inside the package (#116)
- Improvements to
isd()function to do transformations of certain variables to give back data that makes more sense (#115) leaflet,geojsonio, andlawnadded in Suggests, used in a few functions.- Note added to
swdi()function man page that thenldndataset is available to military users only (#107)
- Fix to
buoy()function to accept character class inputs for thebuoyidparameter. the error occurred because matching was not case-insensitive, now works regardless of case (#118) - Fixes for new
ggplot2version (#113) - Built in
GETrequest retries forghncdfunctions as some URLs fail unpredictably (#110)
- Explicitly import non-base R pkg functions, so importing from
utils,methods, andstats(#103) - All NCDC legacy API functions are now defunct. See
?rnoaa-defunctfor more information (#104) radiusparameter removed fromncdc_stations()function (#102), was already removed internally within the function in the last version, now not in the function definition, see also (#98) and (#99)- Dropped
plyranddata.tablefrom imports.plyr::rbind.fill()anddata.table::rbindlist()replaced withdplyr::bind_rows().
- Fixed problem with
httrv1where empty list not allowed to pass to thequeryparameter inGET(#101)
- Gains a suite of new functions for working with NOAA GHCND data, including
ghcnd(),ghcnd_clear_cache(),ghcnd_countries(),ghcnd_search(),ghcnd_splitvars()ghcnd_states(),ghcnd_stations(), andghcnd_version()(#85) (#86) (#87) (#88) (#94) - New contributor Adam Erickson (@DougFirErickson)
- All NOAA buoy functions put back into the package. They were previously on a separate branch in the GitHub repository. (#37) (#71) (#100)
- Minor adjustments to
isd()functions, including better man file. - Cleaner package imports - importing mostly only functions used in dependencies.
- Startup message gone.
calloptsparameter changed to...in functionswdi().- More robust test suite.
ncdc()requires that users do their own paging - previously this was done internally (#77)- Many dependencies dropped, simplifying package:
RCurl,maptools,stringr,digest. A few new ones added:dplyr,tidyr.
- All
erddapfunctions now defunct - see the package rerddap, a general purpose R client for ERDDAP servers. (#51) (#73) (#90) (#95) - The
extentfunction innoaa_stations()used to accept either a bounding box or a point defined by lat/long. The lat/long option dropped as it required two packages, one of which is a pain to install for many users (#98) (#99)
- New data source NOAA legacy API with ISD, daily, and ish data via function
ncdc_legacy(). (#54) - New function
isd()to get ISD data from NOAA FTP server. (#76) - ERDDAP gridded data sets added. Now tabledap datasets are accessible via
erddap_table(), while gridded datasets are available viaerddap_grid(). Helper functionerddap_search()was modified to search for either tabledap or griddap datasets, anderddap_info()gets and prints summary information differently for tabledap and griddap datasets. (#63)
erddap_data()defunct, now as functionserddap_table()anderddap_grid(), uses newstoreparameter which takes a function, eitherdisk(path, overwrite)to store on disk ormemory()to store in R memory.assertthatlibrary removed, replaced withstopifnot()
- New data source added (NOAA torndoes data) via function
tornadoes(). (#56) - New data source added (NOAA storm data from IBTrACS) via functions
storm_*(). (#57) - New data source added (NOAA weather station metadata from HOMR) via functions
homr_*()(#59) - New vignettes for storm data and homr data.
- Some functions in rnoaa now print data.frame outputs as
dplyr-like outputs with a summary of the data.frame, as appropriate.
- Across all
ncdc_*functions changedcalloptsparameter to.... This parameter allow you to pass in options tohttr::GETto modify curl requests. (#61) - A new helper function
check_key()looks for one of two stored keys, as an environment variable under the nameNOAA_KEY, or an option variable under the namenoaakey. Environment variables can be set during session likeSys.setenv(VAR = "..."), or stored long term in your.Renvironfile. Option variables can be set during session likeoptions(var = "..."), or stored long term in your.Rprofilefile. is.*andprint.*functions no longer have public man files, but can be seen viarnoaa:::if needed.
- New package imports:
sp,rgeos,assertthat,jsonlite, andncdf4, and new package Suggests:knitr,taxize - Most function names changed. All
noaa*()functions for NCDC data changed toncdc*().noaa_buoy()changed tobuoy().noaa_seaice()changed toseaice(). When you call the old versions an error is thrown, with a message pointing you to the new function name. See ?rnoaa-defunct. - New vignettes: NCDC attributes, NCDC workflow, Seaice vignette, SWDI vignette, ERDDAP vignette, NOAA buoy vignette.
- New functions to interact with NOAA ERDDAP data:
erddap_info(),erddap_data(), anderddap_search(). - New functions to interact with NOAA buoy data:
buoy(), including a number of helper functions. ncdc()now splits apart attributes. Previously, the attributes were returned as a single column, but now there is column for each attribute so data can be easily retrieved. Attribute columns differ for each differentdatasetid.buoy()function has been removed from the CRAN version ofrnoaa. Install the version withbuoy()and associated functions viadevtools::install_github("ropensci/rnoaa", ref="buoy")
noaa_swdi()(function changed toswdi()) gains new parameterfilepathto specify path to write a file to ifformat=kmzorformat=shp. Examples added for usingformat=csv, shp, and kmz.- Now using internal version of
plyr::compact. - Added API response checker/handler to all functions to pass on helpful messages on server errors.
ncdc()gains new parameterincludemetadata. If TRUE, includes metadata, if not, does not, and response should be faster as does not take time to calculate metadata.noaa_stations()gains new parameterradius. Ifextentis a vector of length 4 (for a bounding box) then radius is ignored, but if you pass in two points toextent, it is interpreted as a point, and thenradiusis used as the distance upon which to construct a bounding box.radiusdefault is 10 km.
datasetid,startdate, andenddateare often required parameters, and changes were made to help users with this.
- Submitted to CRAN.
- Wrote new functions for NOAA API v2.
- A working vignette now.
- Wrappers for NOAA API v1 were written, not on CRAN at this point.