The Junar API is the basis for a number of Open Data initiatives in Latin America and the USA. The junr package is a wrapper to make it easier to access data made public through the Junar API. Some examples of implementations are: the City of Pasadena, and the City of San Jose. Others are listed on the Junar website.
As an example we will use the data from the Costa Rican President’s Office.The first step is to access the website offering the open data to identify the base URL and to obtain an API Key to get access to the Junar API that hosts the data. You will find both on the developers page of the Open Data Costa Rica site.
Below we use a test API Key so that all the examples will run. You may want to get your own API Key instead to run the examples below. Note that with Junar each URL has its own API key.
library(junr)
base_url <- "http://api.datosabiertos.presidencia.go.cr/api/v2/datastreams/"
api_key <- "0bd55e858409eefabc629b28b2e7916361ef20ff" Now that we have the basic information for a connection we can quickly check what data is available behind this URL.
get_index(base_url, api_key)The get_indexfunction returns the complete list of available data with all meta-data included as a data frame.
To get only a list of the global unique identifiers (GUID) of the data sets, you can use list_guid.
list_guid(base_url, api_key)## [1] "PLANI-DEL-MINIS" "EJECU-DE-PRESU-DE-INSTI"
## [3] "COMPR-PUBLI-DE-PRESI" "LICIT-ADJUD-POR-LAS-INSTI"
## [5] "DESCR-DE-ABREV-DE-LAS" "EJECU-DE-PRESU-DE-50724"
## [7] "LICIT-ADJUD-DE-LAS-INSTI" "DATOS-CORRE-AL-PAGO-32327"
## [9] "COMPR-PUBLI-DEL-MINIS" "LICIT-ADJUD-POR-LAS-81483"
## [11] "DATOS-CORRE-AL-PAGO-DE" "LICIT-ADJUD-POR-LOS-MINIS"You can also make a list of the titles of the data sets:
list_titles(base_url, api_key)## [1] "Ministerio de la Presidencia"
## [2] "Ejecución de presupuesto de Instituciones para el 2015"
## [3] "Compras públicas de Presidencia"
## [4] "Licitaciones adjudicadas por las Instituciones Públicas según año"
## [5] "Descripción de abreviaturas de las ejecuciones "
## [6] "Ejecución de presupuesto de Instituciones para el 2014"
## [7] "Licitaciones Adjudicadas de las Instituciones Públicas para el período 2014-2015"
## [8] "Datos correspondientes al pago de planilla del Ministerio"
## [9] "Compras públicas del Ministerio de la Presidencia"
## [10] "Licitaciones adjudicadas por las Instituciones Públicas según tipo de trámite"
## [11] "Datos correspondientes al pago de planilla de Presidencia"
## [12] "Licitaciones adjudicadas por los Ministerios"Both list_guid and list_titles where set up for convenience only because the results tend to fit in the console window making it easier to read. They are meant to help to get a quick overview of the available data.
You need to know the Global Unique Identifier (GUID) of the data set that you are interested in to be able to download them to your R session. You can look for the GUID on the web page that shows the data of interest. For example on the page for public expenditure of the Costa Rican government there is a table called “Public Purchasing of the Ministry of the Presidency”. In the menu underneath the table you have an option to “Obtain GUID”. This last option opens a pop-up showing the GUID “COMPR-PUBLI-DEL-MINIS” that we are going to use in the example below.
data_guid <- "COMPR-PUBLI-DEL-MINIS"
purchasing_data <- get_data(base_url, api_key, data_guid)With View(purchasing_data) you can check whether the data have been downloaded correctly, and have a quick visual check on the mode of the data (see below to convert currency data from text to numeric).
You may note that if you do not need to go to the web interface to get the GUID for any data sets of interest. With the function list_guid() as we used it above, we obtained the same information.
pres_list <-list_guid(base_url, api_key)
pres_list[3]## [1] "LICIT-ADJUD-POR-LOS-MINIS"We can get the GUID we are interested in by fetching the third entry in the list of GUID’s (see the full list in the example above). And the same index numbers can be used with a list of full titles created with list_titles().
On data platforms that run Junar, many data sets are just tables of data that has already been analyzed and summarized. It is not immediately obvious which sets contain many data points, and which sets contain only a few rows.
The function get_dimensions will download all data sets offered through the base URL and determine how many rows and columns are available in each one. It is useful to make a quick assessment of the data available. However, please note that it may take a while before the function finishes, especially if there are many GUID’s.
get_dimensions(base_url, api_key)## GUID NROW NCOL DIM
## 2 PLANI-DEL-MINIS 5561 8 44488
## 21 EJECU-DE-PRESU-DE-INSTI 8867 39 345813
## 3 LICIT-ADJUD-POR-LOS-MINIS 10 2 20
## 4 COMPR-PUBLI-DE-PRESI 427 4 1708
## 5 LICIT-ADJUD-POR-LAS-INSTI 3 2 6
## 6 DESCR-DE-ABREV-DE-LAS 27 4 108
## 7 EJECU-DE-PRESU-DE-50724 9249 40 369960
## 8 LICIT-ADJUD-DE-LAS-INSTI 103471 7 724297
## 9 DATOS-CORRE-AL-PAGO-32327 5561 10 55610
## 10 COMPR-PUBLI-DEL-MINIS 324 4 1296
## 11 LICIT-ADJUD-POR-LAS-81483 7 2 14
## 12 DATOS-CORRE-AL-PAGO-DE 2472 10 24720In the example data above, and possibly in more Junar implementations, we need to clean up any data related to currency values. In our case we need to found all currency symbols (Costa Rica Colon) and all the comma’s separating thousands. As they stand these values are text strings, and cannot be converted directly to numeric without removing the symbols and commas.
There are two utilities to help cleaning the currency data: clean_currency and get_currency_symbol. For example:
currency_data <- get_data(base_url, api_key, "LICIT-ADJUD-POR-LOS-MINIS")
currency_data$`Monto Adjudicado` <- clean_currency(currency_data$`Monto Adjudicado`)