_0a-combine-private-residential-data.Rmd

---
title: "Combine all csv files into one RDS"
output: #html_notebook
---

This script combines the entire directory of csv files into a single dataset and outputs it as a RDS file.

```{r setup}
source("misc/load_libraries.R")
```

```{r append all csvs into one dataset}
private_datasets <- Sys.glob("data/raw/private/*.csv")
transactions <- private_datasets %>% map(read_csv, col_types = "cciiciciicccccciiccc") %>% tibble() %>% unnest()
transactions
```

```{r rename dataset columns}
names(transactions) <- c(
    "project_name", "address", "no_units", "area", "type_of_area",
    "trans_price", "nett_price", "price_psm", "price_psf", "sale_date",
    "property_type", "tenure", "completion_date", "type_of_sale",
    "hdb_buyer", "postal_district", "postal_sector", "postal_code",
    "planning_region", "planning_area"
)
transactions
```

```{r write dataset}
transactions %>% write_rds("data/raw/private/private.RDS")
transactions %>% 
    filter(property_type %in% c("Condominium", "Apartment", "Executive Condominium")) %>% 
    write_rds("data/raw/private/non-landed.RDS")
```