Working with NYC OpenData offers an exciting opportunity to gain valuable insights from the vast resources available in New York City. However, challenges arise when dealing with various datasets due to a lack of standardization, inconsistent code usage, changing codes between versions, and different spatial reference formats (NAD83 or WGS84). Additionally, formatting errors may occur in the results.
This API aims to:
- Standardize the Data Dictionary: Establish a consistent data structure and terminology for seamless integration and analysis of NYC Open Data.
- Centralize ESRI Shape Files: Provide a single, organized repository for ESRI Shape Files to ensure easy accessibility.
- Reduce ETL Workflow: Streamline the Extract, Transform, Load (ETL) process by storing data on a traditional file share, making it accessible to other applications in the stack.
- RESTful API: This API follows the REST architecture, providing a standardized, easy-to-use interface to interact with and manipulate the data.
- Data Standardization: The API ensures a consistent data structure and terminology, simplifying the analysis and usage of NYC Open Data.
- GeoSpatial Support: With support for both NAD83 and WGS spatial reference systems, the API provides accurate and consistent geospatial data representation. Data is returned in GeoJSON format for easy integration with other applications.
- Centralized Repository: A well-organized, centralized location for all ESRI Shape Files related to NYC Open Data.
- Simplified ETL Workflow: The API minimizes manual interventions and streamlines the ETL process by storing data on a traditional file share, making it accessible to other applications in the stack.
- Data Enrichment: Offering additional data enrichment capabilities, the API enhances the quality and usefulness of the available datasets.
- Asp.Net core - C# Web API Framework
- Net Topology Suite - Geospatial data structures and algorithms for .NET
- AutoMapper - C# Object Mapper
- HealthChecks - Health Checks for ASP.NET Core
- Serilog - Logging for .NET
- xUnit.net - Unit Testing Framework
- Docker - Containerization Platform
This project primarily focuses on datasets related to NYC Monuments, Landmarks, and Points of Interest. These datasets are relatively small in size and are versioned together with the source code in this project. By versioning the data and source code together, it simplifies the process of integrating data quality checks for both the data and the source code, ensuring consistency and reliability throughout the project.
- Shape Files - NYC Open Data Datasets Shape Files
- NYC OpenData - NYC Open Data
- LPC Designation Reports - NYC Landmarks Preservation Commission Designation Reports
- Stuart Shay's Flickr - Stuart Shay's Flickr Collection of NYC Monuments, Landmarks, and Points of Interest