Urban & Regional Planning

Urban & Regional Planning Resources Awesome

GitHub stars GitHub forks GitHub contributors GitHub last commit GitHub license

This repository contains curated list of different urban & regional planning data & technology resources. Those interested in the built environement are invited to review and contribute to this repository.



Public Data Resources

Data resources that are publicly available for use. Licenses may apply.

Open Data Sites and national scale datasets should be near the top of each section.


Built Environment

  • Smart Location Database - The Smart Location Database is a nationwide geographic data resource for measuring location efficiency. It includes more than 90 attributes summarizing characteristics such as housing density, diversity of land use, neighborhood design, destination accessibility, transit service, employment, and demographics. Most attributes are available for every census block group in the United States.

  • USBuildingFootprints - Microsoft Maps is releasing country wide open building footprints datasets in United States. This dataset contains ~130,000,000 computer generated building footprints derived using our computer vision algorithms on satellite imagery. This data is freely available for download and use. Additional Information:Article.

Climate

  • NOAA Severe Weather Inventory - The Severe Weather Data Inventory (SWDI) is an integrated database of severe weather records for the United States. The formats currently supported are Shapefile (for GIS), KMZ (for Google Earth), CSV (comma-separated), and XML.

Demographic

  • American Community Survey (ACS) - The American Community Survey (ACS) helps local officials, community leaders, and businesses understand the changes taking place in their communities. It is the premier source for detailed population and housing information for the United States. Additional Information: Geodata Download/Table Data Access

  • IPUMS National Historic GIS - The National Historical Geographic Information System (NHGIS) provides easy access to summary tables and time series of population, housing, agriculture, and economic data, along with GIS-compatible boundary files, for years from 1790 through the present and for all levels of U.S. census geography, including states, counties, tracts, and blocks.

Employment

  • Longitudinal Employer-Household Dynamics (LEHD) - The LEHD program combines these administrative data, additional administrative data and data from censuses and surveys. From these data, the program creates statistics on employment, earnings, and job flows at detailed levels of geography and industry and for different demographic groups. Additional Information:On The Map Download Page.

Environment and Ecosystem Services

  • EnviroAtlas - EnviroAtlas is a collection of interactive tools and resources that allows users to explore the many benefits people receive from nature, often referred to as ecosystem services within the United States.

  • Park Score - The Trust for Public Land curates a comprehensive evaluation of park access and quality in the 100 largest U.S. cities.

  • National Hydrography - The NHDPlus High Resolution (NHDPlus HR), National Hydrography Dataset (NHD), and Watershed Boundary Dataset (WBD) are available for download and as map services. These datasets can help inform environmental planning and storm water management efforts in the US.

  • NLCD - The National Land Cover Database is generated in cooperation with the Multi-Resolution Land Characteristics Consortium (MRLC), a partnership of Federal agencies working together to produce current, nationally consistent, land cover products for all 50 US states and Puerto Rico.

  • CropScape - CropScape displays data from the USDA Cropland Data Layer (CDL), an annual, remote-sensing snapshot of crop cover during the main growing season across the contiguous United States.

  • National Wetland Inventory - The US Fish & Wildlife Service (FWS) National Wetlands Inventory (NWI) is a publicly available resource that provides detailed information on the abundance, characteristics, and distribution of US wetlands.

Equity and Environmental Justice

  • EJ Screen - EJSCREEN uses maps and reports to present three kinds of information: Environmental indicators, demographic indicators and EJ Indexes. Additional Information:Download.

  • CDC Social Vulnerability Index - CDC Social Vulnerability Index (CDC SVI) uses 15 U.S. census variables to help local officials identify communities that may need support before, during, or after disasters based on their level of social vulnerability. Additional Information: Download.

  • H+T Index - The Housing and Transportation (H+T®) Affordability Index provides a comprehensive view of affordability that includes both the cost of housing and the cost of transportation at the neighborhood level. Provided by the Center for Neighborhood Technology.

Health

  • HealthData.gov - This site is dedicated to making high value health data in the United States more accessible to entrepreneurs, researchers, and policy makers in the hopes of better health outcomes for all.

  • County Health Rankings - The annual Rankings provide a revealing snapshot of how health is influenced by where we live, learn, work, and play.

OpenStreetMap

  • OpenStreetMap - OpenStreetMap is the free wiki world map. This colloborative project is one of the largest databases of volunteered geographic information in the world. Its contents include points of interest, routable networks, and other geodata.

  • BBBike - Provides shapefiles and raw OSM format for cities around the world, extracted weekly. This is useful if you are looking for data extracts for a single city.

  • Geofabrik - OpenStreetMap extracts prepared in either PBF or shapefile format for download daily.

  • MetroExtracts - Each day, OSM Extracts by Interline mirrors the entire OpenStreetMap planet and creates city and region sized extracts ready for download into formats ready for GIS.

  • Overpass Turbo - Overpass Turbo is a web-based data mining tool for OpenStreetMap. It runs any kind of Overpass API query, shows the results on an interactive map, and allows users to export query data in the form of GeoJSON files (which may be converted to Shapefiles). It also provides helpful support for new users in the form of the "Wizard" tool. Using Overpass Turbo, you can query virtually any location globally using dedicated tags in Open Street Map.

Resilience and Natural Hazards

  • Sea Level Rise Viewer - NOAA provided map viewer is to provide federal, state, and local coastal resource managers and planners with a preliminary look at sea level rise and coastal flooding impacts.
  • Earth Quake Data - NOAA provided data includes a global record of significant earth quakes going back to 2150 BC to present with geographic information.

Transportation

  • BTS Open Data Site - On the BTS Open Data site, browse geospatial data that is part of the BTS National Transportation Atlas Database (NTAD) product. NTAD is a set of nationwide (United States) geographic databases of public spatial information for transportation facilities and networks; flows of people, goods, vehicles, and craft over the transportation networks; and social, economic, and environmental conditions that affect or are affected by the transportation networks.

  • Transitland - Transitland is an open data platform that collects GTFS, GTFS Realtime, and other open data feeds from over 2,500 transit operators in over 55 countries. Additional Information: Interline,GitHub.

  • National Noise Map - Data within the National Transportation Noise Map represent potential noise levels across the nation for an average annual day for the specified year.

  • National Transit Database - Repository of operations, financial, and asset data that US transit agencies are required to report to the Federal Transit Administration.

  • Global Urban Street Networks - Ready‐to‐use global street network models and calculated indicators in a GIS format. Additional Information:Geopackage Download

Vendor Data Resources

Vendors that can provide purchased or licensed data for a variety of uses.


Demographic

  • Esri Tapestry Segmentation - Provides concise information on the demographic, economic, education and consumer characteristics of populations based on ZIP code.

Infrastructure

  • Mapillary - Access street-level imagery and AI-derived map data from all over the world. Fill in the gaps by requesting new coverage or capturing your own with an easy to use mobile app.

Land Use

  • CoreLogic - Provides high quality parcel data, providing instant access to detailed property characteristics, sales records, valuation and digital copies of current county assessor documents.

Travel Behavior

  • Replica - Replica is a data platform providing rich origin-destination, spend, and scenario impact analysis based on an activity based modeling process.

  • SafeGraph - Points of interest (POI) provider using mobile trace data to provide visitor insights data for commercial places in the United States.

  • StreetLight Data - Provides data using smartphones as sensors to measure vehicles, bikes, and pedestrians across North America. Carry out your mission on time and under budget, with 24/7 access to counts, O-D, and other metrics you need.

  • Strava - API for a popular tracking app for runners and cyclists. Data can be used to understand active transportation usage and patterns.

Planning Data Specifications

A collection of urban planning related data specifications and standards for use as part of programs & projects.


Built Environment

  • DTDL - The Digital Twins Definition Language is the language by which developers can define the language of the entities they expect to use in their topologies.

  • BLDS - The BLDS data standard is a collaborative effort by civic technology companies, governments and other interested partiesto create a shared data specification for building and construction permit data.

Transportation

  • SharedStreets - SharedStreets Referencing System is a global, non-proprietary linear referencing system for describing streets maintained by SharedStreets. Additional Information: GitHub

  • CurbLR - An open data specification for curb regulations maintained by SharedStreets. Additional Information: GitHub, Demo: interactive map and example feed, Blog post: Why CurbLR was built.

  • GTFS - The General Transit Feed Specification is a popular standard for describing transit systems.

  • shared-row - A data specification for representing street right of ways.

  • GBFS - The General Bikeshare Feed Specification is a standardized data feed for shared mobility system availability.

  • MDS - The Mobility Data Specification is a data standard to enable communication between mobility companies and local governments.

  • MTLFS - The Managed and Tolled Lanes Feed Specification is intended to be used by the managed lanes and toll industry for the standardization and sharing of dynamic toll rates, and any managed lane purpose including but not limited to, ramp metering, bus only lanes, express lanes, especially if the resources are being priced dynamically.

  • GMNS - The General Modeling Network Specification defines a common human and machine readable format for sharing routable road network files.

Planning Coding Resources

This is a curated list of Python, R, or other open-source libraries or programming tools can be useful for urban planning applications.


Python

Python Libraries & Related Resources.

  • Pandas - Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more.

  • Arcpy - ArcPy is a Python site package that provides a useful and productive way to perform geographic data analysis, data conversion, data management, and map automation with Python.

  • ArcGIS Python API - The ArcGIS API for Python is a powerful, modern and easy to use Pythonic library to perform GIS visualization and analysis, spatial data management and GIS system administration tasks that can run both interactively, and using scripts. This library enables easy use of pandas within the ArcGIS platform.

  • Geopandas - GeoPandas is an open source project to make working with geospatial data in python easier. GeoPandas extends the datatypes used by pandas to allow spatial operations on geometric types.

  • Partridge - Partridge is a Python 3.6+ library for working with GTFS feeds using pandas DataFrames.

  • Pandana - Urban network analysis library intended to help planners compute quick accessibility metrics or shortest paths. Additional Information: License: AGPL-3.0 License: Provider: UrbanSim Inc. (UDST).

  • Geosnap - Geospatial & temporal neighborhood analysis using US Census Data.

  • OSMnx - Python for street networks. Retrieve, model, analyze, and visualize street networks and other spatial data from OpenStreetMap.

  • Pybikes - Pybikes provides a set of tools to scrape bike sharing data from different websites and APIs, thus providing a coherent and generalized set of classes and methods to access this sort of information.

R

R Packages & Related Resources.

  • R Shiny - Create dynamic, web-friendly visualizations of data using R. Additional Information: Shiny Tutorial.

  • simplefeatures(sf) - Support for simple features, a standardized way to encode spatial vector data in R.

  • ggplot2 - Resource for plotting a wide range of data (useful for visualizing survey data). Additional Information: GNU GENERAL PUBLIC LICENSE.

  • tidytext - Go-to library for text mining--often used in tandem with ggplot or other text mining libraries.

Other

Other coding libraries & resources.

  • civic-tech-patterns - Common patterns and anti-patterns for civic tech and civic applications. Additional Information: Provided by Code for America.

Web and JS

Front-end web related packages and resources.

  • Bootstrap - Widely-used, well documented library for quick design and customization of websites. Additional Information: Documentation.

  • Chart.js - Create simple (or advanced) visualizations of data for web and mobile. Additional Information: GitHub.

  • Leaflet - Open-source JavaScript library for mobile-friendly interactive maps. Plugins available to extend functionality (e.g., storymaps, heatmaps, animation). Additional Information: Quickstart Guide.

  • Turf.js - Advanced geospatial analysis for browsers and Node.js. Additional Information: GitHub.

  • GTFS-Js - JavaScript library for working with GTFS data. Additional Information: Unlicense: WSDOT.

Platforms and Software Resources

Software and platforms for planners.

Geospatial Data and Visualization

A a high-level category to classify the resource into related groups. Census data could be considered "Demographic" for example.

  • ArcGIS - This platform is a geographic information system (GIS) for working with maps and geographic information maintained by the Environmental Systems Research Institute (Esri).

  • QGIS - This open source GIS suite allows users to create, edit, visualise, analyse and publish geospatial information on Windows, Mac, Linux, BSD and mobile devices.

  • kepler.gl - Kepler is a data agnostic, WebGL empowered, high-performance web application for geospatial analytic visualizations. Additional Information: API Reference.

  • flowmap-blue - Create geographic flow maps representing your data published in Google Sheets. Visualize numbers of movements between locations (origin-destination data).

Urban Design Tools and Platforms

  • CityEngine - CityEngine is advanced 3D modeling software for creating huge, interactive and immersive urban environments in less time than traditional modeling techniques. The cities you create using CityEngine can be based on real-world GIS data and the procedural rules that work with them.

  • SketchUp - Easy to use interactive 3D modeling software for planning and design applications. Supported by a rich asset library for creating neighborhood designs.

  • Rhino - This is a commercial 3D computer graphics and computer-aided design application software. Rhino has had multiple plug-ins built on top of it including Grasshopper and the Urban Network Analysis toolbox to enable complex modeling and analysis.

Urban Planning Tools and Platforms

  • ArcGIS Urban - ArcGIS Urban enables planners and design professionals to publish living plans and collaborate across teams with a web-based 3D application that supports scenario planning and impact assessment.

  • UrbanFootPrint - Web-based planning tool serving curated urban, environmental, and economic data to urban practitioners and equipping them with the analytic capabilities to plan and improve communities faster, better, and at lower cost.

  • Remix - A platform to empower cities to plan the best possible transportation system — from public transit to safer streets to ever-increasing new modes of mobility. Remix provides tools to edit & test GTFS, generate multimodal streets, and explore relevant data.

Environmental and Climate Planning Tools and Platforms

  • iTree - Quantifies the benefits and values of trees around the world. Is based on peer-reviewed, USDA Forest Service Research.

  • HAZUS - FEMA’s Hazus Program provides standardized tools and data for estimating risk from earthquakes, floods, tsunamis, and hurricanes. Risk assessment resources and tools from the Hazus program are always freely available and transparently developed.

Other Resources

Other types of planning data & technology resources.


Other Technology Resource Aggregators

These are other repositories that aggregate planning related tools, software, and related resources. They are a good source of inspiration to contribute to this repo for example, but we don't need to duplicate efforts.

  • awesome-transit - A collection of transit data tools and resources.

  • micromobility-tools-and-resources - A collection of micromobility tools and data resources.

  • awesome-sustainable-technology - A curated list of open technology projects to sustain a stable climate, energy supply, and vital natural resources.

  • awesome-gis - Awesome GIS is a collection of geospatial related sources, including cartographic tools, geoanalysis tools, developer tools, data, conference & communities, news, massive open online course, some amazing map sites, and more.

  • awesome-agriculture - Open source technology for agriculture, farming, and gardening.

  • awesome-geojson - GeoJSON utilities that will make your life easier.

  • Urban Computing Foundation - Accelerating open source and community development that improves mobility, safety, infrastructure, traffic, and energy consumption in connected cities. Additional Information: Landscape.


Contributing

Form Based Contributions

If you don't have a GitHub, but have a resources that falls into the categories below you would like to contribute try putting the information in this Google Sheet here. We will look at incorporating it into the repository pending review. https://docs.google.com/forms/d/e/1FAIpQLSfGp_XC5V-uIzafsVBhR4xKX9YhgNOz22w84Sg0zo0ONDdV4w/viewform?usp=sf_link

GitHub Contributions

We are actively looking for contributions from those interested in urban planning and technology. To find out more, visit the Contribution page to see our recommended format. For large contributions, file an issue first. The advantage of contributing to the repo in this manner is that your addition to this shared resource will be recorded.

License and Citation

Similar to other resources aggregators, this repository is released into CC 1.0. We do not require citation, but in order to generate more contributions for and understanding of this resource we do appreciate sharing this repository or citing it where appropriate.

If you do cite this repository you can as:

planning-technology-resources. (2020) APA Technology Division. Taken from: from https://github.com/APA-Technology-Division