Skip to content

CouncilDataProject/milwaukee

Repository files navigation

CDP - Milwaukee

Infrastructure Deployment Status Event Processing Pipeline Event Index Pipeline Web Deployment Status Repo Build Status


⚠️⚠️ This instance of CDP is not actively collecting new data. If you are interested in maintaining this instance, please create a GitHub Issue. ⚠️⚠️

Council Data Project

Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all members of each community we serve with the tools they need to stay informed and hold their Council Members accountable.

For more information about Council Data Project, please visit our website.

Instance Information

This repo serves the municipality: Milwaukee

Python Access

Install:

pip install cdp-backend

Quickstart:

from cdp_backend.database import models as db_models
from cdp_backend.pipeline.transcript_model import Transcript
import fireo
from gcsfs import GCSFileSystem
from google.auth.credentials import AnonymousCredentials
from google.cloud.firestore import Client

# Connect to the database
fireo.connection(client=Client(
    project="cdp-milwaukee-9f60e352",
    credentials=AnonymousCredentials()
))

# Read from the database
five_people = list(db_models.Person.collection.fetch(5))

# Connect to the file store
fs = GCSFileSystem(project="cdp-milwaukee-9f60e352", token="anon")

# Read a transcript's details from the database
transcript_model = list(db_models.Transcript.collection.fetch(1))[0]

# Read the transcript directly from the file store
with fs.open(transcript_model.file_ref.get().uri, "r") as open_resource:
    transcript = Transcript.from_json(open_resource.read())

# OR download and store the transcript locally with `get`
fs.get(transcript_model.file_ref.get().uri, "local-transcript.json")
# Then read the transcript from your local machine
with open("local-transcript.json", "r") as open_resource:
    transcript = Transcript.from_json(open_resource.read())

Contributing

If you wish to contribute to CDP please note that the best method to do so is to contribute to the upstream libraries that compose the CDP Instances themselves. These are detailed below.

  • cdp-backend: Contains all the database models, data processing pipelines, and infrastructure-as-code for CDP deployments. Contributions here will be available to all CDP Instances. Entirely written in Python.
  • cdp-frontend: Contains all of the components used by the web apps to be hosted on GitHub Pages. Contributions here will be available to all CDP Instances. Entirely written in TypeScript and React.
  • cookiecutter-cdp-deployment: The repo used to generate new CDP Instance deployments. Like this repo!
  • councildataproject.org: Our landing page! Contributions here should largely be text changes and admin updates.

Instance Admin Documentation

You can find documentation on how to customize, update, and maintain this CDP instance in the admin-docs directory.

License

CDP software is licensed under a MIT License.

Content produced by this instance is available under a Creative Commons Attribution 4.0 International License.