Standard "We accidently imported ffmpeg as default" Bug Fix

Patch Release for #215

Full Changelog: v3.2.4...v3.2.5

Better Caption Checking, Experimental Clipping

What's Changed

• Update CONTRIBUTING.md by @whargrove in #207
• feature/add-download-and-upload-for-clips by @evamaxfield in #208
• feature/basic-gcp-function-and-clipping-gcp-function by @evamaxfield in #204
• docs/update-docstring-for-clip-and-format by @rajataggarwal91 in #209
• feature/filter-out-invalid-captions by @dphoria in #214

New Contributors

• @whargrove made their first contribution in #207
• @rajataggarwal91 made their first contribution in #209

Full Changelog: v3.2.3...v3.2.4

New Infrastructure Management

Council Data Project v3.2.0

Council Data Project is a backend, frontend, and cookiecutter deployment for creating a whole database, storage system, and website, for archiving, exploring, and tracking municipal council action.

This library, cdp-backend maintains the pipelines, database models, infrastructure configuration, etc.

This version of cdp-backend is meant to fix the currently broken infrastructure deployment system. We are ripping out all of Pulumi and using gcloud, gsutil, and firebase CLI tooling to achieve the same result (which are all first-party tools so should be better supported).

⚠️ ⚠️
This release is a "breaking" change for instances. Instance maintainers will want to update the instance with make update-from-cookiecutter.
⚠️ ⚠️

What's Changed

• admin/upgrade-packaging-standards by @evamaxfield in #201
• bugfix/infra-stack by @evamaxfield in #202

Full Changelog: v3.1.3...v3.2.0

Additional Fixes for WebVTT Parsing and Conversion

WebVTT Captions can have end of sentence markings in the middle of a sentence. Parse the captions per line instead of per caption to solve.

Full Changelog: v3.1.1...v3.1.2

No More Parallel Index Creation

We couldn't deploy any new instances due to a bug with Firestore index creation. This changes makes it so that indexes are only created one after another.

See more details here: pulumi/pulumi-google-native#528

As a result, stack deployment takes much longer unfortunately.

What's Changed

• bugfix/create-firestore-indexes-one-after-another by @JacksonMaxfield in #194

Full Changelog: v3.1.0...v3.1.1

Better Closed Caption Parsing and Indexing Changes

We have made it a new minor version!

This release include two changes:

1. Better / safer WebVTT parsing (specifically to address Boston closed caption files) -- thanks to @isaacna
2. The index pipeline has been split into two. This is a breaking change and deployment maintainers should update their deployment repositories with the make update-from-cookiecutter to pull in these changes.

What's Changed

• bugfix/fix-newline-webvtt-sentence-segmentation by @isaacna in #193
• feature/reduce-and-fan-ngram-index by @JacksonMaxfield in #189

Full Changelog: v3.0.16...v3.1.0

Supporting File Resiliency and M3U8 Playlist Support

A welcome addition of attempting multiple URLs when storing supporting files and also supporting m3u8 playlist video formats so that we can more generally handle Legistar data portals.

What's Changed

• feature/add-supporting-file-resiliency by @JacksonMaxfield in #187
• feature/support-processing-m3u8-video-playlist-uris by @JacksonMaxfield in #188

Contribution from @liamphmurphy

Full Changelog: v3.0.15...v3.0.16

Admin Updates, Docs, Deps, Pipeline Error Resolution

This release is largely admin work.

What's Changed

• Drops py37
• Adds py310
• Cleans up and upgrades deps
• Deps have wider supported bounds where possible to allow for downstream cdp-data easier install
• Switches doc theme to furo
• License and copyright year and holder changes (Jackson Maxfield Brown -> CDP Contribs)
• Explicitly close local dask cluster during parallel pipeline runs

Full Changelog: v3.0.14...v3.0.15

Bugfix for Bug Introduced in 3.0.13

What's Changed

• bugfix/fix-kwarg-issue-introduced-with-verify-false-resource-exists by @JacksonMaxfield in #182

Full Changelog: v3.0.13...v3.0.14

Allow Unverified URLs to Resource Exists and Resource Copy (Solution to Missing or Outdated SSL Certs)

IT is hard and we have encountered bad, missing, or outdated SSL certs numerous times. This is just out attempt to fix it finally. See the associated PR for more info.

What's Changed

• bugfix/allow-through-unverified-urls-in-resource-copy-and-resource-exists by @JacksonMaxfield in #181

Full Changelog: v3.0.12...v3.0.13