Skip to content

Releases: italia/publiccode-crawler

v4.0.4

24 May 19:41
Compare
Choose a tag to compare

What's Changed

Full Changelog: v4.0.3...v4.0.4

v4.0.3

20 Feb 11:37
a354180
Compare
Choose a tag to compare

What's Changed

  • chore(deps): use publiccode-parser-go v3.1.2 by @bfabio in #372
  • chore: don't have golangci-lint update go.mod in CI by @bfabio in #374
  • chore: use Go 1.21 by @bfabio in #373
  • chore(deps): bump golang.org/x/crypto from 0.14.0 to 0.17.0 by @dependabot in #371
  • refactor: rename unsed parameters to _ by @bfabio in #375

Full Changelog: v4.0.2...v4.0.3

v4.0.2

04 Dec 11:24
38c7e12
Compare
Choose a tag to compare

What's Changed

Full Changelog: v4.0.1...v4.0.2

v4.0.1

11 Nov 15:11
21235aa
Compare
Choose a tag to compare

What's Changed

  • chore(deps): bump publiccode-parser-go to v3.0.5 by @bfabio in #368

Full Changelog: v4.0.0...v4.0.1

v4.0.0

12 Oct 09:36
914ddff
Compare
Choose a tag to compare

What's Changed

Features

  • feat!: set default config values by @bfabio in #342
  • feat: create Software even if publiccode.yml is invalid by @bfabio in #339

Fixes

  • fix: add missing fmt.Sprintf in log messages by @bfabio in #327
  • fix: Close() the Response Body in ApiClient by @bfabio in #334
  • fix: enable errorlint linter by @bfabio in #350
  • fix: don't fail if there's no config file by @bfabio in #351
  • fix: properly get all the Publishers by @bfabio in #356
  • fix(bitbucket): properly get the publiccode.yml by @bfabio in #359

Chores / Refactor

  • docs: fix comments by @bfabio in #341
  • chore(deps): bump github.com/prometheus/client_golang from 1.7.1 to 1.11.1 by @dependabot in #324
  • chore(deps): bump golang.org/x/text from 0.3.7 to 0.3.8 by @dependabot in #326
  • chore(ci): add base golangci-lint config file by @bfabio in #328
  • chore(deps): bump golang.org/x/crypto from 0.0.0-20211215153901-e495a2d5b3d3 to 0.1.0 by @dependabot in #329
  • chore(golangci-lint): enable gofumpt and gofmt by @bfabio in #330
  • Enable some golangci-lint linters by @bfabio in #332
  • chore: remove publishers.thirdparty.yml by @bfabio in #333
  • Enable some more linters by @bfabio in #335
  • chore(deps): bump golang.org/x/net from 0.1.0 to 0.7.0 by @dependabot in #340
  • refactor: enable unparam linter by @bfabio in #344
  • refactor: enable prealloc linter by @bfabio in #345
  • refactor: enable forcetypeassert linter by @bfabio in #346
  • refactor: enable gocritic linter by @bfabio in #347
  • refactor!: enable gosec linter by @bfabio in #348
  • chore(ci): enable nilnil linter by @bfabio in #349
  • chore: enable lll linter by @bfabio in #357
  • chore: disable depguard linter by @bfabio in #360
  • chore: enable forbidigo linter by @bfabio in #362
  • refactor: add constant and disable the gomnd linter by @bfabio in #363
  • refactor: enable revive linter by @bfabio in #364
  • chore(deps): bump golang.org/x/net from 0.12.0 to 0.17.0 by @dependabot in #365

Full Changelog: v3.1.0...v4.0.0

v3.1.0

27 Jan 16:01
1971c5a
Compare
Choose a tag to compare

What's Changed

  • feat: handle GitHub secondary rate limiting by @bfabio in #322

  • feat: handle secondary limit in all GitHub calls by @bfabio in #323

  • feat: print summary when the crawling is done by @bfabio in #312

  • feat: add MAIN_PUBLISHER_ID configuration variable by @bfabio in #313

  • fix: don't crash when publiccode.yml is a symlink by @bfabio in #319

  • fix: bring back listing repos for GitHub users by @bfabio in #320

  • fix: use the right logic for MAIN_PUBLISHER_ID by @bfabio in #321

  • style: use go naming rules for filenames by @bfabio in #309

  • chore: run crawl as GitHub action by @bfabio in #314

Full Changelog: v3.0.0...v3.1.0

v3.0.0

19 Oct 16:42
Compare
Choose a tag to compare

What's Changed

  • Refactor the crawler to use Developers Italia API by @bfabio in #302
  • chore: rename module and bump version by @bfabio in #306

Full Changelog: v2.2.0...v3.0.0

v2.2.0

26 Sep 07:59
e15b1e7
Compare
Choose a tag to compare

What's Changed

  • feat: clone bare repositories without blobs by @tensor5 in #269
  • fix: remove wrong "-b" flag from git clone by @tensor5 in #278
  • fix: detection of on-premise GitLab groups by @bfabio in #303
  • chore: don't login to DockerHub on release by @bfabio in #276
  • docs: update crawler diagram by @bfabio in #283
  • chore: use main as branch in workflows by @bfabio in #287
  • chore: add more software to third party
  • chore: remove unneeded chmod by @bfabio in #297
  • chore: remove Go Meta Linter by @bfabio in #290
  • chore(dependencies): bump publiccode-parser-go and go-vcsurl by @bfabio in #299
  • refactor: always use go-vcsurl by @bfabio in #295
  • Code refactor to make the crawler's code clearer and more maintainable by @bfabio in #263
  • refactor!: simplify the logic and reorganize the packages by @bfabio in #296

New Contributors

Full Changelog: v2.1.0...v2.1.1

v2.1.0

12 May 19:31
c6735d5
Compare
Choose a tag to compare

What's Changed

  • externalize httpclient lib by @sebbalex in #199
  • add: readd io-app later on its migration to pagopa org by @sebbalex in #202
  • Update docs by @bfabio in #181
  • Update thirdparty.yml by @pgiacomo69 in #203
  • Ported crawler diagram to mermaid syntax by @MattMattV in #205
  • chore: use link shortener in crawler documentation by @bfabio in #206
  • feat: add ipa and pec as keyword fields in Elasticsearch by @bfabio in #207
  • feat: add lowercase normalizer to ipa and pec in ES by @bfabio in #208
  • Add localisedName as keyword field in Elasticsearch. by @bfabio in #201
  • Add "RiscossioneConverter" by @alessiolombardo in #210
  • Adding Azure DevOps badge by @MattMattV in #204
  • Add GCompris to the catalog (KDE) by @ruphy in #211
  • italia/design-wordpress-theme in manual reuse list by @sebbalex in #209
  • Update README.md. by @bfabio in #180
  • fix(github): skip private or archived repos by @bfabio in #215
  • feat: make logs available to the outside world by @bfabio in #214
  • WC Carta Docente by @ilGhera in #216
  • WC 18app by @ilGhera in #217
  • Use /api/v4/projects with on-prem instances by @sebbalex in #117
  • arpa-puglia repos blacklisted, no longer available by @sebbalex in #220
  • Revert "chore: arpa-puglia repos blacklisted, no longer available" by @bfabio in #221
  • blacklist GasPlanet empty repository by @sebbalex in #222
  • chore: remove Azure Pipelines and CircleCI by @bfabio in #223
  • chore(ci): use actions/checkout when building by @bfabio in #225
  • chore(ci): actually keep the .git directory at build by @bfabio in #226
  • feat: timestamp the public logs by @bfabio in #224
  • feat: save the public logs as JSON by @bfabio in #228
  • chore: add publiccode-editor to reuse by @bfabio in #229
  • chore: re-enable cmdrc/gasplanet repository by @bfabio in #232
  • Add website template for municipalities by @sebbalex in #230
  • added vtenext by @davidegiarolo in #157
  • refactor: don't wait for ElasticSearch by @bfabio in #235
  • feat: add dry-run mode to "crawl" and "one" commands by @bfabio in #234
  • chore: add Ministero della Salute organization by @bfabio in #236
  • add FormPA by @sebbalex in #237
  • Add Signalen to thirdparty list by @Ainali in #238
  • Add TLSAssistant to the catalog by @NetBender in #239
  • feat: add qfield software by @libremente in #233
  • refactor: remove unused file by @bfabio in #242
  • feat: use Elasticearch 7 and load PECs from pec.txt by @bfabio in #240
  • feat: add name field as keyword in Elasticsearch by @bfabio in #244
  • Added new repo under Opencontent: Pitre SOAP Proxy by @lorello in #246
  • Aggiunto SmartPA - Document Classification by @EliaPiccoli in #247
  • chore: add new oas checker repo by @libremente in #248
  • Added PDFsam Basic by @torakiki in #251
  • Updated repository URL of stanzadelcittadino by @lorello in #252
  • chore: update publiccode-parser-go to v1.2.4 by @bfabio in #254
  • chore: use golang 1.17 as 1.13 is no longer supported by @bfabio in #256
  • feat: subgroups support in GitLab by @bfabio in #255
  • feat: use the new publiccode-parser-go version for validation by @bfabio in #258
  • fix: set the type when saving publiccodes to Elastic by @bfabio in #259
  • feat: make publishers named "_" skip the same-repo check by @bfabio in #260
  • feat: make publiccode.description.it.features full-text searchable by @bfabio in #267
  • fix: use publiccode.yml's url when cloning the repo locally by @bfabio in #265
  • refactor: don't create software_scopes.yml and software_categories.yml by @bfabio in #270
  • feat: expose all indexed public software by @ruphy in #268
  • feat: support publiccode.yml Standard v0.3.0 by @bfabio in #274

New Contributors

Full Changelog: v2.0.4...v2.1.0

v2.0.4

12 Oct 09:35
6164f57
Compare
Choose a tag to compare

Changelog

6164f57 Skip publishers if they contain duplicate orgs. (#198)
9f22ae3 fix: removing AgID and UniversitaDellaCalabria (#197)