Kitodo.Production 3.6.3

This is a minor release that fixes several bugs and security issues. Please see the changelog below for details.

Note: no changes were made to the database schema in this release, therefore it does not contain an SQL migration file and no database migration is necessary when updating from a previous 3.6 release.

What's Changed

• Backport fixes from master by @stweil in #6027
• Save SM links in order by @matthias-ronge in #5965
• Backport of PR 6015: Upgrading H2 database by @henning-gerhardt in #6026
• Add url encoding for SearchInterfaceTypes other than SRU by @gerlingsm in #6060
• Allow multiple values for same key in mass import csv by @BartChris in #6031
• Handle enter event in input fields by @BartChris in #6066
• Handle exception during Kitodo Script execution by @solth in #6084
• Fix wrong value for the metadata "processTitle" in process hierarchies by @BartChris in #6086
• Update to version 3.6.3 by @solth in #6091

Full Changelog: kitodo-production-3.6.2...kitodo-production-3.6.3

Kitodo.Production 3.6.2

This is a minor release that fixes several bugs and security issues. Please see the changelog below for details.

Note: No changes were made to the database schema in this release, therefore it does not contain an SQL migration file and no migration is necessary when updating from a previous 3.6 release.

What's Changed

• Fix listing ST by @solth in #5893
• Relocate mysql dependency by @solth in #5899
• Updating Bouncy Castle dependency by @solth in #5900
• password change fix by @solth in #5897
• synchronize task manager by @solth in #5896
• Update MetsModsGoobi_to_MetsKitodo.xsl by @solth in #5898
• prevent npe helper by @solth in #5901
• handle missing meta xml by @solth in #5902
• Update spring security by @solth in #5917
• Catch Exceptions in indexing processes, log warning and continue by @matthias-ronge in #5895
• Update location of chrome driver for testing by @solth in #5925
• Fix DTD security issue by @solth in #5952
• Allow datatype Long when indexing by @BartChris in #5911
• Update messages_es.properties by @solth in #5960
• Update version to 3.6.2 by @solth in #5958

Full Changelog: kitodo-production-3.6.1...kitodo-production-3.6.2

Kitodo.Production 3.6.1

This minor release extends the functionality to rename process media to the process list as a list function, resolves some security issues and fixes a few bugs in the metadata editor. See the patch notes below for more details. No changes were made to the configuration files or database schema, therefore a database migration is not required.

What's Changed

• Update org.json library to fix security issue by @solth in #5818
• Bump org.apache.activemq:activemq-client from 5.17.2 to 5.17.6 by @solth in #5828
• Use type track for audio and video MIME types instead of type page for physical division type by @markusweigelt in #5835
• Add list function for renaming media of multiple processes by @solth in #5839 (see https://github.com/kitodo/kitodo-production/wiki/Medien-umbenennen-als-Listenfunktion for details)
• Always display page labels in metadata editor by @solth in #5847
• Change version to 3.6.1 by @solth in #5848

Full Changelog: kitodo-production-3.6.0...kitodo-production-3.6.1

Kitodo.Production 3.6.0

What's new

Metadata editor features

This release contains numerous new function and bug fixes for the Metadata editor of Kitodo.Production:

• support for video and audio files (see https://github.com/kitodo/kitodo-production/wiki/Video-f%C3%BCr-den-Metadaten-Editor-konfigurieren for details)
• remove hierarchical links between existing processes (see #4738 for details)
• process locks are now released even if the user does not use the "Close" button to exit the editor
• option to rename media files corresponding to their ORDER attribute (see #5701 for details)
• number of scans is now displayed in editor
• new visualization options in structure tree
  • expand or collapse all nodes at once
  • show only structure elements
  • display info about assigned pages in structure element node
  • display hierarchy level in structure element nodes

Calendar

• function from Kitodo.Production 2.x to upload and download calendar has been reintroduced (see #3722 for details)
• new option to add metadata to individual issues (see #5526 for details)

Other new features

• interactive filter menu for task, process and user list (see #5523 for details)
• new ruleset settings to configure behavior of repeated import for each metadata individually (see #5613 for details)
• separate default import configuration for creating child processes (see #5460 for details)
• many more improvements and bug fixes (see full list below)

Database changes

There have been multiple changes to the database schema of Kitodo.Production since version 3.5.x. Please use the attached file migration_3-5-0_to_3-6-0.sql to migrate your database to the current schema.

Changelog

• Support output of metadata in docket creation by @matthias-ronge in #4968
• Change version to 3.6.0-SNAPSHOT by @solth in #5531
• Improve "correction K" tooltip by @oliver-stoehr in #5403
• Show the first image in detail view if structure element is selected by @IkramMaalej in #5405
• Show total number of scans by @IkramMaalej in #5424
• Fix folder settings for test project by @solth in #5533
• Add settings to show comments and pagination panel by default by @solth in #5439
• Add relativepath placeholder by @pontus-osterdahl in #5440
• Improve id column for larger ids by @oliver-stoehr in #5465
• Prevent typeless metadata by @pontus-osterdahl in #5446
• Enable select metadatakey when creating several divisions by @pontus-osterdahl in #5466
• ViewScoped metadata editor by @solth in #5467
• Fix async export by @BartChris in #5482
• Remove unsupported context params by @henning-gerhardt in #5491
• Update to latest chrome version by @markusweigelt in #5517
• Update Chrome to latest stable version in workflow main by @markusweigelt in #5541
• Improve Tomcat logs by reducing number of info messages for component… by @IkramMaalej in #5499
• Updated media references by @solth in #5501
• Fix NPE in the last 'processesTable' page if all rows are selected by @IkramMaalej in #5506
• Enable manipulation of child process links in metadata editor by @solth in #5507
• Add 'strict' mode to let metadata validation fail on warnings by @solth in #5510
• Processes selection by @IkramMaalej in #5511
• Enable client side validation in Create Process form by @BartChris in #5519
• Add options to collapse and expand all tree nodes by @solth in #5520
• Add metadata in calendar to one specific issue by @oliver-stoehr in #5526
• Integration of video and audio into the metadata editor by @markusweigelt in #5472
• Remove support for Travis use by @henning-gerhardt in #5534
• Do not render the media view image if no selected gallery media conte… by @markusweigelt in #5547
• Avoid duplication of metadata groups while adding new metadata fields by @BartChris in #5549
• Metadata tree table by @IkramMaalej in #5550
• Fix displaying result of script execution by @solth in #5551
• Keep ID url parameter when reloading page after script execution by @solth in #5553
• Change MetadataGroup.group variable to HashSet by @solth in #5556
• Fix maven warning by deleting doubled entry by @henning-gerhardt in #5569
• Typo by @matthias-ronge in #5577
• Fix icons not updating if a structure tree node is collapsed or expan… by @IkramMaalej in #5560
• Show dialog as feedback when user saves current data editor settings by @solth in #5571
• Add interactive filter menu by @oliver-stoehr in #5523
• Create correct metadatatype by @pontus-osterdahl in #5585
• Do not reset media resolver on metadata editor page reload by @solth in #5586
• Child process default import config by @solth in #5489
• Prevent saved filters menu from overflowing page on page load by @oliver-stoehr in #5593
• Enable scrolling in title link tab by @solth in #5599
• Expire user session on http session timeout by @solth in #5592
• Do not auto-close error messages on project edit page by @solth in #5561
• Skip automatic removal of missing media from workpiece, when no media… by @markusweigelt in #5598
• Displays a total in the statistics by @matthias-ronge in #5602
• Redirect on cancel in workflow edit form by @solth in #5606
• Typo by @matthias-ronge in #5611
• Clarify warning message when changing active workflow by @solth in #5605
• Generatorsource variable by @pontus-osterdahl in #5610
• Prevent wrong error message when deleting process by @solth in #5614
• Display options in language switcher translated to each corresponding… by @solth in #5615
• Update messages_es.propierties by @danilopenagos in #5616
• Fix problem that SqlGrammarException is not catched with MySQL 5.7 by @thomaslow in #5562
• Remove unused javascript file by @solth in #5619
• Mark 'filterKeydownEvents' method as 'global' for JSHint by @solth in #5621
• Fix the wrong ordering of the exported METS structLink section by @BartChris in #5594
• Icons physical tree by @IkramMaalej in #5582
• Bump json from 20190722 to 20230227 by @dependabot in #5627
• Swap arguments to prevent NPE by @henning-gerhardt in #5642
• Don't complain required fields from an altogether empty metadata group by @matthias-ronge in #5609
• Fix typo in delegate function name by @matthias-ronge in #5632
• Rename directories when changing process title by @solth in #5620
• Return import configurations sorted by title by @solth in #5644
• Inactive templates by @solth in #5628
• Fix bugs caused by file names with dots by @IkramMaalej in #5617
• Bring back calendar import as XML by @matthias-ronge in #5640
• Update ElasticSearch client to fix vulnerability by @solth in #5651
• Ensure OL viewport exists before updating map object by @solth in https://github.co...

Kitodo.Production 3.5.1

This is a patch release that restores database compatibility with MySQL 5.7 databases and includes several security fixes. Please note that even though Kitodo.Production 3.5.1 is compatible with MySQL 5.7 databases we still recommend using MySQL 8 for increased performance. No changes were made to the configuration files or database schema.

What's Changed

• Update to latest chrome version by @solth in #5736
• Catch correct exception when using MySQL 5.7 by @solth in #5738
• fix: pom.xml to reduce vulnerabilities by @solth in #5739
• Bump org.codehaus.plexus:plexus-archiver from 4.1.0 to 4.8.0 by @solth in #5740
• Change version 'org.apache.xmlgraphics' to '2.8' and add removed depe… by @IkramMaalej in #5742
• Update retrieval of Chrome driver by @solth in #5766
• Change version to 3.5.1 by @solth in #5767

Full Changelog: kitodo-production-3.5.0...kitodo-production-3.5.1

Kitodo.Production 3.5.0

This release contains all changes from 3.5.0-beta1 as well as bugfixes related to features from that release.

What's new

Import Configurations

The new ImportConfiguration class replaces catalogue configurations in the kitodo_opac.xml configuration file. (the file itself is still required for other legacy uses, but the section with "catalogue" configurations is now covered by the import configurations) This allows users with the corresponding permissions to add and edit import configurations via the Kitodo frontend without the need to have acces to the file system of the Kitodo server. Those permissions are not assigned to any role by default, so this has to be done before the feature an be used.
A converter allows transforming catalogue configurations from existing kitodo_opac.xml files into new ImportConfiguration entities semiautomatically.
See https://github.com/kitodo/kitodo-production/wiki/Projektauswahl-und-Katalogsuche for details.

Spanish translation

A full Spanish translation of the Kitodo.Production GUI has been added (thanks to @joergleh for this valuable contribution!)

Support for includes in rulesets

Rulesets can now be split into multiple files to make individual parts reusable in multiple rulesets which prevents code duplication and improves maintainability (see #4596 for details)

Sortable lists

All list views have been made sortable by (nearly) all columns as part of the "Usibility improvement" project of the "Kitodo Development fund"

Import of additional metadata

When creating new processes via catalogue searches, metadata imported during initial import can now be augmented with metadata from a separate import (see #4705 and linked issue for details)

Database changes

There have been multiple changes to the database schema of Kitodo.Production since the last release. Please use the attached files to migrate your database to the current schema:

• migration_3-4-3_to_3-5-0.sql to migrate your database from Kitodo.Production 3.4.3 to Kitodo.Production 3.5.0 OR
• migration_3-5-0-beta1_to_3-5-0.sql to migrate your database from Kitodo.Production 3.5.0-beta1 to Kitodo.Production 3.5.0

Important: Kitodo.Production 3.5.0 does not support MySQL 5.7 anymore and requires MySQL 8 instead!

Ruleset changes

Functional metadata of type recordIdentifier is now mandatory for all document types. This means all divisions in the ruleset that have a processTitle attribute must be configured to allow for at least one metadata with attribute use="recordIdentifier". In the example ruleset ruleset_default.xml this has been added to the metadata CatalogIDDigital, which has traditionally been used for this purpose.

Configuration file and shell skript line endings

The line endings of the following configuration files have been changed:
In kitodo_3-5-0_config_modules/config the files

• kitodo_fileFormats.xml
• kitodo_loginBlacklist.txt
• kitodo_opac.xml
• kitodo_projects.xml

and all *.sh files in kitodo_3-5-0_config_modules/scripts have been converted to unix style line endings. *.bat files in kitodo_3-5-0_config_modules/scripts retain their Windows style line endings.

What's Changed ("**" denotes updates since the last beta release 3.5.0-beta1)

• ** Add required LoC resources to repository by @solth in #5461
• ** Replace ConfigurationException with FileNotFoundException by @henning-gerhardt in #5433
• ** Add help text by @IkramMaalej in #5426
• ** Fix multi view state warning when searching by @thomaslow in #5445
• ** Aligned the English messages with the German messages by @joergleh in #5468
• ** Joergleh-2022-12-01 by @joergleh in #5471
• ** Update Chrome driver version to 108 by @solth in #5483
• ** Bump commons-net from 3.8.0 to 3.9.0 by @dependabot in #5474
• ** Fix 'skiplist' method for FTP interfaces by @solth in #5488
• ** Danilop-2022-12-14 by @danilopenagos in #5490
• ** Remove 'Identifier metadata' field from import configuration class by @solth in #5495
• ** Show default import depth for all opac search import configurations by @solth in #5498
• ** Bug import additional field twice by @markusweigelt in #5500
• ** Fix mapping other metadata formats and parent mapping file by @solth in #5497
• ** Activate 'Search' button when search field and term are not empty by @solth in #5486
• ** Fix the search for linkable children by @BartChris in #5514
• ** Remove unused 'parentElementType' property from import configurations by @solth in #5516
• ** Fix hierarchical mass import by @solth in #5513
• ** Hide 'parent id' search field for custom interfaces by @solth in #5521
• ** Fix creation of query URL for custom interfaces without url parameters by @solth in #5522
• ** Fix import of files from FTP servers by @solth in #5524
• ** Change version to 3.5.0 by @solth in #5529
• Fix wrong and missing brackets by @henning-gerhardt in #5198
• Support includes in ruleset by @matthias-ronge in #4969
• Add task action to quickly add correction message by @thomaslow in #5194
• Fix NPE when using navigation shortcuts in gallery panel by @thomaslow in #5197
• Fix action to remove symbolic links from home directory for selected processes by @thomaslow in #5195
• Additional import by @markusweigelt in #4705
• Update Chrome driver to latest version by @solth in #5211
• Fix validation for metadata groups by @BartChris in #5200
• Various layout and design improvements by @oliver-stoehr in #5203
• Update template tasks on a wokflow update by @BartChris in #5206
• Fix checkstyle violations and lower number of allowed violations by @henning-gerhardt in #5218
• Import Configurations by @solth in #5038
• Added Spanish translation files of the messages by @joergleh in #5214
• Export completed children on parent export by @matthias-ronge in #4888
• Fix new checkstyle violation and lower amount of allowed violations by @henning-gerhardt in #5222
• Add missing translations for import configuration related permissions by @solth in #5223
• Allow parent process's process title as prefix in child title generation by @matthias-ronge in #5080
• Allow automatic adding the counting for a child process by @matthias-ronge in #5081
• Add amount of meta data to index to improve performance by @henning-gerhardt in #5233
• Update messages_es.properties by @joergleh in #5226
• Update bug_report.md by @solth in #5227
• Add input field for identifier prefix by @solth in #5231
• Save mapping file order for import configurations by @solth in #5232
• Fix update of "ID parameter of parent record" in ImportConfiguration by @pontus-osterdahl in #5250
• Fix error with file upload import configurations by @solth in #5247
• Show only regular files in list of available xslts for mapping file by @solth in #5254
• Enable file format select menu and restrict available formats to XML by @solth in #5252
• Update mapping file list after removing list entry by @solth in #5256
• Add edit button for search fields of ImportConfigurations by @solth in #5253
• Refactor CSS rule for scrolling in popup dialogs by @solth in #5277
• Add field 'identifier_metadata' to ImportConfigurations by @solth in #5279
• Fix update thumbnails-overlay after paginating by @IkramMaalej in #5276
• Import dialog fix by @solth in https://github.com/kitodo/kitodo-production/...

Kitodo.Production 3.5.0 beta 1

This is a pre-release intended for testing but not for use in production!

What's new

Import Configurations

The new ImportConfiguration class replaces catalogue configurations in the kitodo_opac.xml configuration file. (the file itself is still required for other legacy uses, but the section with "catalogue" configurations is now covered by the import configurations) This allows users with the corresponding permissions to add and edit import configurations via the Kitodo frontend without the need to have acces to the file system of the Kitodo server. Those permissions are not assigned to any role by default, so this has to be done before the feature an be used.
A converter allows transforming catalogue configurations from existing kitodo_opac.xml files into new ImportConfiguration entities semiautomatically.
See https://github.com/kitodo/kitodo-production/wiki/Projektauswahl-und-Katalogsuche for details.

Spanish translation

A full Spanish translation of the Kitodo.Production GUI has been added (thanks to @joergleh for this valuable contribution!)

Support for includes in rulesets

Rulesets can now be split into multiple files to make individual parts reusable in multiple rulesets which prevents code duplication and improves maintainability (see #4596 for details)

Sortable lists

All list views have been made sortable by (nearly) all columns as part of the "Usibility improvement" project of the "Kitodo Development fund"

Import of additional metadata

When creating new processes via catalogue searches, metadata imported during initial import can now be augmented with metadata from a separate import (see #4705 and linked issue for details)

Changelog

• Fix wrong and missing brackets by @henning-gerhardt in #5198
• Support includes in ruleset by @matthias-ronge in #4969
• Add task action to quickly add correction message by @thomaslow in #5194
• Fix NPE when using navigation shortcuts in gallery panel by @thomaslow in #5197
• Fix action to remove symbolic links from home directory for selected processes by @thomaslow in #5195
• Additional import by @markusweigelt in #4705
• Update Chrome driver to latest version by @solth in #5211
• Fix validation for metadata groups by @BartChris in #5200
• Various layout and design improvements by @oliver-stoehr in #5203
• Update template tasks on a wokflow update by @BartChris in #5206
• Fix checkstyle violations and lower number of allowed violations by @henning-gerhardt in #5218
• Import Configurations by @solth in #5038
• Added Spanish translation files of the messages by @joergleh in #5214
• Export completed children on parent export by @matthias-ronge in #4888
• Fix new checkstyle violation and lower amount of allowed violations by @henning-gerhardt in #5222
• Add missing translations for import configuration related permissions by @solth in #5223
• Allow parent process's process title as prefix in child title generation by @matthias-ronge in #5080
• Allow automatic adding the counting for a child process by @matthias-ronge in #5081
• Add amount of meta data to index to improve performance by @henning-gerhardt in #5233
• Update messages_es.properties by @joergleh in #5226
• Update bug_report.md by @solth in #5227
• Add input field for identifier prefix by @solth in #5231
• Save mapping file order for import configurations by @solth in #5232
• Fix update of "ID parameter of parent record" in ImportConfiguration by @pontus-osterdahl in #5250
• Fix error with file upload import configurations by @solth in #5247
• Show only regular files in list of available xslts for mapping file by @solth in #5254
• Enable file format select menu and restrict available formats to XML by @solth in #5252
• Update mapping file list after removing list entry by @solth in #5256
• Add edit button for search fields of ImportConfigurations by @solth in #5253
• Refactor CSS rule for scrolling in popup dialogs by @solth in #5277
• Add field 'identifier_metadata' to ImportConfigurations by @solth in #5279
• Fix update thumbnails-overlay after paginating by @IkramMaalej in #5276
• Import dialog fix by @solth in #5283
• Update checkstyle to version 10.3.2 including needed checkstyle fixes by @henning-gerhardt in #5284
• Add 'prestructured import' flag to MappingFile class by @solth in #5290
• Fix tsl asl by @markusweigelt in #5239
• Use search delimiter even on hierachy search by @henning-gerhardt in #5287
• Avoid duplicated links in the exported METS by using a LinkedHashSet by @BartChris in #5288
• Add message keys for tooltips by @solth in #5291
• Directly import OAI records and skip redundant query by @solth in #5307
• Unused 'parentElementXpath' field by @solth in #5302
• Record Identifier by @solth in #5293
• Enable parentMappingFile configuration for catalog search configurations by @solth in #5310
• Fix bug when importing child records by @solth in #5304
• Show SearchInterface type specific error messages in mass import results by @solth in #5312
• Update messages_es.properties by @joergleh in #5316
• Update Chrome driver to latest version 104 by @solth in #5327
• Prevent NPE during mass import by updating records table in time by @solth in #5326
• Enable automatic closing of task with type typeAcceptClose by @BartChris in #5301
• Update messages_es.properties, esp. add tooltips by @joergleh in #5325
• Explicitly load Saxon, without incurring any side impacts on the JVM by @matthias-ronge in #5109
• Disallow creating child process if doc type is not allowed by @matthias-ronge in #5338
• Replace org.apache.commons.lang with org.apache.commons.lang3 by @henning-gerhardt in #5335
• Replace jdom with jdom2 by @henning-gerhardt in #5344
• Deactivate SQL safe mode to fix migration file by @solth in #5333
• Fix automatic setting of child count by @matthias-ronge in #5340
• Tsl mass import by @markusweigelt in #5329
• Fix update of metadata table after doctype is changed by @markusweigelt in #5355
• Fix process comments being indexed without a spacing by @thomaslow in #5364
• Upgrade selenium chrome driver to 106 by @thomaslow in #5374
• Fix missing user column in task table by @thomaslow in #5362
• Catalog config importer by @solth in #5313
• Default record xpaths in import configurations by @solth in #5356
• Fix unreliable SeleniumTest causes failed builds by @thomaslow in #5380
• Add bottom margin to metadata occluding plus button by @solth in #5359
• Tsl children processes by @markusweigelt in #5337
• Incorporate changes until Oct 6, 2022 by @joergleh in #5377
• Delete existing data editor settings for tasks of a changed workflow by @BartChris in #5292
• Remember sort order and p...

Kitodo.Production 3.4.3

Release Notes

This release contains changes from the development fund for #4322

Further Changes:

• improved performance in indexing, loading, editing in metadataeditor, creation of newspaper issues
• a lot of dependency versions have been increased
• sub-folders can be added to project
• pom refactoring
• improve excel generation
• allow editing of active workflows
• enable dependent value restrictions in ruleset

there is no database change since release 3.4.0 so no migration.sql is needed

Kitodo.Production 3.4.2

This is a security hotfix release

security vulnerabilitys for springframework has been fixed.
Version are changed to:
spring-security: 5.6.2
spring-core: 5.3.18
spring-expression: 5.3.17
spring-beans: 5.3.18

Kitodo.Production 3.3.3

This is a security hotfix release

security vulnerabilitys for springframework has been fixed.
Version are changed to:
spring-security: 5.6.2
spring-core: 5.3.18
spring-expression: 5.3.17
spring-beans: 5.3.18