Bump org.apache.beam:beam-sdks-java-google-cloud-platform-bom from 2.51.0 to 2.56.0

[dependabot]

Bumps org.apache.beam:beam-sdks-java-google-cloud-platform-bom from 2.51.0 to 2.56.0.

Release notes

Sourced from org.apache.beam:beam-sdks-java-google-cloud-platform-bom's releases.

Beam 2.56.0 release

We are happy to present the new 2.56.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.56.0, check out the detailed release notes.

Highlights

• Added FlinkRunner for Flink 1.17, removed support for Flink 1.12 and 1.13. Previous version of Pipeline running on Flink 1.16 and below can be upgraded to 1.17, if the Pipeline is first updated to Beam 2.56.0 with the same Flink version. After Pipeline runs with Beam 2.56.0, it should be possible to upgrade to FlinkRunner with Flink 1.17. (#29939)

I/Os

• Upgraded Avro version to 1.11.3, kafka-avro-serializer and kafka-schema-registry-client versions to 7.6.0 (Java) (#30638). The newer Avro package is known to have breaking changes. If you are affected, you can keep pinned to older Avro versions which are also tested with Beam.

New Features / Improvements

• Profiling of Cythonized code has been disabled by default. This might improve performance for some Python pipelines (#30938).
• Bigtable enrichment handler now accepts a custom function to build a composite row key. (Python) (#30974).

Breaking Changes

• Default consumer polling timeout for KafkaIO.Read was increased from 1 second to 2 seconds. Use KafkaIO.read().withConsumerPollingTimeout(Duration duration) to configure this timeout value when necessary (#30870).
• Python Dataflow users no longer need to manually specify --streaming for pipelines using unbounded sources such as ReadFromPubSub.

Bugfixes

• Fixed locking issue when shutting down inactive bundle processors. Symptoms of this issue include slowness or stuckness in long-running jobs (Python) (#30679).
• Fixed logging issue that caused silecing the pip output when installing of dependencies provided in --requirements_file (Python).

List of Contributors

According to git shortlog, the following people contributed to the {$RELEASE_VERSION} release. Thank you to all contributors!

Abacn

Ahmed Abualsaud

Andrei Gurau

Andrey Devyatkin

Aravind Pedapudi

Arun Pandian

Arvind Ram

... (truncated)

Changelog

Sourced from org.apache.beam:beam-sdks-java-google-cloud-platform-bom's changelog.

[2.56.0] - 2024-05-01

Highlights

• Added FlinkRunner for Flink 1.17, removed support for Flink 1.12 and 1.13. Previous version of Pipeline running on Flink 1.16 and below can be upgraded to 1.17, if the Pipeline is first updated to Beam 2.56.0 with the same Flink version. After Pipeline runs with Beam 2.56.0, it should be possible to upgrade to FlinkRunner with Flink 1.17. (#29939)

I/Os

• Support for X source added (Java/Python) (#X).
• Upgraded Avro version to 1.11.3, kafka-avro-serializer and kafka-schema-registry-client versions to 7.6.0 (Java) (#30638). The newer Avro package is known to have breaking changes. If you are affected, you can keep pinned to older Avro versions which are also tested with Beam.

New Features / Improvements

• Added ability to control the exact number of models loaded across processes by RunInference. This may be useful for pipelines with tight memory constraints (#31052)
• Profiling of Cythonized code has been disabled by default. This might improve performance for some Python pipelines (#30938).
• Bigtable enrichment handler now accepts a custom function to build a composite row key. (Python) (#30974).

Breaking Changes

• Default consumer polling timeout for KafkaIO.Read was increased from 1 second to 2 seconds. Use KafkaIO.read().withConsumerPollingTimeout(Duration duration) to configure this timeout value when necessary (#30870).
• Python Dataflow users no longer need to manually specify --streaming for pipelines using unbounded sources such as ReadFromPubSub.

Bugfixes

• Fixed locking issue when shutting down inactive bundle processors. Symptoms of this issue include slowness or stuckness in long-running jobs (Python) (#30679).
• Fixed logging issue that caused silecing the pip output when installing of dependencies provided in --requirements_file (Python).
• Fixed pipeline stuckness issue by disallowing versions of grpcio that can cause the stuckness (Python) (#30867).

Known Issues

[2.55.1] - 2024-04-08

Bugfixes

• Fixed issue that broke WriteToJson in languages other than Java (X-lang) (#30776).

[2.55.0] - 2024-03-25

Highlights

• The Python SDK will now include automatically generated wrappers for external Java transforms! (#29834)

I/Os

• Added support for handling bad records to BigQueryIO (#30081).
  • Full Support for Storage Read and Write APIs
  • Partial Support for File Loads (Failures writing to files supported, failures loading files to BQ unsupported)
  • No Support for Extract or Streaming Inserts
• Added support for handling bad records to PubSubIO (#30372).

... (truncated)

Commits

• b34cf54 Set version for 2.56.0 RC2
• 96d2a28 One more macos change (#31124)
• 26241f9 Try fixing build wheels (#31115) (#31119)
• 2eb4aa5 Cherry picking snake_case conversions (#31110)
• d07cc62 Simplify intermediate data in Iceberg sink; use manifest files (#31090)
• fe00df6 Add ability to load multiple copies of a model across processes (#31052) (#31...
• 6384a4b Cherrypicking #30910 into release-2.56.0 (#31076)
• bba3ac3 [release-2.56.0] Cherry-picks #31070 (#31072)
• 8aee226 Better and earlier error for missing service loader metadata. (#31042) (#31056)
• 99688da [release-2.56.0] Exclude broken versions of GRPCIO and upgrade the base image...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)