Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DAT-17482] Integrating Bigquery into liquibase #5838

Open
wants to merge 511 commits into
base: master
Choose a base branch
from

Conversation

filipelautert
Copy link
Collaborator

Impact

  • Bug fix (non-breaking change which fixes expected existing functionality)
  • Enhancement/New feature (adds functionality without impacting existing logic)
  • Breaking change (fix or feature that would cause existing functionality to change)

Description

Things to be aware of

Things to worry about

Additional Context

nvoxland and others added 30 commits May 3, 2023 16:18
…oud-google-cloud-bigquerystorage-2.36.1

Bump google-cloud-bigquerystorage from 2.34.2 to 2.36.1
…coco-maven-plugin-0.8.10

Bump jacoco-maven-plugin from 0.8.9 to 0.8.10
…picocli-4.7.3

Bump picocli from 4.7.2 to 4.7.3
…sion-4.21.1

Bump liquibase.version from 4.21.0 to 4.21.1
Bumps [maven-surefire-plugin](https://github.com/apache/maven-surefire) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](apache/maven-surefire@surefire-3.0.0...surefire-3.1.0)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-surefire-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…ven.plugins-maven-surefire-plugin-3.1.0

Bump maven-surefire-plugin from 3.0.0 to 3.1.0
Bumps `liquibase.version` from 4.21.1 to 4.22.0.

Updates `liquibase-core` from 4.21.1 to 4.22.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.21.1...v4.22.0)

Updates `liquibase-maven-plugin` from 4.21.1 to 4.22.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.21.1...v4.22.0)

---
updated-dependencies:
- dependency-name: org.liquibase:liquibase-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.liquibase:liquibase-maven-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…sion-4.22.0

Bump liquibase.version from 4.21.1 to 4.22.0
Bumps [picocli](https://github.com/remkop/picocli) from 4.7.3 to 4.7.4.
- [Release notes](https://github.com/remkop/picocli/releases)
- [Changelog](https://github.com/remkop/picocli/blob/main/RELEASE-NOTES.md)
- [Commits](remkop/picocli@v4.7.3...v4.7.4)

---
updated-dependencies:
- dependency-name: info.picocli:picocli
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
…picocli-4.7.4

Bump picocli from 4.7.3 to 4.7.4
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.25.0 to 2.28.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.25.0...v2.28.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquery-2.28.0

Bump google-cloud-bigquery from 2.25.0 to 2.28.0
Bumps [google-http-client](https://github.com/googleapis/google-http-java-client) from 1.43.1 to 1.43.3.
- [Release notes](https://github.com/googleapis/google-http-java-client/releases)
- [Changelog](https://github.com/googleapis/google-http-java-client/blob/main/CHANGELOG.md)
- [Commits](googleapis/google-http-java-client@v1.43.1...v1.43.3)

---
updated-dependencies:
- dependency-name: com.google.http-client:google-http-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
…tp-client-google-http-client-1.43.3

Bump google-http-client from 1.43.1 to 1.43.3
Bumps [google-cloud-bigquerystorage](https://github.com/googleapis/java-bigquerystorage) from 2.36.1 to 2.39.0.
- [Release notes](https://github.com/googleapis/java-bigquerystorage/releases)
- [Changelog](https://github.com/googleapis/java-bigquerystorage/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquerystorage@v2.36.1...v2.39.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquerystorage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquerystorage-2.39.0

Bump google-cloud-bigquerystorage from 2.36.1 to 2.39.0
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.28.0 to 2.29.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.28.0...v2.29.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquery-2.29.0

Bump google-cloud-bigquery from 2.28.0 to 2.29.0
Bumps `liquibase.version` from 4.22.0 to 4.23.0.

Updates `liquibase-core` from 4.22.0 to 4.23.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.22.0...v4.23.0)

Updates `liquibase-maven-plugin` from 4.22.0 to 4.23.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.22.0...v4.23.0)

---
updated-dependencies:
- dependency-name: org.liquibase:liquibase-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.liquibase:liquibase-maven-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…sion-4.23.0

Bump liquibase.version from 4.22.0 to 4.23.0
Bumps [libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.14.0 to 26.18.0.
- [Release notes](https://github.com/googleapis/java-cloud-bom/releases)
- [Changelog](https://github.com/googleapis/java-cloud-bom/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-cloud-bom@v26.14.0...v26.18.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:libraries-bom
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-libraries-bom-26.18.0

Bump libraries-bom from 26.14.0 to 26.18.0
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.29.0 to 2.30.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.29.0...v2.30.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquery-2.30.0

Bump google-cloud-bigquery from 2.29.0 to 2.30.0
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.30.0 to 2.30.1.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.30.0...v2.30.1)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [google-cloud-bigquerystorage](https://github.com/googleapis/java-bigquerystorage) from 2.39.0 to 2.40.1.
- [Release notes](https://github.com/googleapis/java-bigquerystorage/releases)
- [Changelog](https://github.com/googleapis/java-bigquerystorage/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquerystorage@v2.39.0...v2.40.1)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquerystorage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquerystorage-2.40.1

Bump google-cloud-bigquerystorage from 2.39.0 to 2.40.1
@filipelautert filipelautert changed the title [DAT-17482] "Integrating Bigquery into liquibase [DAT-17482] Integrating Bigquery into liquibase May 2, 2024
Scope.getCurrentScope().getLog(this.getClass()).info("Sequences are not supported by BigQuery");
return null;
}

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @filipelautert
When I added Function support to BigQuerry I got the next error if the getSelectSequenceStatement and replaces methods were removed
image

At the same time, the SQL from the bigquery repository was incorrect, so I had to fix it
https://github.com/liquibase/liquibase-bigquery/blob/main/src/main/java/liquibase/ext/bigquery/snapshot/jvm/BigQuerySequenceSnapshotGenerator.java#L52

            "SELECT NULL AS SEQUENCE_NAME, NULL AS START_VALUE, NULL AS MIN_VALUE, NULL AS MAX_VALUE, " +
                    "NULL AS INCREMENT_BY, " +
                    "NULL AS WILL_CYCLE " +
                    "FROM " +
                    jdbcSchemaName + "." + database.getSystemSchema().toUpperCase() + ".COLUMNS WHERE 1=0");

Should the methods be removed?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense... seems it is conflicting with the new implementation.

KushnirykOleh and others added 2 commits May 15, 2024 16:19
[DAT-17403] resolved priorities for Datatypes and ModifyDatatype generator
* Fix add primaryKey sql generator

* Remove redundant drop primaryKey sql generator

* Add primaryKey snapshot generator

* Revert "Remove redundant drop primaryKey sql generator"

This reverts commit 82a8ce7.

* Replace RawSqlStatement to RawParameterizedStatement

* Revert "Revert "Remove redundant drop primaryKey sql generator""

This reverts commit 8f3a481.

* Remove unnecessary semicolon

* Fix unit tests

* Fix possible NPE

* Update unit test

* Add primaryKey to create table sql generator

* Add primaryKey to add column sql generator

* Fix integration tests

* Fix unit test

* Fix incorrect merge conflict resolution
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet