Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Databricks database support #3518

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Databricks database support #3518

wants to merge 7 commits into from

Conversation

zayscue
Copy link

@zayscue zayscue commented Sep 7, 2022

Databricks has recently expanded its data warehousing offerings, and because of this companies have begun to forgo using Databricks in combination with other warehouses like Snowflake or BigQuery and instead have decided just to keep everything within Databricks. Because of this shift, there is a need for more traditional SQL tooling that supports the Databricks SQL divers and dialect. This merge request is designed to create a community-supported Databricks SQL implementation for the flyway database migration tool.

References:
What is a Databricks SQL Warehouse: https://docs.databricks.com/sql/admin/sql-endpoints.html
Databricks SQL Reference Docs: https://docs.databricks.com/sql/language-manual/index.html

@CLAassistant
Copy link

CLAassistant commented Sep 7, 2022

CLA assistant check
All committers have signed the CLA.

@nycjay
Copy link

nycjay commented Sep 7, 2022

+1
We were looking into writing this ourselves, so very much looking forward to this PR getting merged in.

@nycjay
Copy link

nycjay commented Feb 2, 2023

@zayscue Did you get this working with Unity Catalog? I'm trying to follow along here and connect to the catalog then database/schema, and it's not working as intended. Did you need to complement catalog support separately? Or changes to the URL?

@dmoore247
Copy link

Came here looking for Databricks support in Flyaway

@aguinther-ias
Copy link

Would love to utilize this feature and see it get some attention by Databricks and Red-Gate folks and get merged.

@bestekov
Copy link

Any news on this?

@fernanluyano
Copy link

Which release will have Databricks support?

@@ -13,7 +13,7 @@
* See the License for the specific language governing permissions and
* limitations under the License.
*/
package org.flywaydb.commandline.command.version;
package org.flywaydb.commandline.logging.version;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hope I'm within the bounds of reasonableness. Since you've changed the path here to be logging instead of version, you also need to update the line in src/main/resources/META-INF/services/org.flywaydb.core.extensibility.Plugin to org.flywaydb.commandline.logging.version.VersionCommandExtension as well. (or at least I had to in order to build this)

I think I'm missing some context here, but what's the motivation behind moving these files into logging?

<dependency>
<groupId>com.databricks</groupId>
<artifactId>databricks-jdbc</artifactId>
<version>2.6.29</version>

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

may want to include the latest version if possible, 2.6.33

@tdimhcsleumas
Copy link

Forked this and made some additional changes: #3681

@MattMacGillivray
Copy link

Waiting for this feature - please merge and release! Even if it's 'beta', lets try it.

@jordanyakerstuzo
Copy link

Are there any updated on this feature?

@sdheepakdba
Copy link

Any Update on this features

@jomach
Copy link

jomach commented May 20, 2024

+1

@tdimhcsleumas
Copy link

Community db support is now handled in another repository. The databricks integration was merged recently: flyway/flyway-community-db-support#26

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet