Upserts, Deletes And Incremental Processing on Big Data.
-
Updated
May 24, 2024 - Java
Upserts, Deletes And Incremental Processing on Big Data.
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
An orchestration platform for the development, production, and observation of data assets.
Building data processing pipelines for documents processing with NLP using Apache NiFi and related services
Lean and mean distributed stream processing system written in rust and web assembly.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
CloudQuery Go SDK for source and destination plugins
Privacy and Security focused Segment-alternative, in Golang and React
The open source high performance ELT framework powered by Apache Arrow
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Turns Data and AI algorithms into production-ready web applications in no time.
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Fair Entity Matching: A Fairness Suite for Auditing Entity Matching Approaches
multimedia is an R package for multimodal mediation analysis of microbiome data. It has been designed to help integration of relative abundance, survey, and metabolomic data through causal mediation analysis.
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
Business Automations is a collection of automations built to enhance productivity, increase revenue, and reduce manual data manipulation at a retail store location that integrates a NCR Counterpoint SQL database with the BigCommerce e-commerce platform.
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
Flink CDC is a streaming data integration tool
Add a description, image, and links to the data-integration topic page so that developers can more easily learn about it.
To associate your repository with the data-integration topic, visit your repo's landing page and select "manage topics."