Skip to content

Elasticsearch pipeline is a project for synchronizing data from database, also convert data first before we push data to elasticsearch, the current solutions from logstash does not help anymore, so we make our own.

License

Notifications You must be signed in to change notification settings

nooshhub/elasticsearch-pipeline

Repository files navigation

elasticsearch-pipeline

Elasticsearch pipeline is a solution to replace logstash jdbc for synchronizing data from database. Support Elasticsearch version >= 7.17.4, current target version is 8.2.2. download

get started

Start service.

cd espipe-core 
// start your Elasticsearch 
start_es_server.cmd
// start espipe core
mvn_run.cmd

Access API by postman or Apifox.
Postman script is under espipe-core/src/test/postman/espipe.postman_collection.json.
Import it into your postman.

http://localhost:8713/please/start/init/all
http://localhost:8713/please/start/init/{indexName}
http://localhost:8713/please/stop/init/all
http://localhost:8713/please/stop/init/{indexName}
http://localhost:8713/please/start/sync/all
http://localhost:8713/please/start/sync/{indexName}
http://localhost:8713/please/stop/sync/all
http://localhost:8713/please/stop/sync/{indexName}
http://localhost:8713/please/fix/{indexName}/{id}
http://localhost:8713/please/show/metrics   

Contribute

deploy and release

# run mvn_prepare_release.cmd before release, this will check code style
mvn clean deploy -P release

Sponsor

Dora, Kevin, Lanceadd, MrsMeow

About

Elasticsearch pipeline is a project for synchronizing data from database, also convert data first before we push data to elasticsearch, the current solutions from logstash does not help anymore, so we make our own.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published