Skip to content

Hacky program to migrate ElastiFlow (sFlow) data to NetMeta

Notifications You must be signed in to change notification settings

tomsiewert/elastiflow-to-netmeta

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Elastiflow to NetMeta utility

Hacky utility to migrate Elastiflow data (dumped with elasticdump) to NetMeta.

Reads raw JSON for each day and inserts it into Clickhouse.

Elasticdump command example:

elasticdump --input https://localhost:9200/elastiflow-flow-codex-2.2 --output=/tmp/2023-11-01.json --type=data --searchBody='{"docvalue_fields": [{"field": "flow.collect.timestamp", "format": "date_time"}, {"field": "@timestamp", "format": "date_time"}],"query": {"bool": {"filter": [{"range": {"@timestamp": {"gte": "2023-11-01T00:00:00.000Z", "lte": "2023-11-01T23:59:59.999Z", "format": "strict_date_optional_time"}}}]}}}' --limit 5000

About

Hacky program to migrate ElastiFlow (sFlow) data to NetMeta

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages