Skip to content

Commit

Permalink
Adapt to current wappalyzer schema; Change apps.json to
Browse files Browse the repository at this point in the history
technologies.json

This commit will adjust to the current wappalyzer schema. Additionally,
a working `technologies.json` file is now included in this commit from
wappalyzer. This ensures always a working schema is available.

The name change from wappalyzer (apps.json to technologies.json) is now
also reflected in this package.
  • Loading branch information
rverton committed Feb 11, 2021
1 parent eb56e98 commit 4b7ed27
Show file tree
Hide file tree
Showing 6 changed files with 21,040 additions and 26 deletions.
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,4 @@ hosts
*.csv
cmd/webanalyze/webanalyze
cmd/webanalyze/hosts.json
apps.json
dist/
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,11 @@ Precompiled releases can be downloaded directly [here](https://github.com/rverto
If you want to build for yourself:

$ go get -v -u github.com/rverton/webanalyze/cmd/webanalyze
$ webanalyze -update # loads new apps.json file from wappalyzer project
$ webanalyze -update # loads new technologies.json file from wappalyzer project
$ webanalyze -h
Usage of webanalyze:
-apps string
app definition file. (default "apps.json")
app definition file. (default "technologies.json")
-crawl int
links to follow from the root page (default 0)
-host string
Expand All @@ -32,7 +32,7 @@ If you want to build for yourself:
number of worker (default 4)


The `-update` flags downloads a current version of apps.json from the [wappalyzer repository](https://github.com/AliasIO/Wappalyzer) to the current folder.
The `-update` flags downloads a current version of `technologies.json` from the [wappalyzer repository](https://github.com/AliasIO/Wappalyzer) to the current folder.

## Development / Usage as a lib

Expand All @@ -43,7 +43,7 @@ See `cmd/webanalyze/main.go` for an example on how to use this as a library.
$ ./webanalyze -host robinverton.de -crawl 1
:: webanalyze : v1.0
:: workers : 4
:: apps : apps.json
:: apps : technologies.json
:: crawl count : 1
:: search subdomains : true

Expand All @@ -60,7 +60,7 @@ See `cmd/webanalyze/main.go` for an example on how to use this as a library.
$ ./webanalyze -host robinverton.de -crawl 1 -output csv
:: webanalyze : v1.0
:: workers : 4
:: apps : apps.json
:: apps : technologies.json
:: crawl count : 1
:: search subdomains : true

Expand Down
4 changes: 2 additions & 2 deletions cmd/webanalyze/main.go
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ func init() {
flag.StringVar(&outputMethod, "output", "stdout", "output format (stdout|csv|json)")
flag.BoolVar(&update, "update", false, "update apps file")
flag.IntVar(&workers, "worker", 4, "number of worker")
flag.StringVar(&apps, "apps", "apps.json", "app definition file.")
flag.StringVar(&apps, "apps", "technologies.json", "app definition file.")
flag.StringVar(&host, "host", "", "single host to test")
flag.StringVar(&hosts, "hosts", "", "filename with hosts, one host per line.")
flag.IntVar(&crawlCount, "crawl", 0, "links to follow from the root page (default 0)")
Expand All @@ -59,7 +59,7 @@ func main() {
}

if update {
err = webanalyze.DownloadFile(webanalyze.WappalyzerURL, "apps.json")
err = webanalyze.DownloadFile(webanalyze.WappalyzerURL, "technologies.json")
if err != nil {
log.Fatalf("error: can not update apps file: %v", err)
}
Expand Down

0 comments on commit 4b7ed27

Please sign in to comment.