├── .gitignore ├── README.md ├── go.mod ├── go.sum ├── images ├── cmd-ui.png ├── crawl-ratio-graph.png ├── crawl-speed-graph.png ├── web-archive.png └── web-crawler-diagram.png └── main.go /.gitignore: -------------------------------------------------------------------------------- 1 | .env 2 | web-crawler 3 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/README.md -------------------------------------------------------------------------------- /go.mod: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/go.mod -------------------------------------------------------------------------------- /go.sum: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/go.sum -------------------------------------------------------------------------------- /images/cmd-ui.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/images/cmd-ui.png -------------------------------------------------------------------------------- /images/crawl-ratio-graph.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/images/crawl-ratio-graph.png -------------------------------------------------------------------------------- /images/crawl-speed-graph.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/images/crawl-speed-graph.png -------------------------------------------------------------------------------- /images/web-archive.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/images/web-archive.png -------------------------------------------------------------------------------- /images/web-crawler-diagram.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/images/web-crawler-diagram.png -------------------------------------------------------------------------------- /main.go: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/afazio1/web-crawler/HEAD/main.go --------------------------------------------------------------------------------