├── .gitignore ├── CHANGELOGS.md ├── Cargo.toml ├── LICENSE ├── README.md ├── src ├── lib.rs ├── main.rs ├── matcher.rs └── parser.rs └── tests ├── CMakeLists.txt ├── CMakeLists.txt.in ├── Cargo.toml ├── Makefile └── src ├── lib.rs ├── robots_test.cc ├── rust_robotstxt.h └── simple_test.cpp /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/.gitignore -------------------------------------------------------------------------------- /CHANGELOGS.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/CHANGELOGS.md -------------------------------------------------------------------------------- /Cargo.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/Cargo.toml -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/README.md -------------------------------------------------------------------------------- /src/lib.rs: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/src/lib.rs -------------------------------------------------------------------------------- /src/main.rs: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/src/main.rs -------------------------------------------------------------------------------- /src/matcher.rs: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/src/matcher.rs -------------------------------------------------------------------------------- /src/parser.rs: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/src/parser.rs -------------------------------------------------------------------------------- /tests/CMakeLists.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/CMakeLists.txt -------------------------------------------------------------------------------- /tests/CMakeLists.txt.in: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/CMakeLists.txt.in -------------------------------------------------------------------------------- /tests/Cargo.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/Cargo.toml -------------------------------------------------------------------------------- /tests/Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/Makefile -------------------------------------------------------------------------------- /tests/src/lib.rs: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/src/lib.rs -------------------------------------------------------------------------------- /tests/src/robots_test.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/src/robots_test.cc -------------------------------------------------------------------------------- /tests/src/rust_robotstxt.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/src/rust_robotstxt.h -------------------------------------------------------------------------------- /tests/src/simple_test.cpp: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/Folyd/robotstxt/HEAD/tests/src/simple_test.cpp --------------------------------------------------------------------------------