├── .gitignore ├── LICENSE ├── README.md ├── config.py ├── cookie ├── bing_search_cookie.json └── google_search_cookie.json ├── example_cmd.sh ├── init.py ├── main.py ├── modules ├── __init__.py ├── algorithm.py ├── crawler.py └── preprocess.py └── requirements.txt /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/README.md -------------------------------------------------------------------------------- /config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/config.py -------------------------------------------------------------------------------- /cookie/bing_search_cookie.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/cookie/bing_search_cookie.json -------------------------------------------------------------------------------- /cookie/google_search_cookie.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/cookie/google_search_cookie.json -------------------------------------------------------------------------------- /example_cmd.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/example_cmd.sh -------------------------------------------------------------------------------- /init.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/init.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/main.py -------------------------------------------------------------------------------- /modules/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /modules/algorithm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/modules/algorithm.py -------------------------------------------------------------------------------- /modules/crawler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/modules/crawler.py -------------------------------------------------------------------------------- /modules/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/luogan1234/concept-expansion-snippet/HEAD/modules/preprocess.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | jieba 2 | requests 3 | bs4 4 | nltk 5 | pytorch-pretrained-bert --------------------------------------------------------------------------------