├── .github ├── PULL_REQUEST_TEMPLATE.md └── workflows │ └── tests.yml ├── .gitignore ├── .pre-commit-config.yaml ├── LICENSE ├── README.md ├── __init__.py ├── assets └── .gitignore ├── configs ├── filter_terms.txt └── skip_terms.yaml ├── output └── .gitignore ├── project.yml ├── requirements.txt ├── scripts ├── __init__.py ├── create_kb.py ├── extract_demo_dump.py ├── parse.py ├── utils.py └── wiki │ ├── __init__.py │ ├── compat.py │ ├── ddl.sql │ ├── download.sh │ ├── namespaces.py │ ├── schemas.py │ ├── wikidata.py │ └── wikipedia.py ├── setup.cfg ├── setup.py └── test_wikid.py /.github/PULL_REQUEST_TEMPLATE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/.github/PULL_REQUEST_TEMPLATE.md -------------------------------------------------------------------------------- /.github/workflows/tests.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/.github/workflows/tests.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | .idea 2 | __pycache__ 3 | project.lock 4 | -------------------------------------------------------------------------------- /.pre-commit-config.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/.pre-commit-config.yaml -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/README.md -------------------------------------------------------------------------------- /__init__.py: -------------------------------------------------------------------------------- 1 | from .scripts import * 2 | -------------------------------------------------------------------------------- /assets/.gitignore: -------------------------------------------------------------------------------- 1 | * 2 | */ 3 | !.gitignore 4 | -------------------------------------------------------------------------------- /configs/filter_terms.txt: -------------------------------------------------------------------------------- 1 | New York 2 | Boston -------------------------------------------------------------------------------- /configs/skip_terms.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/configs/skip_terms.yaml -------------------------------------------------------------------------------- /output/.gitignore: -------------------------------------------------------------------------------- 1 | * 2 | */ 3 | !.gitignore 4 | -------------------------------------------------------------------------------- /project.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/project.yml -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | spacy<4.0 2 | pyyaml 3 | tqdm 4 | prettytable -------------------------------------------------------------------------------- /scripts/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/__init__.py -------------------------------------------------------------------------------- /scripts/create_kb.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/create_kb.py -------------------------------------------------------------------------------- /scripts/extract_demo_dump.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/extract_demo_dump.py -------------------------------------------------------------------------------- /scripts/parse.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/parse.py -------------------------------------------------------------------------------- /scripts/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/utils.py -------------------------------------------------------------------------------- /scripts/wiki/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/__init__.py -------------------------------------------------------------------------------- /scripts/wiki/compat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/compat.py -------------------------------------------------------------------------------- /scripts/wiki/ddl.sql: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/ddl.sql -------------------------------------------------------------------------------- /scripts/wiki/download.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/download.sh -------------------------------------------------------------------------------- /scripts/wiki/namespaces.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/namespaces.py -------------------------------------------------------------------------------- /scripts/wiki/schemas.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/schemas.py -------------------------------------------------------------------------------- /scripts/wiki/wikidata.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/wikidata.py -------------------------------------------------------------------------------- /scripts/wiki/wikipedia.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/scripts/wiki/wikipedia.py -------------------------------------------------------------------------------- /setup.cfg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/setup.cfg -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/setup.py -------------------------------------------------------------------------------- /test_wikid.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/wikid/HEAD/test_wikid.py --------------------------------------------------------------------------------