├── .coveragerc ├── .github ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── ISSUE_TEMPLATE │ ├── bug_report.yml │ ├── config.yml │ └── feature_request.yml ├── PULL_REQUEST_TEMPLATE.md ├── dependabot.yml └── workflows │ ├── publish_pypi.yml │ └── test.yml ├── .gitignore ├── .pydocstyle ├── AUTHORS.md ├── CHANGELOG.md ├── LICENSE ├── README.md ├── SECURITY.md ├── autopep8.bat ├── autopep8.sh ├── codecov.yml ├── dev-requirements.txt ├── otherfiles ├── RELEASE.md ├── donation.png ├── meta.yaml ├── requirements-splitter.py └── version_check.py ├── requirements.txt ├── setup.py ├── tests ├── test_rule_based.py ├── test_tiktoken_cl100k.py ├── test_tiktoken_o200k.py └── test_tiktoken_r50.py └── tocount ├── __init__.py ├── functions.py ├── params.py ├── rule_based ├── __init__.py ├── functions.py └── keywords.py ├── tiktoken_cl100k ├── __init__.py └── functions.py ├── tiktoken_o200k ├── __init__.py └── functions.py └── tiktoken_r50k ├── __init__.py └── functions.py /.coveragerc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.coveragerc -------------------------------------------------------------------------------- /.github/CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /.github/CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/CONTRIBUTING.md -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/bug_report.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/ISSUE_TEMPLATE/bug_report.yml -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/config.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/ISSUE_TEMPLATE/config.yml -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/feature_request.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/ISSUE_TEMPLATE/feature_request.yml -------------------------------------------------------------------------------- /.github/PULL_REQUEST_TEMPLATE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/PULL_REQUEST_TEMPLATE.md -------------------------------------------------------------------------------- /.github/dependabot.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/dependabot.yml -------------------------------------------------------------------------------- /.github/workflows/publish_pypi.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/workflows/publish_pypi.yml -------------------------------------------------------------------------------- /.github/workflows/test.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.github/workflows/test.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.gitignore -------------------------------------------------------------------------------- /.pydocstyle: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/.pydocstyle -------------------------------------------------------------------------------- /AUTHORS.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/AUTHORS.md -------------------------------------------------------------------------------- /CHANGELOG.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/CHANGELOG.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/README.md -------------------------------------------------------------------------------- /SECURITY.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/SECURITY.md -------------------------------------------------------------------------------- /autopep8.bat: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/autopep8.bat -------------------------------------------------------------------------------- /autopep8.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/autopep8.sh -------------------------------------------------------------------------------- /codecov.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/codecov.yml -------------------------------------------------------------------------------- /dev-requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/dev-requirements.txt -------------------------------------------------------------------------------- /otherfiles/RELEASE.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/otherfiles/RELEASE.md -------------------------------------------------------------------------------- /otherfiles/donation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/otherfiles/donation.png -------------------------------------------------------------------------------- /otherfiles/meta.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/otherfiles/meta.yaml -------------------------------------------------------------------------------- /otherfiles/requirements-splitter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/otherfiles/requirements-splitter.py -------------------------------------------------------------------------------- /otherfiles/version_check.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/otherfiles/version_check.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/setup.py -------------------------------------------------------------------------------- /tests/test_rule_based.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tests/test_rule_based.py -------------------------------------------------------------------------------- /tests/test_tiktoken_cl100k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tests/test_tiktoken_cl100k.py -------------------------------------------------------------------------------- /tests/test_tiktoken_o200k.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tests/test_tiktoken_o200k.py -------------------------------------------------------------------------------- /tests/test_tiktoken_r50.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tests/test_tiktoken_r50.py -------------------------------------------------------------------------------- /tocount/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/__init__.py -------------------------------------------------------------------------------- /tocount/functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/functions.py -------------------------------------------------------------------------------- /tocount/params.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/params.py -------------------------------------------------------------------------------- /tocount/rule_based/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/rule_based/__init__.py -------------------------------------------------------------------------------- /tocount/rule_based/functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/rule_based/functions.py -------------------------------------------------------------------------------- /tocount/rule_based/keywords.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/rule_based/keywords.py -------------------------------------------------------------------------------- /tocount/tiktoken_cl100k/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_cl100k/__init__.py -------------------------------------------------------------------------------- /tocount/tiktoken_cl100k/functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_cl100k/functions.py -------------------------------------------------------------------------------- /tocount/tiktoken_o200k/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_o200k/__init__.py -------------------------------------------------------------------------------- /tocount/tiktoken_o200k/functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_o200k/functions.py -------------------------------------------------------------------------------- /tocount/tiktoken_r50k/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_r50k/__init__.py -------------------------------------------------------------------------------- /tocount/tiktoken_r50k/functions.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/openscilab/tocount/HEAD/tocount/tiktoken_r50k/functions.py --------------------------------------------------------------------------------