├── .github └── workflows │ └── tests.yml ├── .gitignore ├── CMakeLists.txt ├── LICENSE ├── MANIFEST.in ├── Makefile ├── README.md ├── examples └── 01_intro_to_floret.ipynb ├── floret.pc.in ├── pyproject.toml ├── python ├── README.md └── floret_module │ └── floret │ ├── __init__.py │ ├── floret.py │ ├── pybind │ └── floret_pybind.cc │ ├── tests │ ├── README.md │ ├── __init__.py │ ├── data.txt │ ├── test_configurations.py │ ├── test_script.py │ ├── test_tokenize.py │ └── test_train.py │ └── util │ ├── __init__.py │ └── util.py ├── requirements.txt ├── setup.cfg ├── setup.py ├── src ├── MurmurHash3.cpp ├── MurmurHash3.h ├── args.cc ├── args.h ├── autotune.cc ├── autotune.h ├── densematrix.cc ├── densematrix.h ├── dictionary.cc ├── dictionary.h ├── fasttext.cc ├── fasttext.h ├── loss.cc ├── loss.h ├── main.cc ├── matrix.cc ├── matrix.h ├── meter.cc ├── meter.h ├── model.cc ├── model.h ├── productquantizer.cc ├── productquantizer.h ├── quantmatrix.cc ├── quantmatrix.h ├── real.h ├── utils.cc ├── utils.h ├── vector.cc └── vector.h └── tests ├── fetch_test_data.sh └── runtests.py /.github/workflows/tests.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/.github/workflows/tests.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/.gitignore -------------------------------------------------------------------------------- /CMakeLists.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/CMakeLists.txt -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/LICENSE -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/MANIFEST.in -------------------------------------------------------------------------------- /Makefile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/Makefile -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/README.md -------------------------------------------------------------------------------- /examples/01_intro_to_floret.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/examples/01_intro_to_floret.ipynb -------------------------------------------------------------------------------- /floret.pc.in: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/floret.pc.in -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/pyproject.toml -------------------------------------------------------------------------------- /python/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/README.md -------------------------------------------------------------------------------- /python/floret_module/floret/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/__init__.py -------------------------------------------------------------------------------- /python/floret_module/floret/floret.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/floret.py -------------------------------------------------------------------------------- /python/floret_module/floret/pybind/floret_pybind.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/pybind/floret_pybind.cc -------------------------------------------------------------------------------- /python/floret_module/floret/tests/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/README.md -------------------------------------------------------------------------------- /python/floret_module/floret/tests/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/__init__.py -------------------------------------------------------------------------------- /python/floret_module/floret/tests/data.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/data.txt -------------------------------------------------------------------------------- /python/floret_module/floret/tests/test_configurations.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/test_configurations.py -------------------------------------------------------------------------------- /python/floret_module/floret/tests/test_script.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/test_script.py -------------------------------------------------------------------------------- /python/floret_module/floret/tests/test_tokenize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/test_tokenize.py -------------------------------------------------------------------------------- /python/floret_module/floret/tests/test_train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/tests/test_train.py -------------------------------------------------------------------------------- /python/floret_module/floret/util/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/util/__init__.py -------------------------------------------------------------------------------- /python/floret_module/floret/util/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/python/floret_module/floret/util/util.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | pybind11 2 | pytest 3 | -------------------------------------------------------------------------------- /setup.cfg: -------------------------------------------------------------------------------- 1 | [metadata] 2 | description_file = README.md 3 | -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/setup.py -------------------------------------------------------------------------------- /src/MurmurHash3.cpp: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/MurmurHash3.cpp -------------------------------------------------------------------------------- /src/MurmurHash3.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/MurmurHash3.h -------------------------------------------------------------------------------- /src/args.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/args.cc -------------------------------------------------------------------------------- /src/args.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/args.h -------------------------------------------------------------------------------- /src/autotune.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/autotune.cc -------------------------------------------------------------------------------- /src/autotune.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/autotune.h -------------------------------------------------------------------------------- /src/densematrix.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/densematrix.cc -------------------------------------------------------------------------------- /src/densematrix.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/densematrix.h -------------------------------------------------------------------------------- /src/dictionary.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/dictionary.cc -------------------------------------------------------------------------------- /src/dictionary.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/dictionary.h -------------------------------------------------------------------------------- /src/fasttext.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/fasttext.cc -------------------------------------------------------------------------------- /src/fasttext.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/fasttext.h -------------------------------------------------------------------------------- /src/loss.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/loss.cc -------------------------------------------------------------------------------- /src/loss.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/loss.h -------------------------------------------------------------------------------- /src/main.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/main.cc -------------------------------------------------------------------------------- /src/matrix.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/matrix.cc -------------------------------------------------------------------------------- /src/matrix.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/matrix.h -------------------------------------------------------------------------------- /src/meter.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/meter.cc -------------------------------------------------------------------------------- /src/meter.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/meter.h -------------------------------------------------------------------------------- /src/model.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/model.cc -------------------------------------------------------------------------------- /src/model.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/model.h -------------------------------------------------------------------------------- /src/productquantizer.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/productquantizer.cc -------------------------------------------------------------------------------- /src/productquantizer.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/productquantizer.h -------------------------------------------------------------------------------- /src/quantmatrix.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/quantmatrix.cc -------------------------------------------------------------------------------- /src/quantmatrix.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/quantmatrix.h -------------------------------------------------------------------------------- /src/real.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/real.h -------------------------------------------------------------------------------- /src/utils.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/utils.cc -------------------------------------------------------------------------------- /src/utils.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/utils.h -------------------------------------------------------------------------------- /src/vector.cc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/vector.cc -------------------------------------------------------------------------------- /src/vector.h: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/src/vector.h -------------------------------------------------------------------------------- /tests/fetch_test_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/tests/fetch_test_data.sh -------------------------------------------------------------------------------- /tests/runtests.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/explosion/floret/HEAD/tests/runtests.py --------------------------------------------------------------------------------