├── Dockerfile ├── LICENSE ├── README.md ├── config └── models.json ├── examples ├── README.md ├── test_cli_connector.py ├── test_images │ └── sample.jpg └── test_server_connector.py ├── llama_cli_connector.py ├── llama_server_connector.py ├── models └── add_your_models_here.txt ├── requirements.txt └── vision-prompt.txt /Dockerfile: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/Dockerfile -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/README.md -------------------------------------------------------------------------------- /config/models.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/config/models.json -------------------------------------------------------------------------------- /examples/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/examples/README.md -------------------------------------------------------------------------------- /examples/test_cli_connector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/examples/test_cli_connector.py -------------------------------------------------------------------------------- /examples/test_images/sample.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/examples/test_images/sample.jpg -------------------------------------------------------------------------------- /examples/test_server_connector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/examples/test_server_connector.py -------------------------------------------------------------------------------- /llama_cli_connector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/llama_cli_connector.py -------------------------------------------------------------------------------- /llama_server_connector.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/llama_server_connector.py -------------------------------------------------------------------------------- /models/add_your_models_here.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fidecastro/llama-cpp-connector/HEAD/models/add_your_models_here.txt -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | requests 2 | openai 3 | fastapi 4 | uvicorn[standard] 5 | httpx -------------------------------------------------------------------------------- /vision-prompt.txt: -------------------------------------------------------------------------------- 1 | Describe this image in full detail. 2 | 3 | 4 | --------------------------------------------------------------------------------