Instructions to use James040/llama-cpp-python-wheels with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use James040/llama-cpp-python-wheels with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="James040/llama-cpp-python-wheels", filename="{{GGUF_FILE}}", )output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
File size: 132 Bytes
d65ab05 | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:b31fb70ff1ef1c845af7832d67784fba783e69451ddf1bfb84108d6bcf42479d
size 4516126
|