% ramalama-perplexity 1
ramalama-perplexity - calculate the perplexity value of an AI Model
ramalama perplexity [options] model [arg ...]
| Transports | Prefix | Web Site |
|---|---|---|
| URL based | https://, http://, file:// | https://web.site/ai.model, file://tmp/ai.model |
| HuggingFace | huggingface://, hf://, hf.co/ | huggingface.co |
| Ollama | ollama:// | ollama.com |
| OCI Container Registries | oci:// | opencontainers.org |
Examples: quay.io, Docker Hub,Artifactory |
RamaLama defaults to the Ollama registry transport. This default can be overridden in the ramalama.conf file or via the RAMALAMA_TRANSPORTS
environment. export RAMALAMA_TRANSPORT=huggingface Changes RamaLama to use huggingface transport.
Modify individual model transports by specifying the huggingface://, oci://, ollama://, https://, http://, file:// prefix to the model.
URL support means if a model is on a web site or even on your local system, you can run it directly.
show this help message and exit
Calculate the perplexity of an AI Model. Perplexity measures how well the model can predict the next token with lower values being better.
ramalama perplexity granite-moe3Jan 2025, Originally compiled by Eric Curtin [email protected]