Description
Configuration for LangChain4j model JlamaChatModel.
Usages
Configuration options
| Key | Kind | Type | Default Value | Description |
|---|---|---|---|---|
auth-token | VALUE | String | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#authToken(java.lang.String) | |
enabled | VALUE | Boolean | true | If set to false, JlamaChatModel will not be available even if configured |
max-tokens | VALUE | Integer | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#maxTokens(java.lang.Integer) | |
model-cache-path | VALUE | Path | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#modelCachePath(java.nio.file.Path) | |
model-name | VALUE | String | Configure the model name | |
quantize-model-at-runtime | VALUE | Boolean | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#quantizeModelAtRuntime(java.lang.Boolean) | |
temperature | VALUE | Float | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#temperature(java.lang.Float) | |
thread-count | VALUE | Integer | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#threadCount(java.lang.Integer) | |
working-directory | VALUE | Path | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#workingDirectory(java.nio.file.Path) | |
working-quantized-type | VALUE | c.g.t.j.s.DType | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#workingQuantizedType(com.github.tjake.jlama.safetensors.DType) |
See the manifest for all available types.