io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiStreamingChatModelConfig

Description

Configuration for LangChain4j model OciGenAiStreamingChatModel

Configuration options

Key	Type	Default	Description
`gen-ai-client`	`GenerativeAiInferenceClient`		Custom http client builder
`seed`	`Integer`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#seed(java.lang.Integer)`
`default-request-parameters-discover-services`	`Boolean`	`true`	Whether to enable automatic service discovery for `default-request-parameters`
`auth-provider`	`BasicAuthenticationDetailsProvider`		Authentication provider is by default used from default Service bean found in Service Registry
`enabled`	`Boolean`	`true`	If set to `false`, OciGenAiStreamingChatModel will not be available even if configured
`num-generations`	`Integer`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseGenericChatModel.Builder#numGenerations(java.lang.Integer)`
`temperature`	`Double`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#temperature(java.lang.Double)`
`max-tokens`	`Integer`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#maxTokens(java.lang.Integer)`
`model-name`	`String`		OCI LLM Model name or OCID
`auth-provider-discover-services`	`Boolean`	`true`	Whether to enable automatic service discovery for `auth-provider`
`logit-bias`	`Map<String, Integer>`		Modifies the likelihood of specified tokens that appear in the completion
`region-discover-services`	`Boolean`	`true`	Whether to enable automatic service discovery for `region`
`serving-type`	`String`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#servingType(com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType)`
`frequency-penalty`	`Double`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#frequencyPenalty(java.lang.Double)`
`default-request-parameters`	`ChatRequestParameters`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#defaultRequestParameters(dev.langchain4j.model.chat.request.ChatRequestParameters)`
`listeners`	`List<ChatModelListener>`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#listeners(java.util.List)`
`top-k`	`Integer`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topK(java.lang.Integer)`
`top-p`	`Double`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topP(java.lang.Double)`
`listeners-discover-services`	`Boolean`	`true`	Whether to enable automatic service discovery for `listeners`
`stop`	`List<String>`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#stop(java.util.List)`
`compartment-id`	`String`		OCI Compartment OCID
`gen-ai-client-discover-services`	`Boolean`	`true`	Whether to enable automatic service discovery for `gen-ai-client`
`log-probs`	`Integer`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseGenericChatModel.Builder#logProbs(java.lang.Integer)`
`region`	`String`		Region is by default set to the current OCI region detected by OCI SDK
`presence-penalty`	`Double`		Generated from `dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#presencePenalty(java.lang.Double)`

See the manifest for all available types.

Edit this page or Report an issue