Module io.helidon.integrations.langchain4j.providers.oraclegenai

Package io.helidon.integrations.langchain4j.providers.oci.genai

Class OciGenAiStreamingChatModelConfig.BuilderBase.OciGenAiStreamingChatModelConfigImpl

java.lang.Object

io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiStreamingChatModelConfig.BuilderBase.OciGenAiStreamingChatModelConfigImpl

All Implemented Interfaces:

Prototype.Api, AiProvider.ModelLifecycle, OciGenAiStreamingChatModelConfig

Enclosing class:

OciGenAiStreamingChatModelConfig.BuilderBase<BUILDER extends OciGenAiStreamingChatModelConfig.BuilderBase<BUILDER,PROTOTYPE>,PROTOTYPE extends OciGenAiStreamingChatModelConfig>

protected static class OciGenAiStreamingChatModelConfig.BuilderBase.OciGenAiStreamingChatModelConfigImpl
extends Object
implements OciGenAiStreamingChatModelConfig

Generated implementation of the prototype, can be extended by descendant prototype implementations.

Nested Class Summary

Nested classes/interfaces inherited from interface io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiStreamingChatModelConfig

OciGenAiStreamingChatModelConfig.Builder, OciGenAiStreamingChatModelConfig.BuilderBase<BUILDER extends OciGenAiStreamingChatModelConfig.BuilderBase<BUILDER,PROTOTYPE>,PROTOTYPE extends OciGenAiStreamingChatModelConfig>

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CONFIG_ROOT	The root configuration key for this builder.
static final String	PROVIDER_KEY	AI provider config key.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	OciGenAiStreamingChatModelConfigImpl(OciGenAiStreamingChatModelConfig.BuilderBase<?,?> builder)	Create an instance providing a builder.

Method Summary

Modifier and Type	Method	Description
Optional<com.oracle.bmc.auth.BasicAuthenticationDetailsProvider>	authProvider()	Authentication provider is by default used from default Service bean found in Service Registry.
default boolean	closeModelOnShutdown()	Disables automatic model close because close may wait for streaming callbacks that can still use the registry.
String	compartmentId()	OCI Compartment OCID.
Optional<dev.langchain4j.model.chat.request.ChatRequestParameters>	defaultRequestParameters()	Generated from BaseChatModel.Builder.defaultRequestParameters(dev.langchain4j.model.chat.request.ChatRequestParameters)
boolean	enabled()	If set to false, OciGenAiStreamingChatModel will not be available even if configured.
boolean	equals(Object o)
Optional<ExecutorService>	executorService()	Custom executor for asynchronous request startup and stream processing.
Optional<Double>	frequencyPenalty()	Generated from BaseChatModel.Builder.frequencyPenalty(java.lang.Double)
Optional<com.oracle.bmc.generativeaiinference.GenerativeAiInferenceAsyncClient>	genAiAsyncClient()	Custom asynchronous OCI GenAI client.
Optional<com.oracle.bmc.generativeaiinference.GenerativeAiInferenceClient>	genAiClient()	Custom http client builder.
int	hashCode()
List<dev.langchain4j.model.chat.listener.ChatModelListener>	listeners()	Generated from BaseChatModel.Builder.listeners(java.util.List)
Map<String,Integer>	logitBias()	Modifies the likelihood of specified tokens that appear in the completion.
Optional<Integer>	logProbs()	Generated from BaseGenericChatModel.Builder.logProbs(java.lang.Integer)
Optional<Integer>	maxTokens()	Generated from BaseChatModel.Builder.maxTokens(java.lang.Integer)
String	modelName()	OCI LLM Model name or OCID.
Optional<Integer>	numGenerations()	Generated from BaseGenericChatModel.Builder.numGenerations(java.lang.Integer)
Optional<Double>	presencePenalty()	Generated from BaseChatModel.Builder.presencePenalty(java.lang.Double)
com.oracle.bmc.Region	region()	Region is by default set to the current OCI region detected by OCI SDK.
Optional<Integer>	seed()	Generated from BaseChatModel.Builder.seed(java.lang.Integer)
Optional<com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType>	servingType()	Generated from BaseChatModel.Builder.servingType(com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType)
List<String>	stop()	Generated from BaseChatModel.Builder.stop(java.util.List)
Optional<Double>	temperature()	Generated from BaseChatModel.Builder.temperature(java.lang.Double)
Optional<Integer>	topK()	Generated from BaseChatModel.Builder.topK(java.lang.Integer)
Optional<Double>	topP()	Generated from BaseChatModel.Builder.topP(java.lang.Double)
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiStreamingChatModelConfig

configuredBuilder

Field Details

PROVIDER_KEY

static final String PROVIDER_KEY

AI provider config key.

See Also:

• Constant Field Values

CONFIG_ROOT

static final String CONFIG_ROOT

The root configuration key for this builder.

See Also:

• Constant Field Values

Constructor Details

OciGenAiStreamingChatModelConfigImpl

protected OciGenAiStreamingChatModelConfigImpl(OciGenAiStreamingChatModelConfig.BuilderBase<?,?> builder)

Create an instance providing a builder.

Parameters:

builder - extending builder base of this prototype

Method Details

enabled

public boolean enabled()

Description copied from interface: OciGenAiStreamingChatModelConfig

If set to false, OciGenAiStreamingChatModel will not be available even if configured.

Specified by:

enabled in interface OciGenAiStreamingChatModelConfig

Returns:

whether OciGenAiStreamingChatModel is enabled, defaults to true

topK

public Optional<Integer> topK()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.topK(java.lang.Integer)

Specified by:

topK in interface OciGenAiStreamingChatModelConfig

Returns:

Integer property

listeners

public List<dev.langchain4j.model.chat.listener.ChatModelListener> listeners()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.listeners(java.util.List)

Specified by:

listeners in interface OciGenAiStreamingChatModelConfig

Returns:

List property

seed

public Optional<Integer> seed()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.seed(java.lang.Integer)

Specified by:

seed in interface OciGenAiStreamingChatModelConfig

Returns:

Integer property

logProbs

public Optional<Integer> logProbs()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseGenericChatModel.Builder.logProbs(java.lang.Integer)

Specified by:

logProbs in interface OciGenAiStreamingChatModelConfig

Returns:

Integer property

defaultRequestParameters

public Optional<dev.langchain4j.model.chat.request.ChatRequestParameters> defaultRequestParameters()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.defaultRequestParameters(dev.langchain4j.model.chat.request.ChatRequestParameters)

Specified by:

defaultRequestParameters in interface OciGenAiStreamingChatModelConfig

Returns:

ChatRequestParameters property

numGenerations

public Optional<Integer> numGenerations()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseGenericChatModel.Builder.numGenerations(java.lang.Integer)

Specified by:

numGenerations in interface OciGenAiStreamingChatModelConfig

Returns:

Integer property

topP

public Optional<Double> topP()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.topP(java.lang.Double)

Specified by:

topP in interface OciGenAiStreamingChatModelConfig

Returns:

Double property

presencePenalty

public Optional<Double> presencePenalty()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.presencePenalty(java.lang.Double)

Specified by:

presencePenalty in interface OciGenAiStreamingChatModelConfig

Returns:

Double property

stop

public List<String> stop()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.stop(java.util.List)

Specified by:

stop in interface OciGenAiStreamingChatModelConfig

Returns:

List property

servingType

public Optional<com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType> servingType()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.servingType(com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType)

Specified by:

servingType in interface OciGenAiStreamingChatModelConfig

Returns:

ServingType property

maxTokens

public Optional<Integer> maxTokens()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.maxTokens(java.lang.Integer)

Specified by:

maxTokens in interface OciGenAiStreamingChatModelConfig

Returns:

Integer property

temperature

public Optional<Double> temperature()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.temperature(java.lang.Double)

Specified by:

temperature in interface OciGenAiStreamingChatModelConfig

Returns:

Double property

frequencyPenalty

public Optional<Double> frequencyPenalty()

Description copied from interface: OciGenAiStreamingChatModelConfig

Generated from BaseChatModel.Builder.frequencyPenalty(java.lang.Double)

Specified by:

frequencyPenalty in interface OciGenAiStreamingChatModelConfig

Returns:

Double property

executorService

public Optional<ExecutorService> executorService()

Description copied from interface: OciGenAiStreamingChatModelConfig

Custom executor for asynchronous request startup and stream processing. A directly supplied or registry-provided executor is borrowed and remains the responsibility of its owner; the model does not shut it down.

Specified by:

executorService in interface OciGenAiStreamingChatModelConfig

Returns:

the executor service

genAiAsyncClient

public Optional<com.oracle.bmc.generativeaiinference.GenerativeAiInferenceAsyncClient> genAiAsyncClient()

Description copied from interface: OciGenAiStreamingChatModelConfig

Custom asynchronous OCI GenAI client. A directly supplied or registry-provided client is borrowed and is not closed by the generated factory.

Specified by:

genAiAsyncClient in interface OciGenAiStreamingChatModelConfig

Returns:

the asynchronous OCI GenAI client

modelName

public String modelName()

Description copied from interface: OciGenAiStreamingChatModelConfig

OCI LLM Model name or OCID.

Specified by:

modelName in interface OciGenAiStreamingChatModelConfig

Returns:

Model name or OCID

compartmentId

public String compartmentId()

Description copied from interface: OciGenAiStreamingChatModelConfig

OCI Compartment OCID.

Specified by:

compartmentId in interface OciGenAiStreamingChatModelConfig

Returns:

Compartment OCID

region

public com.oracle.bmc.Region region()

Description copied from interface: OciGenAiStreamingChatModelConfig

Region is by default set to the current OCI region detected by OCI SDK.

Specified by:

region in interface OciGenAiStreamingChatModelConfig

Returns:

OCI Region to connect to

authProvider

public Optional<com.oracle.bmc.auth.BasicAuthenticationDetailsProvider> authProvider()

Description copied from interface: OciGenAiStreamingChatModelConfig

Authentication provider is by default used from default Service bean found in Service Registry.

Specified by:

authProvider in interface OciGenAiStreamingChatModelConfig

Returns:

OCI authentication details provider

genAiClient

public Optional<com.oracle.bmc.generativeaiinference.GenerativeAiInferenceClient> genAiClient()

Description copied from interface: OciGenAiStreamingChatModelConfig

Custom http client builder.

Specified by:

genAiClient in interface OciGenAiStreamingChatModelConfig

Returns:

the http client builder

logitBias

public Map<String,Integer> logitBias()

Description copied from interface: OciGenAiStreamingChatModelConfig

Modifies the likelihood of specified tokens that appear in the completion.

Example: '{"6395": 2, "8134": 1, "21943": 0.5, "5923": -100}'

Specified by:

logitBias in interface OciGenAiStreamingChatModelConfig

Returns:

a map

toString

public String toString()

Overrides:

toString in class Object

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

closeModelOnShutdown

default boolean closeModelOnShutdown()

Disables automatic model close because close may wait for streaming callbacks that can still use the registry. This also leaves internally created clients open; callers using one must close the model explicitly after all operations complete and before registry shutdown starts.

Specified by:

closeModelOnShutdown in interface AiProvider.ModelLifecycle

Returns:

always false