Class ApigeeLlm

Integration for Gemini models.

Hierarchy (View Summary)

Gemini
- ApigeeLlm

Constructors

constructor

new ApigeeLlm(__namedParameters: ApigeeLlmParams): ApigeeLlm
Parameters
- __namedParameters: ApigeeLlmParams
Returns ApigeeLlm
Overrides Gemini.constructor
- Defined in models/apigee_llm.ts:63

Properties

`Readonly`[BASE_MODEL_SYMBOL]

"[BASE_MODEL_SYMBOL]": true

A unique symbol to identify BaseLlm classes.

`Readonly`model

model: string

`Protected` `Readonly`vertexai

vertexai: boolean

`Static` `Readonly`supportedModels

supportedModels: (string | RegExp)[] = ...

A list of model name patterns that are supported by this LLM.

Returns

A list of supported models.

Accessors

apiBackend

get apiBackend(): GoogleLLMVariant
Returns GoogleLLMVariant
Inherited from Gemini.apiBackend
- Defined in models/google_llm.ts:252

apiClient

get apiClient(): GoogleGenAI
Returns GoogleGenAI
Inherited from Gemini.apiClient
- Defined in models/google_llm.ts:231

liveApiClient

get liveApiClient(): GoogleGenAI
Returns GoogleGenAI
Inherited from Gemini.liveApiClient
- Defined in models/google_llm.ts:276

liveApiVersion

get liveApiVersion(): string
Returns string
Overrides Gemini.liveApiVersion
- Defined in models/apigee_llm.ts:135

`Protected`trackingHeaders

get trackingHeaders(): Record<string, string>
Returns Record<string, string>
Inherited from Gemini.trackingHeaders
- Defined in models/base_llm.ts:80

Methods

connect

connect(llmRequest: LlmRequest): Promise<BaseLlmConnection>
Connects to the Gemini model and returns an llm connection.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the Gemini model.
Returns Promise<BaseLlmConnection>
BaseLlmConnection, the connection to the Gemini model.
Overrides Gemini.connect
- Defined in models/apigee_llm.ts:151

generateContentAsync

generateContentAsync(
llmRequest: LlmRequest,
stream?: boolean,
): AsyncGenerator<LlmResponse, void>
Sends a request to the Gemini model.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the Gemini model.
- stream: boolean = false
  bool = false, whether to do streaming call.
Returns AsyncGenerator<LlmResponse, void>
Yields
LlmResponse: The model response.
Overrides Gemini.generateContentAsync
- Defined in models/apigee_llm.ts:142

`Protected`getHttpOptions

getHttpOptions(): HttpOptions
Returns HttpOptions
Overrides Gemini.getHttpOptions
- Defined in models/apigee_llm.ts:98

`Protected`getLiveHttpOptions

getLiveHttpOptions(): HttpOptions
Returns HttpOptions
Overrides Gemini.getLiveHttpOptions
- Defined in models/apigee_llm.ts:104

maybeAppendUserContent

maybeAppendUserContent(llmRequest: LlmRequest): void
Appends a user content, so that model can continue to output.
Parameters
- llmRequest: LlmRequest
  LlmRequest, the request to send to the LLM.
Returns void
Inherited from Gemini.maybeAppendUserContent
- Defined in models/base_llm.ts:94