Add text_service

[os-esh]

Feature: Api root for working with Vertex AI

[os-esh]

Here example, how to check the service:

using GoogleCloud
const DEFAULT_REGION = "us-central1"
const CREDENTIALS = JSONCredentials("credentials.json")
const GOOGLE_SESSION = GoogleSession(CREDENTIALS, ["cloud-platform"])

set_session!(text_service, GOOGLE_SESSION)

model_params = (
  temperature=0.7,
  maxOutputTokens=200,
  topP=0.7,
  topK=40
)

params = Dict(
  :instances => [
    Dict(:prompt => "Tell about yourself")
  ],
  :parameters => model_params
)

response = text_service(
  :PALM,
  :predict,
  DEFAULT_REGION,
  CREDENTIALS.project_id,
  DEFAULT_REGION,
  GoogleCloud.BISON_TEXT_MODEL_NAME,
  data=params
)

[aviks]

Hi @quinnj or @mattBrzezinski would either of you be able to take a look at this? Thanks!

[quinnj]

Looks fine? Is there any way to add some kind of test? Just to ensure it can load even?

[rssdev10]

@quinnj for real testing here we need an active API KEY. I think it is possible to add some tests if there is a way to enable real use of API KEY in CI. Otherwise, only mock tests with examples of data to be returned are possible.

E.g. this way we use for tests with external OpenAI API calls - https://github.com/OpenSesame/GptSearchPlugin/blob/main/test/helpers/mocking.jl#L7-L18 .

[quinnj]

Yeah, I was thinking just mock tests would be great.