Skip to main content

Documentation Index

Fetch the complete documentation index at: https://ona.com/docs/llms.txt

Use this file to discover all available pages before exploring further.

Available on the Enterprise plan. Contact sales to learn more.
Ona Agent supports direct integration with Google Vertex AI. Supported models: Anthropic Claude Opus 4.6 and Sonnet 4.5.

​
Prerequisites

  • You must have a Google Cloud Platform (GCP) account with Vertex AI enabled.
  • You must enable the Anthropic Claude models you want to use in Vertex AI Model Garden. Each model is enabled per project and may require a quota request. Enabling the Vertex AI API alone is not sufficient.
  • You must have an Ona enterprise license.
  • Your runner must be able to reach aiplatform.googleapis.com over HTTPS. For runners that egress through a private VPC, this means either Private Google Access on the runner’s subnet or a NAT gateway with outbound internet access. Without this, agent calls fail with connection errors.

​
Set up Google Cloud authentication

  1. Go to the Google Cloud Console
  2. Navigate to IAM & Admin > Service Accounts
  3. Click Create Service Account
  4. Enter a name and description for your service account
  5. Click Create and Continue
  6. Grant the following roles:
    • Vertex AI User
  7. Click Continue and then Done
  8. Click on the created service account
  9. Go to the Keys tab
  10. Click Add Key > Create new key
  11. Select JSON format and click Create
  12. Save the downloaded JSON key file securely
GCP IAM Service Accounts page showing the process of creating a new service account with Vertex AI User role

​
Configure the Vertex AI endpoint

​
Endpoint format

vertex://${region}/${model-version}
Use the global region for dynamic routing across available infrastructure.

​
Add the configuration to Ona

You can configure a Vertex integration in two ways:

​
Option 1: Ona CLI

export VERTEX_SERVICE_ACCOUNT_JSON=$(cat /path/to/service-account.json)

ona runner config llm-integration create <runner-id> SUPPORTED_MODEL_SONNET_4 vertex://global/claude-sonnet-4@20250514 "$VERTEX_SERVICE_ACCOUNT_JSON"

ona runner config llm-integration list
Refer to the Endpoint format section above for model and region values.

​
Option 2: Through the UI

  1. Go to the Runners settings page
  2. Select an enterprise runner where you want to enable LLM integration
  3. Scroll down to the “LLM Providers” section
  4. Click the Configure button
Runner settings showing LLM Providers section with Configure button
  1. Fill in the configuration:
    • Region: Enter the region of your Vertex AI endpoint, we recommend using the global region for dynamic routing across available infrastructure.
    • Model Version: Enter the model version you want to use, for example claude-sonnet-4@20250514. See Anthropic’s model availability.
    • Service Account JSON: Drag a service account file here.
  2. Click Create Integration
LLM integration form with fields for region, model version, and service account JSON upload

​
Verify the integration

  1. Create a new environment with the configured runner
  2. Open Ona Agent and start a session - if you see Ona Agent responding, the integration is working.
  3. Test with a simple code generation request

​
Supported models

Ona Agent supports Anthropic Claude Opus 4.6 and Sonnet 4.5 on Google Vertex AI.

​
Next steps

​
Troubleshooting

Authentication errors
  • Verify your service account has the correct IAM roles
  • Ensure the JSON key file is valid and properly formatted
  • Check that the Vertex AI API is enabled for your project
Endpoint not found
  • Verify your project ID, region, and model name in the endpoint URL
  • Ensure the model is available in your selected region
Permission denied
  • Check that your service account has Vertex AI User role
  • Verify your project has billing enabled
  • Ensure Vertex AI API is enabled
If you encounter issues:
  1. Check the Ona Agent logs for detailed error messages
  2. Verify your Google Cloud quotas and limits
  3. Contact your account manager for additional support