> ## Documentation Index
> Fetch the complete documentation index at: https://docs.getcollate.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Collate AI Proxy Deployment Guide

> Deploy the Collate AI Proxy with Helm in your own Kubernetes environment and connect it to your existing Collate installation.

# Bring Your Own Cloud

This guide provides step-by-step instructions for deploying the Collate AI Proxy (CAIP) with Helm alongside your existing Collate installation.

The chart packages the Collate AI Proxy as a standalone Kubernetes service that integrates with Collate.

<Warning>
  Collate AI requires the underlying Collate deployment to use **OpenSearch** as its search engine. ElasticSearch is not supported because Semantic and Hybrid Search rely on OpenSearch's vector capabilities.
</Warning>

## Architecture

The following diagram shows the deployment architecture for the Collate AI Proxy when it is installed with Helm alongside an existing Collate deployment.

<img src="https://mintcdn.com/collatedocs/2giDsuIWet2v3d__/public/images/collate-ai/byoc/caip-architecture.png?fit=max&auto=format&n=2giDsuIWet2v3d__&q=85&s=6db9d8cd18f0bb9545fe52c8c84abf3a" alt="Collate AI Proxy deployment architecture" width="2048" height="1830" data-path="public/images/collate-ai/byoc/caip-architecture.png" />

In AWS, we rely on AWS Bedrock using its regional endpoints or inference endpoints to interact with large language models and power our AI agents.

For other providers, such as Azure OpenAI, we query the provider APIs directly.

## Guide sections

<CardGroup cols={2}>
  <Card title="Prerequisites" href="/how-to-guides/deployment/byoc/kubernetes/collate-ai-proxy/prerequisites">
    Review the software, access, hardware, and Azure OpenAI setup requirements.
  </Card>

  <Card title="Deployment" href="/how-to-guides/deployment/byoc/kubernetes/collate-ai-proxy/deployment">
    Configure Helm values and install the Collate AI Proxy.
  </Card>

  <Card title="Configure Collate" href="/how-to-guides/deployment/byoc/kubernetes/collate-ai-proxy/configure-collate">
    Connect your Collate deployment to the Collate AI Proxy.
  </Card>

  <Card title="Validation" href="/how-to-guides/deployment/byoc/kubernetes/collate-ai-proxy/validation">
    Verify that the deployment is healthy from the Collate UI.
  </Card>

  <Card title="Additional settings" href="/how-to-guides/deployment/byoc/kubernetes/collate-ai-proxy/additional-settings">
    Override image settings and host your own Docker images if needed.
  </Card>
</CardGroup>