Azure OpenAI

Connecting an Azure OpenAI model to a Convier instance

Contents of this page

Set environment variables: (Can be done with installation wizard)
- LLM_AZURE_ENDPOINT (https://$yourResource.openai.azure.com/)
- LLM_AZURE_DEPLOYMENT_NAME (name of deployment in Azure AI Foundry)
- LLM_AZURE_SCOPE (https://cognitiveservices.azure.com/.default)
Enable Managed Identity on the App Service
Add role Cognitive Services OpenAI User to App Service Managed Identity
In your Convier project, add source type Azure OpenAI

Enforce regional processing

deny-non-regional.json

{
  "if": {
    "allOf": [
      {
        "field": "type",
        "equals": "Microsoft.CognitiveServices/accounts/deployments"
      },
      {
        "field": "Microsoft.CognitiveServices/accounts/deployments/sku.name",
        "notIn": ["Standard", "ProvisionedManaged"]
      }
    ]
  },
  "then": {
    "effect": "deny"
  }
}

Create policy:

az policy definition create \\
  --name deny-aoai-non-regional-deployments \\
  --display-name "Deny Azure OpenAI non-regional deployments" \\
  --mode All \\
  --rules deny-non-regional.json \\
  --subscription <subscription id>

az policy assignment create \\
  --name deny-aoai-non-regional-deployments \\
  --display-name "Deny Azure OpenAI non-regional deployments" \\
  --policy deny-aoai-non-regional-deployments \\
  --scope /subscriptions/<subscription id>