Authenticate your Azure OpenAI Based App Using Microsoft Entra ID & Managed Identity

If you’re using Azure OpenAI then you must be aware that the most common and easiest way to authenticate our application is using app-key.

generated from bing

The key-based authentication approach is very popular because it is very straightforward. Let’s have a quick look at the below code snippet:

from openai import AzureOpenAI
client = AzureOpenAI( 
  api_key= ‘KEY’, 
  api_version=”VERSION", 
  azure_endpoint = ‘ENDPOINT’ ) 

response = client.completions.create(model=’MODEL’, prompt=’PROMPT’, max_tokens=80) 
print(response.choices[0].text)

The above code snippet constructs the AzureOpenAI client object using api-key, api-version, and endpoint. Then, this object makes a call to the completion endpoint with the required parameters.

Of course, app key works very well for the experimentation purpose and is not very well suited for enterprise grade applications which will soon be in production.

So, why should we never use keys to authenticate Azure OpenAI in production?

Key reasons for not using key-based authentication

In a production capacity, it is generally not recommended to use keys for Azure OpenAI authentication and there are several key reasons behind this. Here are those reasons:

Key Exposure

Keys may inadvertently be committed to source control by developers or stored in some insecure locations and if key is exposed, unauthorized individuals can easily gain access to Azure environment.

Granular Permissions

Keys are good for local development and testing but not for production environments as they don’t follow the principle of least privilege. They give too much access to anyone who uses them, which can lead to misuse.

Shareable

It is very easy to share keys with both good and bad intensions, intentionally or unintentionally which leads to potential security breaks.

Rotation being hard

As keys can’t rotate automatically, we need manual intervention to do the rotation which might be too time consuming and cumbersome, specifically in a production deployment. Just one instance of compromise and all the instances where that are used to generate tokens will need an update.

Here is the video tutorial explaining in more detail:

Tips to avoid key-based authentication

One should avoid using keys to authenticate and use Managed Identities for Azure resources. There are multiple benefits of Managed Identities:

Superior security

Managed identities offer a significant improvement to security by providing tokens which are generated by Azure. This eventually means, that we no longer need to handle credentials directly.

Granular Access Control

With Managed Identities, assigning specific roles and permissions is straightforward. This ensures that each identity has only the access it needs, adhering to the principle of least privilege. It emphasizes on granting the bare minimum required permissions.

No rotation required

As the managed identity feature takes care of credential management for us, we do not need to store or manually rotate credentials, which minimizes the risk of credential exposure.

Implement Key-less Authentication Using Microsoft Entra

Let’s get started by updating our source code first. Here are the code changes:

from openai import AzureOpenAI
from azure.identity import DefaultAzureCredential,get_bearer_token_provider 

cred = DefaultAzureCredential() 
token_provider = get_bearer_token_provider(cred,”https://cognitiveservices.azure.com/.default") 

client = AzureOpenAI( 
  azure_ad_token_provider = token_provider, 
  api_version=”VERSION", 
  azure_endpoint = ‘ENDPOINT_GOES_HERE’ ) 

response = client.completions.create(model=’MODEL’, prompt=’PROMPT’, max_tokens=80) 
print(response.choices[0].text)

Now, if you’ll simply execute this code, it won’t work. Here is the error, you can expect:

Error clearly says, there is something wrong with authentication part and this happened because of these two reasons:

• - no default credentials are set
• - no permissions are granted to the user, who is executing the application

Here, we have multiple ways to sort our default credential issue. Here is the complete documentation of DefaultAzureCredential class, which sits in Azure.Identity namespace.

You can choose any of these ways to resolve this. I used CLI way and executed below commands in PowerShell terminal:

az login 
Connect-AzAccount

If you’re not able to execute above commands, then make sure you’ve required PS module installed. Install Az PowerShell module using

Install-Module -Name Az -Repository PSGallery -Force

Once you got connected, you will see that your available subscriptions got listed in your terminal.

The next step is to make sure that whoever is running the code has permission to access the OpenAI service. This can be done either with Azure CLI or using Azure portal.

Using Azure CLI (make sure to set required environment variables)

az role assignment create \
 — role “876pyt-XXXX-XXXX-XXXX-XXXX” \ 
 — assignee-object-id “$PRINCIPAL_ID” \ 
 — scope /subscriptions/”$SUBSCRIPTION_ID”/resourceGroups/”$RESOURCE_GROUP” \
 — assignee-principal-type User

Using Azure Portal

Here are the steps for assigning permissions using Azure portal:

• Open the OpenAI resource
• Select “Access Control (IAM)” from the left navigation
• Select “+ Add” in the top menu

• Search for “Cognitive Services OpenAI User” and select it in the results

• Select “Assign access to: User, group, or service principal”
• Search for your email address:

• Select “Review and assign”

Now, if you’ll run your application, you’ll get the response. Check out my full video discussing it in action:

If you want to know about Azure OpenAI’s integration using Managed Identity, then here is another video:

Hope you enjoyed saying bye to key-based authentication.