Skip to content

Commit

Permalink
Merge pull request #51 from lighteternal/patch-1
Browse files Browse the repository at this point in the history
Update semantic-caching.ipynb
  • Loading branch information
vieiraae authored Aug 8, 2024
2 parents 7825f32 + 64558f8 commit 3ade31c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion labs/semantic-caching/semantic-caching.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
"## Semantic Caching lab\n",
"![flow](../../images/semantic-caching.gif)\n",
"\n",
"Playground to try the [sementic caching policy](https://learn.microsoft.com/en-us/azure/api-management/azure-openai-semantic-cache-lookup-policy). \n",
"Playground to try the [semantic caching policy](https://learn.microsoft.com/en-us/azure/api-management/azure-openai-semantic-cache-lookup-policy). \n",
"\n",
"The azure-openai-semantic-cache-lookup policy conducts a cache lookup of responses on Azure OpenAI Chat Completion API and Completion API requests from a pre-configured external cache. It operates by comparing the vector proximity of the prompt to prior requests and using a specific similarity score threshold. Caching responses helps reduce bandwidth and processing demands on the backend Azure OpenAI API, thus reducing latency perceived by API consumers.\n",
"\n",
Expand Down

0 comments on commit 3ade31c

Please sign in to comment.