Hi,
We have configured an "Azure OpenAI" AI model and a "Azure AI search" in the ODC AI AgentBuilder.When starting a new agent with this AI model it works correctly, but when enabling the datasource I get the error:
"You exceeded the token limit for your model, please reduce the length of the messages or completion."
Only sending a "hi" or hello works. Any question triggers the error
Our issues was that the AI build into the Order Management Demo uses a function calling way to retrieve it's data.If you also enable it to have access to its data through the AI builder, it has 2 ways of retrieving data. Which it does both in parallel, requiring high amount of tokens.
We are having the same problem as you.
Did you find a solution to your problem.
Have a great day,
Renaud
Have you checked the Tokens limitations on the Portal?Example: