Hello,
I am using the AI Agent Builder from the OutSystems Forge in my project. I’ve connected it to data entities within my application and exposed a custom local model (Llama 3.2) via API using ngrok. The custom model is successfully integrated with the AI Agent Builder.
However, when I ask the agent questions about the connected data, the agent responds that it does not have access to the data. Upon reviewing the request being sent to my custom model, I noticed that the data content itself is not being sent. Instead, what is being passed is the schema of the database (e.g., table creation scripts and column descriptions), rather than the actual data or rows.
For example, when I ask the agent: "Can you tell me how many rows exist in the data I provided?", the response from the model is: "You didn’t give me any database. This is the beginning of our conversation, and I don’t have any information to work with yet."
{ "messages": [ { "role": "system", "content": "Given the following ${database_schema}:\n\n```SQL\r\n\r\n-- Table: 'example'\r\n-- Description: 'Contenu des example par example '\r\nCREATE TABLE OS_example_TABLE (\r\n\texternalid Text,\t\t\t-- Column ExternalId. \r\n\texampleid Integer REFERENCES OS__TABLE(),\t\t\t-- Column exampleId. \r\n\tupdatedby Integer REFERENCES OS__TABLE().....ect }, { "role": "user", "content": "can you check how many rows in the data base i gave you ?" } ], "n": 1}
{ "response": "You didn't give me any database. This is the beginning of our conversation, and I don't have any information to work with yet. Please feel free to share the database or describe it, and I'll be happy to help you with your question about the number of rows."}
Dear @Mohamed Anas BelArbi .
The AI model is expecting the actual data rows from the database, not just the schema. This is why it responds with the message that it doesn’t have any database information.
@ndy we know that already, this is the problem :)