Hi,
We are in the process of migrating to the Freedom UI and as such have access to the AI capabilities, for which I am interested to learn from other users of their experiences.
Have your users and company found the use of AI of benefit and if so, what would you say would biggest benefits you have found?
During testing, we have found a very high average token consumption (between 20,000 and 50,000) and am concerned about how much each interaction 'costs' in tokens and that will limit our usage.
Any feedback would be appreciated.
thanks
Mark
Like
Hello,
Please refer to the following, below is an example of how many tokens each intent can use:
More information about tokenization can be found here:
1. https://learn.microsoft.com/en-us/dotnet/ai/conceptual/understanding-tokens
2. Actual visual representation of token counts from Open AI: https://platform.openai.com/tokenizer
Regarding token usage, specifically why does 1 question use so many tokens:
Creatio AI performs additional actions beyond the messages generated by the user in the chat. Let me explain with an example:
If you ask Creatio AI to create a draft of an email, Creatio AI performs several steps:
- Search for available skills.
- Read the skill prompt and available actions.
- Read data from the page.
- Check system settings to confirm that the message can be sent.
- Generate a draft message and display it in the chat (the only step visible to the user).
- Perform additional actions, such as opening a card, etc.
Steps 1–4 are not visible in the user interface, but they also consume tokens, which explains why the token usage may appear higher than expected.
Learn more: https://www.creatio.com/products/pricing
Best regards,
Ivan