Otoroshi 17.8 is available, with budget management for AI models

Otoroshi v17.8 is available with multiple improvements and bug fixes. It comes with LLM extension 0.0.55 which introduces inline functions in all models and budget management for AI services. Thus, you can now defines limits to AI provider usage per API key, user, kind of models, etc.

To update just set CC_OTOROSHI_VERSION of the add-on’s Java application to v17.8.0_1762533533 and rebuild it. You can also use the new Clever Tools commands, introduced in 3.13.0 release:

clever features enable operators

clever otoroshi version check yourOtoroshiNameOrId
clever otoroshi version update yourOtoroshiNameOrId
clever otoroshi version update yourOtoroshiNameOrId v17.8.0_1762533533

• Learn more about Otoroshi with LLM on Clever Cloud
• Learn more about Budget management for AI models in Otoroshi