Nvidia unveils NeMo Switchyard to curb escalating AI costs with intelligent model routing

Summary

Nvidia has released NeMo Switchyard, an open-source software router designed to reduce AI costs by intelligently routing requests to the most cost-effective language models. This new tool aims to help enterprises manage spiraling AI expenses, claiming a 74% cost cut against frontier-only models with a 6% accuracy reduction.