Open source tool distills Jev so you can run it locally
Sure, Jev is cheap and quick to respond to queries, but you know what would be even better? How about a local student model that learns from your Jev requests and runs familiar ones on your hardware instead? Jevstiller is an open source project that, as its name suggests, distills Jev’s outputs into a local model that can do some of Jev’s arguably fast work even more quickly and efficiently - no need to spend $42 per billion input tokens or wait around 300 ms for a response on reques
Read more »