Flide
от OmniJev
🔥🔥 The extremely fast inference engine for decision model
Из README
English · 简体中文 · 日本語 · 한국어 News · Quick start · Models · Options Flide is fast inference infrastructure for Jev-style decision models. With exact state forking it is up to 9.5 times faster than vLLM and SGLang, and every answer is the one the model gives the question alone. It serves the Jev /v1/systemone API. 🔥 News 🔥 2026-11-22 We added Copernicus-31B, liquamen, Logits-Sigma-1 and turion-jev-31b in Flide 0.1.19, d1-2B now reads images, and Flide comes as a Docker image. 🔥 2026-11-21 We added cerno-27b-v1.1, KnowLine-31B-Gen2 and Jeffan-27B-1211 in Flide 0.1.18, and an optional session…
Фрагмент README проекта на GitHub.
Навыки
Open-source проект — изучите код и разверните его у себя с GitHub.