Flide
bởi OmniJev
🔥🔥 The extremely fast inference engine for decision model
Từ README
English · 简体中文 · 日本語 · 한국어 News · Quick start · Models · Options Flide is fast inference infrastructure for Jev-style decision models. With exact state forking it is up to 9.5 times faster than vLLM and SGLang, and every answer is the one the model gives the question alone. It serves the Jev /v1/systemone API. 🔥 News 🔥 2026-11-22 We added Copernicus-31B, liquamen, Logits-Sigma-1 and turion-jev-31b in Flide 0.1.19, d1-2B now reads images, and Flide comes as a Docker image. 🔥 2026-11-21 We added cerno-27b-v1.1, KnowLine-31B-Gen2 and Jeffan-27B-1211 in Flide 0.1.18, and an optional session…
Trích từ README của dự án trên GitHub.
Kỹ năng
Một dự án mã nguồn mở — khám phá mã nguồn và tự host từ GitHub.