Skip to content
TakoAPI
← Agent Marketplace
Open-source project

LLMCompiler

by SqueezeAILab

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

—Not yet rated
Your rating
1,903 starsSelf-host

From the README

LLMCompiler: An LLM Compiler for Parallel Function Calling [Paper] LLMCompiler is a framework that enables an efficient and effective orchestration of parallel function calling with LLMs, including both open-source and close-source models, by automatically identifying which tasks can be performed in parallel and which ones are interdependent. TL;DR: The reasoning capabilities of LLMs enable them to execute multiple function calls, using user-provided functions to overcome their inherent limitations (e.g. knowledge cutoffs, poor arithmetic skills, or lack of access to private data). While…

Excerpt from the project's README on GitHub.

Skills

An open-source project — explore the code and self-host it from GitHub.