Katanemo's Arch-Function leads the trending list for Function-Calling LLMs on Hugging Face.
The Large Language Model (LLM) Arch-Function, developed by Katanemo, has established itself as a leading model for Function-Calling on the Hugging Face platform. This was announced by Salman Paracha, known for his work in "Intelligent Infrastructure," via the social media platform X (formerly Twitter). Arch-Function is integrated into Arch, an intelligent gateway for agents, available at https://github.com/katanemo/archgw.
Paracha highlights the speed and efficiency of Arch-Function. The model is said to be on par with Frontier-LLMs in terms of performance, but operates with significantly higher speed and lower costs. It can reportedly process up to 1700 tokens per second – several times more than GPT-4 or Claude. The cost per million tokens is also considerably lower.
Function-Calling allows LLMs to interact with external code and systems. Instead of just generating text, these models can call functions and provide parameters to perform actions. This opens up a wide range of application possibilities:
The process of Function-Calling typically proceeds in the following steps:
1. The user makes a request in natural language.
2. The LLM analyzes the request and identifies the required function.
3. The LLM assembles the necessary parameters for the function.
4. The function is executed and returns a result.
5. The LLM integrates the result into its response to the user.
Arch, the framework behind Arch-Function, aims to simplify the development of agents. By integrating Arch-Function, developers can focus on the business logic of their agents without having to worry about the complexity of Function-Calling. The availability of Arch-Function on Hugging Face underscores the openness and community spirit behind the project.
The increasing popularity of Arch-Function on Hugging Face indicates the growing interest in efficient and powerful Function-Calling LLMs. The combination of speed, cost-efficiency, and integration into a comprehensive framework makes Arch-Function an attractive option for developers who want to create agents and AI-powered applications. It remains to be seen how the technology will evolve and what further innovations Katanemo will present in the future.
```