📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM...
RayLLM - LLMs on Ray
A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG...
LLMFlows - Simple, Explicit and Transparent LLM Apps
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
Efficient AI Inference & Serving
LLMs and Machine Learning done easily
GPU environment and cluster management with LLM support
ChatDev IDE is an tools for building your ai agent, Whether it's NPCs in...
Create characters in Unity with LLMs!
The official repo of Aquila2 series proposed by BAAI, including pretrain...
A multi-platform SwiftUI frontend for running local LLMs with Apple's ML...
LLM.swift is a simple and readable library that allows you to interact w...
Inferflow is an efficient and highly configurable inference engine for l...
AI-powered cybersecurity chatbot designed to provide helpful and accurat...