Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

alihan/ autothink

Python 0 0

Optimizing inference proxy for LLMs

llm large-language-models openai prompt-engineering agent agents proxy-server genai llm-inference agentic-ai optimization agentic-framework agentic-workflow api-gateway chain-of-thought llmapi mixture-of-experts moa monte-carlo-tree-search openai-api

Updated 2025-05-28 09:39:38 +03:00

alihan/ TPI-LLM

Python 0 0

TPI-LLM: A High-Performance Tensor Parallelism Inference System for Edge LLM Services.

edge-ai llm-inference ml-system

Updated 2024-10-04 22:25:48 +03:00