Large Language Model Text Generation Inference

llama and other large language models on iOS and MacOS offline using GGML library.

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

Swift library to work with llama and other large language models.

CodeAssist is an advanced code completion tool that provides high-quality code completions for Python, Java, C++ and so on. CodeAssist 是一个高级代码补全工具，高质量为 Python、Java 和 C++ 补全代码。

Host your own LLM ChatBot!

Emacs AI-powered text & code completion client

a Jax/Flax inference code of StarCoder

A tool for scraping web documentation using Crawl4AI, converting it to Markdown, and preparing it for integration with local LLMs (like Ollama) to enhance their knowledge for learning and "vibe coding" workflows.

Bring your own copilot server and customize commands to refactor instead of autofill or tabbed completion.

Leveraging code LLMs to build and use your own personal coding assistant on VSCode 😎

A plugin designed for generating product code based on tests written for it.

Finetuning Starcoder2 to assist the development of decentralised NEAR dApps

🦄 Forge - a local-first, multi-agent software-engineering runtime that runs Claude Code / Codex-style agentic workflows entirely on your own machine via Ollama, llama.cpp, vLLM, and LM Studio (cloud models optional). Ships 18 sandboxed tools, 6 model providers, and a full REPL + UI dashboard in a single Node CLI - no telemetry, no lock-in.

AI-powered code review with Hugging Face's StarCoder AI model

Implementing idea from the "Extracting Training Data from Large Language Models" paper on starcoderbase-3b model