A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

Experimental: MLX model provider for Strands Agents - Build, train, and deploy AI agents on Apple Silicon.

Real-time webcam demo with SmolVLM(mlx-community/SmolVLM-Instruct-4bit) and MLX-VLM

An all-in-one LLMs chat Web UI based on the MLX framework, designed for Apple Silicon.

Various LLM resources and experiments

Defensive layer for mlx / mlx-lm / mlx-vlm on Apple Silicon. Prevents IOGPUFamily kernel panics, SIGABRT from Metal completion handlers, and Mac reboots from MLX inference. Covers 7 known kernel-panic root-cause classes.

llmost - the most easy llm host

A lightweight, config-driven framework for unified vision-language model inference across local and cloud backends.

macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

MLX inference service compatible with OpenAI API, built on MLX-LM and MLX-VLM.基于MLX-LM和MLX-VLM构建的OpenAI API兼容的MLX推理服务.

🤖 Run Strands Agents on Apple Silicon with ease—perform inference, fine-tune models, and leverage vision capabilities using Python and LoRA training.

Streamlit web app for document question answering.

Streamlit app using Google's MedGemma 1.5 4B (via mlx-vlm on Apple Silicon) for chest X-ray analysis: anatomy localization with bounding boxes and longitudinal comparison of two CXRs.

Analyze whole slide digital pathology images with the MedGemma 1.5 model via a Streamlit web app. Runs on Apple Silicon using MLX.

Analyze CT scans with Google's MedGemma 1.5 vision-language model via mlx-vlm on Apple Silicon.

Streamlit app for medical image and text inference using Google's MedGemma model in MLX format, running locally on Mac with Apple Silicon.

Generate and edit images with FLUX.2 Klein (4B) from Black Forest Labs.

This repository provides a python script for running Vision Language Models via mlx-vlm