Skip to content

Commit 2a7dbcc

Browse files
lyonsnoclaude
andcommitted
Pin mlx dependency to PrismML 1-bit affine quantization fork
Point at PrismML-Eng/mlx@prism which adds 1-bit affine quantization Metal kernels, enabling Bonsai-8B-mlx-1bit (1.2 GB Qwen3-8B) to run locally on Apple Silicon. Temporary pin until ml-explore/mlx#3161 merges upstream. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent aa0310b commit 2a7dbcc

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

setup.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@
2424
url="https://github.com/ml-explore/mlx-lm",
2525
license="MIT",
2626
install_requires=[
27-
f"mlx>={MIN_MLX_VERSION}; platform_system == 'Darwin'",
27+
"mlx @ git+https://github.com/PrismML-Eng/mlx.git@prism ; platform_system == 'Darwin'",
2828
"numpy",
2929
"transformers>=5.0.0",
3030
"sentencepiece",

0 commit comments

Comments
 (0)