id: REF-BITSANDBYTES-INSTALL
title: bitsandbytes Installation Guide
source_type: library_documentation
publisher: Hugging Face
url: https://huggingface.co/docs/bitsandbytes/installation
accessed_at: "2026-08-21T23:31:01Z"
relevant_claims:
  - bitsandbytes supports NVIDIA CUDA GPUs with compute capability 6.0 or newer.
  - Linux aarch64 CUDA wheels are documented for CUDA Toolkit 11.8 through 13.2 with specific SM targets.
  - NVIDIA Jetson L4T/JetPack requires a source build; the published Linux aarch64 wheels target SBSA/server ARM and are not Jetson-compatible.
  - LLM.int8 requires Turing-class or newer hardware, while NF4/FP4 quantization requires Pascal-class or newer hardware.
