• info Overview
    • Quickstart
    • Install and Run Models
    • Try it out
    • Customizing the Model
    • Build LocalAI from source
    • Run with container images
    • Run with Kubernetes
    • Your First Chat with LocalAI
    • Setting Up Models
    • Using GPU Acceleration
    • Deploying to Production
    • Integration Examples
  • newspaper What's New
    • Backends
    • ⚡ GPU acceleration
    • 📖 Text generation (GPT)
    • 📈 Reranker
    • 🗣 Text to audio (TTS)
    • 🎨 Image generation
    • 🔍 Object detection
    • 🧠 Embeddings
    • 🥽 GPT Vision
    • ✍️ Constrained Grammars
    • 🆕🖧 Distributed Inference
    • 🔈 Audio to text
    • 🔥 OpenAI functions and tools
    • 💾 Stores
    • 🖼️ Model gallery
    • Model Context Protocol (MCP)
  • sync Integrations
    • Advanced usage
    • Fine-tuning LLMs for text generation
    • Performance Tuning
    • VRAM and Memory Management
    • Model Configuration
    • Installer options
    • API Reference
    • Model compatibility table
    • Architecture
    • CLI Reference
    • LocalAI binaries
    • Running on Nvidia ARM64
  • quiz FAQ
  • bug_report Troubleshooting Guide
  • security Security Best Practices
    Star us on GitHub ! 
    Star
    • GitHub
    • Twitter / X
    • RSS
  • to navigate
  • to select
  • to close
    • Home
    • Advanced Configuration
    On this page
      • Configuration
      • Performance & Optimization
      • Specialized Topics
      • Before You Begin
      • Related Documentation
      • Configuration
      • Performance & Optimization
      • Specialized Topics
      • Before You Begin
      • Related Documentation
    settings

    Advanced Configuration

    Advanced configuration and optimization for LocalAI

    article

    Advanced usage

    article

    Fine-tuning LLMs for text generation

    speed

    Performance Tuning

    Optimize LocalAI for maximum performance

    article

    VRAM and Memory Management

    article

    Model Configuration

    article

    Installer options


    © 2023-2025 Ettore Di Giacinto