📚 Core Concepts

LangBatch gives you building blocks to create pipelines for AI inference. The core concepts are:

• Batch Types

  What is a batch?

• Pipeline

  How to create a batch AI inference pipeline?

• Providers

  Provider based implementations