LLM Frameworks
The main orchestration libraries for building on top of language models, compared by the abstractions they impose and how hard they are to remove later.
6 technologies
- LangChain framework Framework for composing language models with retrieval, tools and memory.
- LlamaIndex framework Data framework focused on ingesting, indexing and querying private knowledge.
- Hugging Face Transformers library Reference implementations and pretrained weights for transformer models, behind one API.
- PEFT library Parameter-efficient fine-tuning methods behind one interface.
- TRL library Training library for fine-tuning and aligning models on preference data.
- Haystack framework Framework for building retrieval and question-answering pipelines.