GenAI Ops Landscape

A curated list of GenAI Ops Projects.

GenAI Ops Tools

LlamaIndex

by

Category
Information Retrieval
Data Ingestion
What it does:
LlamaIndex (formally known as GPT Index) is a project that provides a central interface to connect your LLM's with external data.
Open Source:
Yes
Read more →

LoRa

by

Microsoft

Category
Fine Tuning Framework
What it does:
LoRA: Low-Rank Adaptation of Large Language Models. LoRA reduces the number of trainable parameters by learning pairs of rank-decompostion matrices while freezing the original weights.
Open Source:
Yes
Read more →

MosaicML Training

by

Mosaic ML

Category
Model Training
What it does:
Train your own LLMs and other generative AI models, while maintaining control of your data
Open Source:
No
Read more →

NeMo-Guardrails

by

Nvidia

Category
Content Filtering
What it does:
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Open Source:
Yes
Read more →

OpenAI API

by

OpenAI

Category
Foundation Model
Embedding Provider
What it does:
API access to OpenAI's models and ML tools (e.g., embeddings).
Open Source:
No
Read more →

OpenAI Evals

by

OpenAI

Category
Model Evaluation
What it does:
Evals is a framework for evaluating LLMs (large language models) or systems built using LLMs as components. It also includes an open-source registry of challenging evals.
Open Source:
Yes
Read more →

OpenAI Observability

by

NewRelic

Category
User-Model Supervision
What it does:
Monitor your usage of OpenAI’s GPT Series APIs using New Relic’s dashboard
Open Source:
No
Read more →

OpenAssistant

by

LAION-AI

Category
Foundation Model
What it does:
OpenAssistant is an open-source large language model.
Open Source:
Yes
Read more →

Perspective API

by

Google & Jigsaw

Category
Content Filtering
What it does:
Perspective uses machine learning models to identify abusive comments.
Open Source:
No
Read more →