GenAI Ops Landscape

A curated list of GenAI Ops Projects.

GenAI Ops Tools

Pinecone

by

Pinecone

Category
Data Storage
Information Retrieval
What it does:
Vector database to build high-performance vector search applications.
Open Source:
No
Read more →

Preamble

by

Preamble

Category
Content Filtering
Application-Layer
AI Governance
What it does:
Ensures usage of LLMs is in compliance with organization policies.
Open Source:
No
Read more →

PrivateGPT

by

Private AI

Category
Content Filtering
Application-Layer
What it does:
A privacy-preserving alternative powered by ChatGPT
Open Source:
Read more →

PromptLayer

by

PromptLayer

Category
Prompt Engineering
What it does:
Log OpenAI requests. Search usage history. Track performance. Visually manage prompt templates.
Open Source:
No
Read more →

PromptSource

by

BigScience

Category
Prompt Engineering
What it does:
PromptSource is a toolkit for creating, sharing and using natural language prompts.
Open Source:
Yes
Read more →

RLHF

by

Scale AI

Category
RLHF
What it does:
RLHF for Large Language Models
Open Source:
No
Read more →

RedPajama-Data

by

Together

Category
Data Tooling
What it does:
Code for preparing large datasets for training LLMs
Open Source:
No
Read more →

Replicate

by

Category
Model Deployment and Hosting
What it does:
A tool that lets you run machine learning models with a few lines of code, without needing to understand how machine learning works. It also allows you to deploy machine learning models at scale, using open-source models off the shelf, or your own custom, private models
Open Source:
No
Read more →

ShareGPT

by

Category
Browser Extension
What it does:
Share your ChatGPT conversations with one click.
Open Source:
No
Read more →