MLOps инструменты

Large language models for various NLP tasks

Paid

A fully managed service that provides every developer and data scientist with the ability to build, train, and deploy machine learning models quickly.

Paid

A fully managed service that provides every developer and data scientist with the ability to build, train, and deploy machine learning models quickly.

Paid

Make it easy to coordinate the components of distributed applications and microservices using visual workflows.

Paid

Aim is an easy-to-use and performant open-source experiment tracker

Open Source

European AI models for language and multimodal tasks

Paid

Open-source Python library focused on outlier, adversarial and drift detection

Open Source

Built-in data labeling workflows with AWS integration

Paid Service

Fully managed service for managing and deploying machine learning models.

Paid

Large language model API with advanced reasoning capabilities

Paid

Fully utilize every GPU with RayTurbo / Govern sprawling AI usage

ServicePaid

Serverless AI inference and fine-tuning platform

PaidFreemium

Airflow is a platform to programmatically author, schedule, and monitor workflows.

Open Source

Apache NiFi is a software project that provides an easy to use, powerful, and reliable system to process and distribute data.

Open Source

Enterprise data annotation platform with crowd workforce

Paid Service

Argo Workflows is an open source container-native workflow engine for Kubernetes.

Open Source

AI observability and LLM evaluation platform designed to help AI engineers and developers surface model issues quicker

Open SourceFreemium

ML observability platform for monitoring model performance and detecting drift

Paid

API for speech recognition and audio intelligence

PaidFreemium

Open-source framework that enables the creation of complex AI workflows through multi-agent conversations

FreemiumOpen Source

Cloud-based data integration service that orchestrates and automates the movement and transformation of data.

Paid

A cloud-based environment to develop, train, test, deploy, manage, and track machine learning models.

Paid

A cloud-based environment to develop, train, test, deploy, manage, and track machine learning models.

Paid

Cloud-based service for managing the lifecycle of machine learning models.

Paid

Serverless GPU infrastructure for AI model deployment

Paid

The easiest open-source way to build Serverless autonomous AI agents with memory and tools.

Freemium

Platform for agentic process automation

Freemium

Платформа для упаковки и развертывания моделей ML

Open SourceFramework

Fast inference engine for Transformer models

Open SourceLLM

Powerful and efficient Computer Vision Annotation Tool for image and video annotation

Open SourceService

AI platform for computer vision, NLP, and audio analysis

PaidFreemium

Is a ML/DL development and production suite

Open Source

Open source platform for MLOps with experiment tracking and model registry

Open Source

Виртуальные машины c SLA 99,9% от 0 рублей в месяц

V100H100

Cуперкомпьютеры и ML на базе российского решения

Paid

Framework for modular, production-ready RAG systems

Open Source

NLP models for text generation, classification, and more

PaidFreemium

Comet provides an end-to-end model evaluation platform

Paid

A platform for integrating AI agents with over 150 external tools to enhance functionality.

Freemium

Conductor is a microservices orchestration engine developed by Netflix.

Open Source

Platform for Multi AI Agents System for complex task execution.

FreemiumOpen Source

Open source version control system for machine learning projects

Open Source

Open source version control system for machine learning projects

Open Source

Dagster is a data orchestrator for machine learning, analytics, and ETL.

Open Source

Metadata platform for the modern data stack

Open Source

DataRobot is a paid automated machine learning platform that provides monitoring and management features.

Paid

Unified analytics platform with versioning and collaboration features

Paid

Движок для эффективного запуска разреженных нейронных сетей

Open Source

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Open SourceLLM

Open-source library for testing and validating machine learning models and data

Open SourcePaid

ML model validation and monitoring

Open SourceFreemium

AI speech recognition and audio intelligence platform

PaidFreemium

Infrastructure for running AI models with pay-per-use pricing

Paid

Open-source storage layer that brings reliability to data lakes

Open Source

Training data platform with version control and workflow automation

Open SourceService

Doccano is an open-source annotation tool for text data, supporting various formats like text classification, sequence labeling, and more.

Open SourceService

SQL database that you can fork, clone, branch, merge, push and pull

Open Source

AI voice cloning and text-to-speech API

PaidFreemium

All-in-one platform to create vertical AI agents with private data and knowledge.

Freemium

Evidently is ​​an open-source ML and LLM observability framework

Open SourcePaid

One Platform for LLM and ML Observability

Paid

Optimizing GPU memory management & IO transmission

Open Source

LLM response caching

Open Source

API for AI image generation and editing

PaidFreemium

Git extension for versioning large files

Open SourceVersion Control

Model registry allows data scientists and developers to manage their machine learning models

Open Source

A suite of machine learning tools and services provided by Google Cloud.

Paid

A suite of machine learning tools and services provided by Google Cloud.

Paid

Managed service for deploying, managing, and governing ML models in a central repository.

Paid

Data labeling service integrated with Google Cloud

Paid Service

Graph-based RAG system using knowledge graphs

Open Source

Prompt orchestration

Open Source

AI orchestration framework to build customizable, production-ready LLM applications

Open SourceFreemium

Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground

Open SourceFreemium

Hive Data provides data labeling services with a focus on scalability and quality assurance for machine learning projects.

PaidService

Datasets is a library for easily accessing and sharing datasets

Open SourceFramework

Prompt management platform

Freemium

Гибкая и удобная инфраструктура для эффективного решения сложных задач на GPU

V100A100H1004090

Easily deploy Transformers, Diffusers or any model on dedicated, fully managed infrastructure

ServicePaid

MLOps platform for deploying and scaling AI models

Paid

Платформа для развертывания моделей ML в Kubernetes

Open SourceFramework

Machine Learning Toolkit for Kubernetes

Open Source

Model registry provides a central repository for model developers to store and manage models

Open Source

Kubeflow Pipelines is a platform for building and deploying portable, scalable machine learning workflows.

Open Source

Framework for enterprise-ready RAG pipelines

Open Source

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Open SourceService

Graphical image annotation tool for object detection

Open Source

Training data platform for computer vision, text, and more

Paid Service

Git-like version control for data lakes

Open SourceData Management

Vector database

Open Source

A framework for building and deploying applications powered by large language models (LLMs).

Freemium

A framework for building conversational AI agents.

Freemium

Langbase helps developers ship composable AI agent pipes with hyper-personalized memory (RAG).

Freemium

Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets

Open SourceFreemium

AI image generation platform with custom model training

PaidFreemium

Letta (formerly MemGPT) is a framework for creating LLM services with memory

Open Source

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework

Open SourceLLM

Luigi is a Python package that helps you build complex pipelines of batch jobs.

Open Source

Universal LLM Deployment Engine with ML Compilation

Open SourceLLM

Open source platform for the machine learning lifecycle

Open Source

Open source platform for the machine learning lifecycle

Open Source

Free-to-use web platform for image annotation

Open Source

Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems

Open Source

AI image generation with high artistic quality

Paid

Voice AI platform for creating low-latency, natural-sounding voice agents

Freemium

Vector database

Open Source

Custom versioning of Machine Learning models

Open Source

Open source system for managing machine learning models

Open Source

The experiment tracker for foundation model training

PaidFreemium

Metadata store for MLOps with model registry and versioning capabilities

Commercial

A no-code platform for building and integrating custom AI agents to automate workflows.

Freemium

NLP API for various language tasks

PaidFreemium

Движок вывода для оптимизированного запуска ONNX моделей

Open SourceOptimization

Access to GPT models and DALL-E for various AI tasks

Paid

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Open SourceLLM

🦾 OpenLLM: Self-Hosting LLMs Made Easy

Open SourceLLM

A unified interface for LLMs

PaidFreemium

Инструментарий Intel для оптимизации глубокого обучения

Open SourceOptimization

Data-Centric Pipelines and Data Versioning

PaidOpen Source

Data versioning and model registry platform for MLOps

CommercialOpen Source

Access to various LLMs through unified API

Paid

Vector database

Open Source

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

PaidOpen Source

LLM gateway with monitoring and analytics

Open SourceFreemium

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

PaidOpen Source

Annotation tool from Explosion AI with active learning capabilities

Paid Service

Prodigy is an annotation tool for creating training data for machine learning models, focusing on efficiency and ease of use.

PaidService

Prompt versioning and management

FreemiumOpen Source

Prompt testing and evaluation

Freemium

Vector database

Open Source

Version control for data science with package management

Open SourcePaid

Engine for RAG using deep document understanding

Open Source

Фреймворк для масштабируемого обслуживания моделей машинного обучения

Open SourceFramework

Run and fine-tune open-source models

PaidFreemium

Powerful & cost-effective GPUs built to support any workload

PaidService

Powerful & cost-effective GPUs built to support any workload

H1004090A100

AI tools for creative professionals, including video generation

PaidFreemium

Open-source AI infrastructure for RAG applications

Open Source

Sacred is a tool to help you configure, organize, log and reproduce experiments

Open Source

Sacred is a tool to help you configure, organize, log and reproduce experiments

Open Source

AWS service for managing machine learning models, offering a comprehensive MLOps solution

Paid

Enterprise platform for data annotation and labeling with API access

Paid Service

ScaleNLP offers specialized data annotation services for natural language processing tasks, ensuring high-quality labeled datasets.

PaidService

An MLOps framework to deploy, monitor and manage thousands of production machine learning models

Open SourceFramework

An inference server, including support for multiple frameworks, multi-model serving and more

Open SourceFramework

Аренда серверов с GPU

20804090A100

Snorkel is a data programming framework that allows users to create, manage, and label training data through weak supervision.

PaidService

Access to Stable Diffusion models for image generation

PaidFreemium

LLM-powered knowledge curation system

Open Source

SuperAnnotate is a data annotation platform that offers tools for image, video, and text annotation, with a focus on collaboration.

PaidService

Platform for computer vision development from data labeling to model deployment

FreemiumService

AppStore for AI Agents

Freemium

AppStore for AI Agents

Freemium

Visualization Toolkit

Open Source

An open-source library for numerical computation and machine learning.

Open Source

An open-source library for numerical computation and machine learning.

Open Source

Система для обслуживания моделей машинного обучения TensorFlow

Open Source

A TensorRT Toolbox for Optimized Large Language Model Inference

Open SourceLLM

Titan Takeoff is a state-of-the-art inference server designed for self-hosting

ServiceOpen Source

Platform for running and fine-tuning open-source AI models

Paid

Фреймворк для развертывания моделей PyTorch в продакшене

Open Source

Сервер для масштабируемого обслуживания моделей машинного обучения

Open SourceFramework

Data preprocessing for AI

Paid

Simple and standalone manual annotation software for image, audio and video

Open Source

MLOps platform with model registry and versioning

Commercial

A Cloud Native Batch System (Project under CNCF)

Open Source

Collaborative model tracking and experiment management platform

Paid

ML platform for tracking experiments and managing models with advanced registry features

Commercial

Weights & Biases is the AI developer platform for training and fine-tuning

PaidFreemium

AI observability platform for monitoring, detecting, and resolving data and ML issues

Paid

Open-source data and ML monitoring

Open SourceFreemium

AI toolkit that helps cross-functional teams build reliable high quality agents

Freemium

Сервис предоставляет масштабируемые вычислительные

V100A100

Сервис для ML-разработки с удобным интерфейсом

Paid

Zegami combines image data with machine learning, allowing users to annotate and visualize data effectively.

PaidService

RAG based and conversational knowledge base tool built with TiDB

Open Source

Inference of Meta's LLaMA model (and others) in pure C/C++

Open SourceLLM

Фреймворк для развертывания LLM моделей с оптимизацией

Open SourceLLM

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

Open SourceFreemium