back to home

mage-ai / mage-ai

πŸ§™ Build, run, and manage data pipelines for integrating and transforming data.

8,652 stars
910 forks
547 issues
PythonTypeScriptHTML

AI Architecture Analysis

This repository is indexed by RepoMind. By analyzing mage-ai/mage-ai in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.

Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.

Embed this Badge

Showcase RepoMind's analysis directly in your repository's README.

[![Analyzed by RepoMind](https://img.shields.io/badge/Analyzed%20by-RepoMind-4F46E5?style=for-the-badge)](https://repomind-ai.vercel.app/repo/mage-ai/mage-ai)
Preview:Analyzed by RepoMind

Repository Summary (README)

Preview

Mage OSS

Build modern data pipelines locally β€” fast, visual, and production-ready.

<br />

Mage OSS is a self-hosted development environment designed to help teams create production-grade data pipelines with confidence.

Ideal for automating ETL tasks, architecting data flow, or orchestrating transformations β€” all in a fast, notebook-style interface powered by modular code.

When it’s time to scale, Mage Pro β€” our core platform β€” unlocks enterprise orchestration, collaboration, and AI-powered workflows.

<br />

<a href="https://mage.ai"><img alt="Mage AI GitHub repo stars" src="https://img.shields.io/github/stars/mage-ai/mage-ai?style=for-the-badge&logo=github&labelColor=000000&logoColor=FFFFFF&label=stars&color=0500ff" /></a> <a href="https://hub.docker.com/r/mageai/mageai"><img alt="Mage AI Docker downloads" src="https://img.shields.io/docker/pulls/mageai/mageai?style=for-the-badge&logo=docker&labelColor=000000&logoColor=FFFFFF&label=pulls&color=6A35FF" /></a> <a href="https://github.com/mage-ai/mage-ai/blob/master/LICENSE"><img alt="Mage AI license" src="https://img.shields.io/github/license/mage-ai/mage-ai?style=for-the-badge&logo=codeigniter&labelColor=000000&logoColor=FFFFFF&label=license&color=FFCC19" /></a> <a href="https://www.mage.ai/chat"><img alt="Join the Mage AI community" src="https://img.shields.io/badge/Join%20the%20community-black.svg?style=for-the-badge&logo=lightning&labelColor=000000&logoColor=FFFFFF&label=&color=DD55FF&logoWidth=20" /></a>

<br />

What you can do with Mage OSS

  • Build pipelines locally with Python, SQL, or R in a modular notebook-style UI

  • Run jobs manually or on a schedule (cron supported)

  • Connect to databases, APIs, and cloud storage with prebuilt connectors

  • Debug visually with logs, live previews, and step-by-step execution

  • Set up quickly with Docker, pip, or conda β€” no cloud account required

  • Your go-to workspace for local pipeline development β€” fully in your control.

<img width="100%" alt="mage" src="https://github.com/user-attachments/assets/75992872-20a6-4120-8bf0-9c22a3d66450" />

<br /><br />

Start local. Scale when you're ready.

Use Mage OSS to build and run pipelines on your machine. When you're ready for advanced tooling, performance, and AI-assisted productivity, Mage Pro is just one click away.

Try Mage Pro free β†’

<br />

Quickstart

Install using Docker (recommended):

docker pull mageai/mageai:latest

Or with pip:

pip install mage-ai

Or with conda:

conda install -c conda-forge mage-ai

Full setup guide and docs: docs.mage.ai

<br />

Core Features

FeatureDescription
Modular pipelinesBuild pipelines block-by-block using Python, SQL, or R
Notebook UIInteractive editor for writing and documenting logic
Data integrationsPrebuilt connectors to databases, APIs, and cloud storage
SchedulingTrigger pipelines manually or on a schedule
Visual debuggingStep-by-step logs, data previews, and error handling
dbt supportBuild and run dbt models directly inside Mage
<br />

Example Use Cases

  • Move data from Google Sheets to Snowflake with a Python transform
  • Schedule a daily SQL pipeline to clean and aggregate product data
  • Develop dbt models in a visual notebook-style interface
  • Run simple ETL/ELT jobs locally with full transparency
<br />

Documentation

Looking for how-to guides, examples, or advanced configuration?

Explore our full documentation at docs.mage.ai.

<br />

Contributing

We welcome contributions of all kinds β€” bug fixes, docs, new features, or community examples.

Start with our contributing guide, check out open issues, or suggest improvements.

<br />

Ready to scale? Mage Pro has you covered.

Mage Pro is a powered-up platform built for teams. It adds everything you need for production pipelines, at scale.

  • Magical AI-assisted development and debugging
  • Multi-environment orchestration
  • Role-based access control
  • Real-time monitoring & alerts
  • Powerful CI/CD & version control
  • Powerful enterprise features
  • Available fully managed, hybrid, or on-premises

Try Mage Pro free β†’