310491a557
- Updated python_coding_microproject.csv to use NVIDIA NIM Kimi K2 - Updated kali_linux_shell_simulator.csv to use NVIDIA NIM Kimi K2 - Made more general-purpose (flexible targets, expanded tools) - Added nemotron-mini-agent.csv for fast local inference via Ollama - Added nemotron-agent.csv for advanced reasoning via Ollama - Added wiki page: Projects for NVIDIA NIMs and Nemotron
GT AI OS Community Edition
A self-hosted AI platform for teams and small businesses. Build and deploy custom AI agents with full data privacy and bring-your-own inference via NVIDIA NIM, Ollama, Groq, vLLM, and more.
Supported Platforms
| Platform | Host Architecture | Status |
|---|---|---|
| Ubuntu Linux 24.04 | x86_64 | Supported |
| NVIDIA DGX OS 7 (Optimized for Grace Blackwell Architecture) | ARM64 | Supported |
| macOS (Apple Silicon M1+) | ARM64 | Supported |
Features
- AI Agent Builder - Create custom AI agents with your own instructions
- Local Model Support - Run local AI models with Ollama (completely offline)
- Document Processing - Upload documents and ask questions about them
- Team Management - Create teams and control who can access what
- Usage Tracking - See how your AI agents are being used
Documentation
| Topic | Description |
|---|---|
| Installation | Detailed setup instructions |
| Updating | Keep GT AI OS up to date |
| NVIDIA NIM Setup | Enterprise GPU-accelerated inference |
| Ollama Setup | Set up local AI models |
| Groq Cloud Setup | Ultra-fast cloud inference |
| Cloudflare Tunnel | Access GT AI OS from anywhere |
| Troubleshooting | Common issues and solutions |
Community vs Enterprise
| Feature | Community (Free) | Enterprise (Paid) |
|---|---|---|
| Users | Up to 50 users | User licenses per seat |
| Support | GitHub Issues | Dedicated human support |
| Billing & Reports | Not included | Full financial tracking |
| Pro Agents | Not included | Pre-built professional agents |
| AI Inference | BYO/DIY | Fully Managed |
| Setup | DIY | Fully Managed |
| Uptime Guarantee | Self | 99.99% uptime SLA |
Want Enterprise? Contact GT Edge AI
Architecture
┌────────────────────────────────────────────────────────────────┐
│ GT AI OS │
├──────────────────┬──────────────────────┬──────────────────────┤
│ Control Panel │ Tenant App │ Resource Cluster │
│ (Admin UI) │ (User UI) │(AI Inference Routing)│
├──────────────────┴──────────────────────┴──────────────────────┤
│ PostgreSQL │
│ Control DB │ Tenant DB │
└────────────────────────────────────────────────────────────────┘
Contributing
Found a bug? Have an idea? Open an issue: https://github.com/GT-Edge-AI-Internal/gt-ai-os-community/issues
See CONTRIBUTING.md for details.
Security
Found a security issue? Report via our contact form
See SECURITY.md for our security policy.
License
Apache License 2.0 - See LICENSE
GT AI OS Community Edition | Made by GT Edge AI