Model Infra Landscape 2026

Routing · serving · training · data · compute

ANT OPEN SOURCE57 projects · Jun OpenRank weighted

Access & Serving

Closest to model workloads

Model API gateways

5

Serving / Deploy

3

Serving / Inference

8

Model Training

Post-train and pre-train systems

Post-Train / Reinforcement learning

4

Post-Train / Supervised fine-tuning

3

Pre-Train / Framework & parallel

6

Pre-Train / Compiler & accelerator

8

Pre-Train / Evaluation & observability

2

Pre-Train / Robotics infra

2

Data & Compute

Foundation for model development

Data / Labeling

2

Data / Integration

3

Data / Governance

7

Compute & scheduling

4