Native Linux

AMD Instinct MI300X

AMD · GPU · LynxBenchAI 26Q3 Index, recorded 2026-10-16

On the LynxBenchAI 26Q3 Index, the AMD Instinct MI300X ranks 5 of 44 devices overall with a GT of 986.72 (Training 727.23, rank 5; Inference 1304.04, rank 6; Compute 1023.28, rank 1); overall it scores 1.05x the NVIDIA H100 80GB HBM3 and 2.19x the NVIDIA GeForce RTX 4090.

CDNA 3 architecture · 192 GB HBM3 · OAM · launched 2023 (AMD specifications)

986.72
GT · rank #5 of 44

Where It Sits on the LynxBenchAI 26Q3 Index

Rank among all 44 devices; further right is higher.

  • Overall (GT)rank 5 of 44
  • Trainingrank 5 of 44
  • Inferencerank 6 of 44
  • Computerank 1 of 44
The AMD Instinct MI300X's score divided by the reference device's score
Compared withOverallTrainingInferenceCompute
NVIDIA H100 80GB HBM31.05x1.03x0.78x2.10x
NVIDIA GeForce RTX 40902.19x2.16x1.98x2.78x
Nearest devices on each score, with this device's score divided by theirs
ScoreNext aboveRatioNext belowRatio
Training NVIDIA H2000.90x NVIDIA H100 80GB HBM31.03x
Inference NVIDIA H100 80GB HBM30.78x NVIDIA RTX PRO 6000 Blackwell Server Edition1.09x
Compute first NVIDIA B300 SXM6 AC1.64x
  • Among the top quarter of the LynxBenchAI 26Q3 Index on Training (rank 5 of 44).
  • Among the top quarter of the LynxBenchAI 26Q3 Index on Inference (rank 6 of 44).
  • Among the top quarter of the LynxBenchAI 26Q3 Index on Compute (rank 1 of 44).

training

727.23 category score
Model Precision Sustained
MobileNetV3 FP32 275.35
MobileNetV3 BF16 116.95
Flan-T5 Small FP32 1482.85
Flan-T5 Small BF16 862.82
DistilGPT2 FP32 1571.28
DistilGPT2 BF16 911.36
DistilBERT FP32 1583.23
DistilBERT BF16 1524.76
GraphGPS (Peptides) FP32 426.90
GraphGPS (Peptides) BF16 313.78

inference

1304.04 category score
Model Precision Sustained
MobileNetV3 FP16 733.83
MobileNetV3 INT8 515.38
Flan-T5 Small FP16 3458.97
Flan-T5 Small INT8 1070.69
Flan-T5 Small FP8 1719.40
DistilGPT2 FP16 3318.55
DistilGPT2 INT8 1084.29
DistilGPT2 FP8 1689.36
DistilBERT FP16 2816.12
DistilBERT INT8 946.39
DistilBERT FP8 1524.79
GraphGPS (Peptides) FP16 1139.44
GraphGPS (Peptides) INT8 536.07
GraphGPS (Peptides) FP8 582.67

compute

1023.28 category score
Model Precision Sustained
Dense MatMul FP32 1095.58
Dense MatMul FP16 1238.82
Dense MatMul BF16 1227.87
Dense MatMul FP64 432.02
Sparse MatMul FP32 1322.97
Sparse MatMul FP64 774.09

LynxBenchAI 26Q3 Index · GT = LynxBenchAI Global Score. Every precision result is sustained throughput under a declared, bounded optimisation budget — no collapsed single number below the category level.

Compare With

Each figure is the first device's overall score divided by the second's.

All comparisons →

How to Read These Results

A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).

Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.

LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).

Questions

How fast is the AMD Instinct MI300X for AI workloads?
On the LynxBenchAI 26Q3 Index, the AMD Instinct MI300X ranks 5 of 44 devices overall with a GT of 986.72 (Training 727.23, rank 5; Inference 1304.04, rank 6; Compute 1023.28, rank 1); overall it scores 1.05x the NVIDIA H100 80GB HBM3 and 2.19x the NVIDIA GeForce RTX 4090.
How does the AMD Instinct MI300X compare with the NVIDIA H100 80GB HBM3?
On the LynxBenchAI 26Q3 Index, the AMD Instinct MI300X scores 1.05x the NVIDIA H100 80GB HBM3 overall: Training 1.03x, Inference 0.78x, Compute 2.10x.
How does the AMD Instinct MI300X compare with the NVIDIA GeForce RTX 4090?
On the LynxBenchAI 26Q3 Index, the AMD Instinct MI300X scores 2.19x the NVIDIA GeForce RTX 4090 overall: Training 2.16x, Inference 1.98x, Compute 2.78x.
What does this result tell me about my own PyTorch model?
Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Measure your own AMD Instinct MI300X: pip install lynxbench-ai · Install guide →

← Back to the leaderboard

The Personal Edition submits your benchmark results to TechnoLynx's servers as part of participating in the public leaderboard. If that isn't acceptable for your use case, contact TechnoLynx about Press, Pro, or Enterprise licenses.

Get Started