Native Linux

NVIDIA GeForce RTX 4060

NVIDIA · GPU · LynxBenchAI 26Q3 Index, recorded 2026-10-16

On the LynxBenchAI 26Q3 Index, the NVIDIA GeForce RTX 4060 ranks 34 of 44 devices overall with a GT of 106.26 (Training 81.93, rank 34; Inference 154.96, rank 34; Compute 82.26, rank 30); overall it scores 0.11x the NVIDIA H100 80GB HBM3 and 0.24x the NVIDIA GeForce RTX 4090.

Ada Lovelace architecture · 8 GB GDDR6 · PCIe card (NVIDIA specifications)

106.26
GT · rank #34 of 44

Where It Sits on the LynxBenchAI 26Q3 Index

Rank among all 44 devices; further right is higher.

  • Overall (GT)rank 34 of 44
  • Trainingrank 34 of 44
  • Inferencerank 34 of 44
  • Computerank 30 of 44
The NVIDIA GeForce RTX 4060's score divided by the reference device's score
Compared withOverallTrainingInferenceCompute
NVIDIA H100 80GB HBM30.11x0.12x0.09x0.17x
NVIDIA GeForce RTX 40900.24x0.24x0.24x0.22x
Nearest devices on each score, with this device's score divided by theirs
ScoreNext aboveRatioNext belowRatio
Training DGX Spark (NVIDIA GB10)0.89x NVIDIA RTX 2000 Ada Generation Laptop GPU1.34x
Inference NVIDIA GeForce RTX 4060 Ti0.90x AMD Radeon RX 9060 XT1.26x
Compute DGX Spark (NVIDIA GB10)0.97x NVIDIA GeForce RTX 50701.02x

training

81.93 category score
Model Precision Sustained
MobileNetV3 FP32 113.22
MobileNetV3 BF16 84.66
Flan-T5 Small FP32 120.25
Flan-T5 Small BF16 64.74
DistilGPT2 FP32 98.36
DistilGPT2 BF16 63.43
DistilBERT FP32 132.29
DistilBERT BF16 105.77
GraphGPS (Peptides) FP32 39.80
GraphGPS (Peptides) BF16 40.90

inference

154.96 category score
Model Precision Sustained
MobileNetV3 FP16 365.84
MobileNetV3 INT8 100.37
Flan-T5 Small FP16 304.88
Flan-T5 Small INT8 169.75
Flan-T5 Small FP8 205.70
DistilGPT2 FP16 200.54
DistilGPT2 INT8 128.30
DistilGPT2 FP8 125.43
DistilBERT FP16 226.96
DistilBERT INT8 136.64
DistilBERT FP8 142.44
GraphGPS (Peptides) FP16 92.03
GraphGPS (Peptides) INT8 46.56
GraphGPS (Peptides) FP8 47.11

compute

82.26 category score
Model Precision Sustained
Dense MatMul FP32 50.46
Dense MatMul FP16 59.51
Dense MatMul BF16 60.09
Dense MatMul FP64 1.62
Sparse MatMul FP32 155.55
Sparse MatMul FP64 146.47

LynxBenchAI 26Q3 Index · GT = LynxBenchAI Global Score. Every precision result is sustained throughput under a declared, bounded optimisation budget — no collapsed single number below the category level.

Compare With

Each figure is the first device's overall score divided by the second's.

All comparisons →

How to Read These Results

A LynxBenchAI score is sustained throughput on a fixed catalogue of PyTorch models, measured after a warm-up at a batch size raised until throughput stops improving, so it is what the machine holds under load, not its best instant. Training, Inference and Compute are three separate scores; GT combines them (Training and Inference weigh 0.4 each, Compute 0.2).

Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Scores compare only within one Index: the 26Q3 Index fixes the models, precisions, correctness thresholds and scoring, and a later Index may change them. Each test is one timed window, the scores have no 0-100 scale, and a precision a device cannot run scores zero rather than being skipped.

LynxBenchAI is built by TechnoLynx, which the European Commission engaged as an independent expert advisor on AI performance and benchmarking for AI Gigafactories under the EuroHPC Joint Undertaking (case study).

Questions

How fast is the NVIDIA GeForce RTX 4060 for AI workloads?
On the LynxBenchAI 26Q3 Index, the NVIDIA GeForce RTX 4060 ranks 34 of 44 devices overall with a GT of 106.26 (Training 81.93, rank 34; Inference 154.96, rank 34; Compute 82.26, rank 30); overall it scores 0.11x the NVIDIA H100 80GB HBM3 and 0.24x the NVIDIA GeForce RTX 4090.
How does the NVIDIA GeForce RTX 4060 compare with the NVIDIA H100 80GB HBM3?
On the LynxBenchAI 26Q3 Index, the NVIDIA GeForce RTX 4060 scores 0.11x the NVIDIA H100 80GB HBM3 overall: Training 0.12x, Inference 0.09x, Compute 0.17x.
How does the NVIDIA GeForce RTX 4060 compare with the NVIDIA GeForce RTX 4090?
On the LynxBenchAI 26Q3 Index, the NVIDIA GeForce RTX 4060 scores 0.24x the NVIDIA GeForce RTX 4090 overall: Training 0.24x, Inference 0.24x, Compute 0.22x.
What does this result tell me about my own PyTorch model?
Every run uses the stock, publicly released PyTorch stack, so a result is broadly indicative of the out-of-the-box PyTorch experience on that hardware, and so of custom PyTorch models too. It does not run your own model, and it is not a vendor-tuned peak like an MLPerf submission.

Measure your own NVIDIA GeForce RTX 4060: pip install lynxbench-ai · Install guide →

← Back to the leaderboard

The Personal Edition submits your benchmark results to TechnoLynx's servers as part of participating in the public leaderboard. If that isn't acceptable for your use case, contact TechnoLynx about Press, Pro, or Enterprise licenses.

Get Started