AI Training Cost Calculator

Enter the number of parameters in billions (e.g., 100 for 100 billion)
Enter the number of tokens in trillions (e.g., 1.5 for 1.5 trillion)

Model Comparisons

Deepseek V3

Active Parameters: 38B active params

Tokens: 15T tokens

Training Costs:

H100: $4,750,000 (2,375,000 hours)

B200: $1,900,000 (633,333 hours)

Original GPT-4 (Trained in 2022)

Active Parameters: 280B active params

Tokens: ~10.5T tokens

Training Costs:

H100: $30,333,333 (15,166,667 hours)

B200: $12,133,333 (4,044,444 hours)

Llama-3.1-405B

Active Parameters: 405B active params

Tokens: 15T tokens

Training Costs:

H100: $50,625,000 (25,312,500 hours)

B200: $20,250,000 (6,750,000 hours)

GPT-4o 2024(Rough Estimate)

Active Parameters: ~120B active params

Tokens: ~15T tokens

Training Costs:

H100: $15,0000,000 (7,500,000 hours)

B200: $6,000,000 (2,000,000 hours)