🏋ïļ

Training Cost Estimator

Estimate training costs based on model size and training data.

Training Cost Estimator

Estimated Results

Compute (FLOPs) 4.20e+23
GPU Hours (H100) 58,929
Estimated Cost $176,788

Assumptions

  • FLOPs = 6 x Parameters x Tokens (Chinchilla scaling)
  • GPU: NVIDIA H100 at 1,979 TFLOPS (FP8)
  • Cloud price: ~$3/hour per H100

Disclaimer: This is a simplified estimate. Actual training costs depend on many factors including model architecture, optimization strategy, hardware utilization, and data quality.