From Dev.to
I ran the same QLoRA 7B job 8 times on Vast.ai RTX 4090s. The bill went from $0.19 to $0.81. Here is what moved it.
When people compare a rented RTX 4090 with a cloud A100, they multiply the hourly GPU price by the training time. I wanted to see The job: Qwen2.5-7B-Instruct, 4-bit QLoRA, yahma/alpaca-cleaned, 300 s...
