The C64 ROM loader is notorious for being slow. Think it does a load and verify cycle every time.
The 48K ZX Spectrum had a speedy ROM loader. You could basically (sic) LOAD/SAVE the full available RAM in less than 5 mins without doing anything fancy. Later with 128k software some companies created software fastloads to get them to load in a more timely manner.