git lfs has to be able to checkout previous versions just like git, so all previously committed lfs files are stored. If you do not care about previous versions maybe you would prefer Syncthing?
Binary files do not benefit from diff compression so it stores the full file, maybe compresses it individually but a .blend is already compressed.