It's okay to do this in some cases, but in general, you should set up CloudFront with signed URLs to better control who can access the uploaded files.
Django Storages supports signed URLs out of the box, but I couldn't find good docs on how to set it up. Any leads?