Look into Backblaze B2. Use rclone, or another backup tool that has S3 compatibility (though B2 API has some additional bells and whistles).

With rclone, you can also have a step to seamlessly encrypt the contents on the client side before sending to an external provider like B2.

I chose B2 because it is the most affordable option, but rclone supports many backends.