After enabling the share to anyone, there’s a trick to make it to download directly.
Try this: https://drive.google.com/uc?export=download&id=DRIVE_FILE_ID
More detail: Simple URL Tricks for Google Drive You Should Know
2 Likes