You can set it manually through File Explorer.
I copied these instructions from a website cause I'm on a Mac and couldn't remember the menu names.
1. Click on “My Computer”.
2. Along the type of the screen, after “File”, “Edit”, etc…, click on “Tools”.
3. Click on “Folder Options”.
4. A new window with numerous tabs along the top will open. Click on the “File Types” tab.
5. You’ll see a list of all the different kinds of files on your computer. Click once on the type of files whose icon you wish to change.
6. Click the “Advanced” button at the bottom of the window (above “Ok” and “Cancel”).
7. A new window will open up. Click on your desired icon, and press “Ok”.
8. Click “Ok” again, to close the Folder Options window and save your changes.
You can also change it in the registry if you were looking to set this for others users automatically. You'll have to google that one.