This utility is portable, which means that you are no longer required to go through the installation process and no leftovers will remain on the HDD after its removal.
Windows Update Blocker is a freeware that helps you to completely disable or enable Automatic Updates on your Windows system, with just a click of the button. You would then have to enable the service again whenever you want the operating system to check for updates (It does not look so easy). This requires that you open the Services manager, locate the service and change its startup parameter and status. If you want control over the update process you can disable the Windows Update service.
This new feature is actually pretty convenient for most users. Windows 10 offers less UI control over the updating behavior of the operating system than previous versions of Windows, There is no option to turn off Windows Updates using the Control Panel or Settings app in Windows 10, it checks for updates automatically and install any updates they find, whether you like it or not.