Hi Rafi,
When you use the bundled version for Server deployments then you need to set it up as a service yourself. Therefor it’s easier to use the EnterpriseDB (EDB) installer (which is the other option) that does all that for you.
Also the EDB installer sets PostgreSQL up in a very secure manner (runs under postgres system user, etc.).