There's no option to keep the existing Windows installation when installing ESXi natively on the same host. The option you mentioned - convert the Windows server to a VM and convert it back to the ESXi host once installed - would be a way to go.
André