This issue may occur due to a prior partition table present in the local datastore.
To resolve this issue, use a Linux boot CD of your choice. Format the local datastore and create a partition table.
After recreating the partition table, retry the ESXi 5.x installation.