Step 4a (diskless): Prepare diskless hosts and the VCF Installer
Diskless hosts have no local storage for VMware Cloud Foundation (VCF). They boot from an Amazon EBS volume, and vSAN and local VMFS datastores aren’t available, so you provide external storage for the management domain. For the instance types that are diskless, see Supported VCF versions and instance types. In this step, you create the external storage, prepare the first host, deploy the VCF Installer appliance, download the VCF software, and add the remaining hosts. In Step 4b (diskless): Create the specification and deploy, you create the deployment specification and deploy VCF.
The example on this page deploys a VCF 9.x management domain on two r7i.metal-24xl hosts. It uses Amazon FSx for OpenZFS as the only storage, with a Network File System (NFS) v3 principal datastore and no vSAN. The VCF Installer accepts a management domain with two hosts and an NFS principal datastore.
You can use Amazon FSx for NetApp ONTAP or Everpure Cloud Dedicated instead. Follow the same sequence, and replace the storage creation and datastore mount steps with the procedures for your storage. For more information, see External storage options for diskless hosts.
Before you begin
Make sure that you meet the following prerequisites.
-
You created an environment with
SELF_DEPLOYEDas the VCF version. For more information, see Step 1: Create the environment. -
You associated the Amazon Elastic VMware Service VLAN subnets with a route table that has a default route to your NAT gateway. The VCF Installer downloads software from the Broadcom online depot, so the VM management VLAN subnet needs outbound internet access. For more information, see Associate VLAN subnets with a route table.
-
You created and verified the forward (A) and reverse (PTR) DNS records for every host and VCF appliance. For more information, see Step 2: Create DNS records.
-
You added the first diskless host, and it is in the
CREATINGorCREATEDstate. For more information, see Step 3: Add hosts. You can add the remaining hosts later in this step, while the VCF software downloads. -
You have a computer or an instance with a web browser that can reach the private IP addresses of your VPC. You use it to open the VMware Host Client and the VCF Installer. For more information, see Launch an instance to reach the VPC.
-
You have a Broadcom account with a VCF entitlement, and you downloaded the VCF Installer Open Virtualization Appliance (OVA) file for your VCF version from the Broadcom Support Portal
. -
You chose the size and type of your external storage. For more information, see External storage options for diskless hosts and Configure FSx for OpenZFS as principal storage for diskless hosts.
The examples on this page and in Step 4b (diskless) use the following values. Replace the example addresses and names with your own values.
| Item | Example value |
|---|---|
|
Instance type |
|
|
VPC CIDR block |
10.10.0.0/16 |
|
Domain name in the DHCP option set |
|
|
Service access subnet |
10.10.200.0/24 |
|
DNS servers in the DHCP option set |
10.10.200.100 and 10.10.200.101 |
|
Host management VLAN subnet |
10.10.0.0/24 |
|
VM management VLAN subnet |
10.10.1.0/24 |
|
Host names and addresses |
|
|
VCF Installer, which becomes SDDC Manager |
|
|
FSx for OpenZFS endpoint IP address |
10.10.200.50 |
DNS records for the example
Create an A record and a PTR record for each name in the following table before you add the first host.
The example uses the evs.example.com zone.
The specification in Step 4b (diskless) gives no IP addresses for the appliances, so the VCF Installer takes them from these records.
For the record requirements and the verification steps, see Step 2: Create DNS records.
| Name | IP address | Use |
|---|---|---|
|
|
10.10.0.11 |
First host |
|
|
10.10.0.12 |
Second host |
|
|
10.10.1.10 |
vCenter Server |
|
|
10.10.1.11 |
NSX Manager virtual IP address |
|
|
10.10.1.12 |
VCF Installer, which becomes SDDC Manager |
|
|
10.10.1.16 |
NSX Manager node |
|
|
10.10.1.19 |
VCF Operations |
|
|
10.10.1.23 |
VCF Operations collector |
|
|
10.10.1.25 |
VCF services platform |
|
|
10.10.1.26 |
VCF services platform |
|
|
10.10.1.27 |
VCF services platform |
|
|
10.10.1.28 |
VCF identity database |
|
|
10.10.1.29 |
VCF license server |
Keep these addresses outside the address ranges in the specification. In the example, the VCF services platform pool uses 10.10.1.100 to 10.10.1.113, and the NFS network range uses 10.10.0.20 to 10.10.0.29.
Create the external storage
Create your external storage while the first host is created.
A host reaches the CREATED state in about 9 minutes, and a file system becomes available in 10 to 25 minutes.
For Amazon FSx for OpenZFS, create a file system and two NFS volumes.
Use vcf-principal as the principal datastore and installer-staging as the temporary datastore for the VCF Installer appliance.
Note the endpoint IP address of the file system.
For instructions, see Configure FSx for OpenZFS as principal storage for diskless hosts.
Prepare the first host
The VCF Installer expects its appliance and the principal datastore on the first host. Diskless hosts have no local storage, so you use the two NFS volumes for both. This procedure replaces the Amazon EBS-backed temporary datastore that hosts with local storage use.
Amazon EVS stores the ESX root password of each host in AWS Secrets Manager.
Each host has its own secret.
To find the secret, search Secrets Manager for the environment ID.
The value of the secret is a plain string and not JSON.
The credentials list of the environment stays empty in Self-deployed mode.
In the VMware Host Client, do the following:
-
Open
https://esx01.evs.example.comin your browser. The certificate is self-signed, so your browser shows a warning. -
Sign in as
rootwith the root password from Secrets Manager. -
Set the
VM Networkport group to the VM management VLAN ID, and keep the host management port group untagged with VLAN ID0. Without this VLAN ID, the VCF Installer appliance can’t reach the VM management VLAN subnet. For how to find the VLAN ID, see VLAN subnets, VLAN IDs, and IP addresses. -
Choose Storage, Datastores, and New datastore, and then choose Mount NFS datastore.
-
Enter the following values, and finish the wizard.
-
For NFS server, enter the endpoint IP address of the file system.
-
For NFS share, enter
/fsx/installer-staging. -
For NFS version, choose NFS 3.
-
For Name, enter a name such as
fsx-staging.
-
-
Repeat the previous two steps to mount the principal datastore with the share
/fsx/vcf-principaland a name such asfsx-principal.
You have mounted both datastores on the first host.
Both datastores mount through the host management VMkernel adapter (vmk0).
Don’t create a separate NFS VMkernel adapter.
Each datastore shows the capacity of the file system, or the volume quota if you set one. For example, a 7,168 GiB file system with no volume quota appears as a 7,168 GiB datastore. The VCF Installer checks this size during validation. For more information, see Size the file system.
The principal datastore must be mounted on the first host before you validate the specification.
Otherwise, the VCF Installer reports that it can’t find the datastore on the host.
For more information, see article 414088
Deploy the VCF Installer
Deploy the VCF Installer OVA file onto the first host, on the staging datastore.
In the VMware Host Client, do the following:
-
Choose Virtual Machines, and then choose Create / Register VM.
-
Choose Deploy a virtual machine from an OVF or OVA file, enter a name such as
sddcm, and select the OVA file. -
Choose the
fsx-stagingdatastore. -
On the deployment options page, map the network to
VM Network, choose thin disk provisioning, and turn on Power on automatically. -
On the additional settings page, enter the appliance values. The following table shows example values.
Setting Example value Host Name
sddcm.evs.example.comNetwork 1 IPv4 Address
10.10.1.12
Network 1 Subnet Mask
255.255.255.0
Network Default IPv4 Gateway
10.10.1.1
DNS Domain Name
evs.example.comDomain Search Path
evs.example.comDomain Name Servers
10.10.200.100,10.10.200.101
NTP Servers
time.aws.comRoot user password and local user password
Your own passwords
-
Finish the wizard.
The VCF Installer appliance becomes SDDC Manager after deployment.
Its IP address and host name must match the SDDC Manager record in your DNS plan.
The passwords must be at least 15 characters long and contain an uppercase letter, a lowercase letter, a digit, and one of the special characters ! % @ $ ^ # ? *.
For more information, see VCF Installer settings for Amazon EVS.
The import of the OVA file onto the NFS datastore takes about 2 minutes.
The VCF Installer web service responds within a few minutes after the appliance starts.
To verify, open https://sddcm.evs.example.com in your browser, and sign in as admin@local with the local user password that you entered in the wizard.
Right after the first start, the inventory page of the VCF Installer can show an error for more than 30 minutes. The error doesn’t stop you from connecting the Broadcom online depot or from validating the specification. Continue with the next section, and don’t wait for the inventory page.
Connect the software depot
The VCF Installer downloads the VCF software from a software depot. Connect the VCF Installer to the Broadcom online depot, and then download the install binaries for your VCF version.
Broadcom online depot
-
Make sure that your Broadcom account has a valid VCF entitlement for the VCF version that you plan to deploy.
-
In the VCF Installer, open the depot settings, and configure the Broadcom online depot with your Broadcom credential. The credential depends on your VCF version.
-
For VCF 9.0, generate a Broadcom download token from the Broadcom Support Portal
, and enter the token in the VCF Installer. -
For VCF 9.1, the VCF Installer authenticates to the Broadcom online depot with an activation code. Generate a software depot ID in the VCF Installer, and register it in the VCF Business Services console. Enter the activation code that the console returns in the VCF Installer, and then review and accept the certificate thumbprint. For more information, see Broadcom knowledge base article 443647
.
-
-
Select the VCF version that you want, and download the install binaries. Downloading the binaries pulls that version of the VCF software into the local depot of the VCF Installer.
-
Wait until every download shows success before you validate the deployment specification.
Connecting to the Broadcom online depot and downloading software requires outbound internet access from the VCF Installer. The NAT gateway in your network foundation provides this access. For more information, see Create a VPC with subnets and route tables.
If the depot connection succeeds but downloads fail with a 403 error, check that your Broadcom entitlement covers the VCF version that you selected.
For more information, see Broadcom knowledge base article 440278
The Amazon EVS custom add-on depot is a different depot. It provides the Amazon EVS add-on for ESX cluster images, and you don’t use it in this step. For more information, see Use the Amazon EVS custom add-on depot.
The catalog lists install and patch images of each component, and several builds of your VCF version. Download the install image of the newest build of each component within the VCF version that you selected. The VCF Installer downloads three bundles at a time.
Add the remaining hosts
Add the other hosts while the downloads run. All hosts in a cluster must use the same instance type and the same ESX version. Before you add each host, verify its DNS records. For more information, see Step 2: Create DNS records.
Diskless hosts support only ESX 9.x versions.
Choose an ESX version that Amazon EVS provides for the instance type and that matches your VCF Installer build.
To list the ESX versions for the instance type, run aws evs get-versions.
For more information, see Supported VCF versions and instance types.
You can add a host by using the Amazon EVS console or the AWS CLI.
Example
Don’t run the create command again for a host that is in the CREATING state.
A host usually reaches CREATED in about 9 minutes.
When a host is CREATED, confirm that its IP address equals the address in its A record.
If a host stays in CREATING, check its DNS records first.
For more information, see Troubleshoot Self-deployed deployments.
You don’t prepare the other hosts. The VCF Installer mounts the datastores on them during deployment. Get the root password of each host from Secrets Manager, because you need it in the specification.
When every host is CREATED and every download shows success, you have prepared the diskless hosts and the VCF Installer.
Next step: Step 4b (diskless): Create the specification and deploy.