Table of Contents

1   Setup Jumpstart Server

1.1   Create jumpstart server environment

In this document we copy the contents of the Solaris DVD or CDROM's to a hard disk. This requires that you creaete the /jumpstart directory in a slice with enough disk space. On my test system my configuration and images took 3GB.

Instead of creating a directory in an existing partition, you can also create a new slice and use /jumpstart as the mountpoint. It's your pick :-)

server # mkdir -p /jumpstart/config server # mkdir -p /jumpstart/x86

1.2   Create jumpstart image

1.2.1   Using DVD

server # cd /cdrom/cdrom0/Solaris_10/Tools server # ./setup_install_server /jumpstart/x86 ... output skipped ...

Copy check command to config directory.

server # cd /jumpstart/image/Solaris_10/Misc/jumpstart_sample server # cp check /jumpstart/config

1.2.2   Using CDROM

Insert CDROM 1

server # cd /cdrom/cdrom0/s0/Solaris_10/Tools server # ./setup_install_server /jumpstart/x86 ... output skipped ...

Insert CDROM 2

server # cd /cdrom/cdrom0/Solaris_10/Tools server # ./add_to_install_server /jumpstart/x86 ... output skipped ...

Insert CDROM 3

server # cd /cdrom/cdrom0/Solaris_10/Tools server # ./add_to_install_server /jumpstart/x86 ... output skipped ...

Insert CDROM 4

server # cd /cdrom/cdrom0/Solaris_10/Tools server # ./add_to_install_server /jumpstart/x86 ... output skipped ...

Insert CDROM 5

server # cd /cdrom/cdrom0/Solaris_10/Tools server # ./add_to_install_server /jumpstart/x86 ... output skipped ...

Copy check command to config directory.

server # cd /jumpstart/image/Solaris_10/Misc/jumpstart_sample server # cp check /jumpstart/config

1.3   Setup NFS server

server # echo "share -F nfs -o ro,anon=0 /jumpstart" >> /etc/dfs/dfstab server # svcadm enable nfs/server server # svcs nfs/server STATE STIME FMRI online 14:52:25 svc:/network/nfs/server:default server # share - /jumpstart ro,anon=0 ""

1.4   Create sysidcfg file

Create the following sysidcfg file with an available editor.

server # cd /jumpstart/config # cat sysidcfg +-------------------- | system_locale=en_US | timezone=MET | name_service=NONE | terminal=dtterm | timeserver=localhost | root_password=WybF.D5GwZnz2 | network_interface=primary{ protocol_ipv6=no } | security_policy=NONE | nfsv4_domain=dynamic | keyboard=workaround:Unknown | display=workaround:Unknown | pointer=workaround:Unknown | monitor=workaround:Unknown

If you are running Solaris 10u2 you can add nfs4_domain=dynamic to your sysidcfg too. If you do, then you don't have to put the touch /a/etc/.NFS4inst_state.domain line in your after script.

1.5   Create profile aka class file

Create the following profile aka. class file, again with an editor.

server # cat std_profile +-------------------------------- | install_type initial_install | system_type standalone | partitioning explicit | filesys any 1024 swap | filesys any free / | filesys any 1024 /var | cluster SUNWCreq

1.6   Create pre script file

The profile above will create a new partition table with 3 slices (/, /var & swap). This will only work if the disk to install to already contains a solaris parition. If the system you want to install Solaris on wasn't installed with Solaris before, changes are great that the disk will not contain a Solaris partition.

You can use fdisk -B /dev/rdsk/<devicename> in a pre script to create the Solaris partition first.

server # cat std_pre +-------------------------- | fdisk -B /dev/rdsk/<devicename>

1.7   Create after script file

Create a script that is run on the client after the installation succeeds. Output of this afterscript is automatically saved on the jumpstart client in /var/sadm/sys/logs/finish.log. Your afterscript should match the following output:

server # cat std_after +------------------------------------ | echo "Begin afterscript" | touch /a/noautoshutdown | # touch /a/etc/.NFS4inst_state.domain | echo "Finish afterscript"

If you are running Solaris 10u2 or later you can skip the touch /a/etc/.NFS4inst_state.domain and place nfs4_domain=dynamic in the sysidcfg file.

1.8   Create rules file

Then we need a rules file with the following contents.

server # cat rules | any - - std_profile std_after server # ./check Validating rules... Validating profile std_profile... The custom JumpStart configuration is ok.

2   Configure TFTP

Depending on you system, the tftp service is already available or not. When the tftp service is not available, you will have to uncomment the service in the /etc/inetd.conf file and run the inetconv command.

server # svcs tftp/udp6 svcs: Pattern 'tftp/udp6' doesn't match any instances STATE STIME FMRI server # grep tftp /etc/inetd.conf # TFTPD - tftp server (primarily used for booting) #tftp dgram udp6 wait root /usr/sbin/in.tftpd in.tftpd -s /tftpboot

Uncomment the "#tftp dgram udp6 ..." line in the /etc/inetd.conf file.

server # grep tftp /etc/inetd.conf # TFTPD - tftp server (primarily used for booting) tftp dgram udp6 wait root /usr/sbin/in.tftpd in.tftpd -s /tftpboot server # inetconv inetconv: Notice: Service manifest for 100235/1 already generated as /var/svc/manifest/network/rpc/100235_1-rpc_ticotsord.xml, skipped inetconv: Notice: Service manifest for 100083/1 already generated as /var/svc/manifest/network/rpc/100083_1-rpc_tcp.xml, skipped inetconv: Notice: Service manifest for 100068/2-5 already generated as /var/svc/manifest/network/rpc/100068_2-5-rpc_udp.xml, skipped tftp -> /var/svc/manifest/network/tftp-udp6.xml Importing tftp-udp6.xml ...Done server # svcs tftp/udp6 STATE STIME FMRI online 12:56:05 svc:/network/tftp/udp6:default

3   Configure Name Service

In this document the DHCP server will fetch the hostname for clients from a name service (/etc/inet/hosts). We therefore have to add the jumpstart client to the /etc/inet/hosts file.

server # echo "10.0.0.100 client1" >> /etc/inet/hosts

4   Setup DHCP server

4.1   Configure DHCP service

server # dhcpconfig -D -r SUNWfiles -p /var/dhcp Created DHCP configuration file. Created dhcptab. Added "Locale" macro to dhcptab. Added server macro to dhcptab - voyin. DHCP server started.

The -r option defines what file type should be used for storing the dhcp tables (network and tab). SUNWfiles creates ascii files. The advantage of SUNWfiles is that these files are easy to debug. SUNbinfiles creates the dhcp tables as binary files. The advantage of binary files is the increase in perfomance for the DHCP server.

4.2   Check DHCP Service

server# svcs "*dhcp*" STATE STIME FMRI online 14:16:10 svc:/network/dhcp-server:default

4.3   Add symbols to DHCP configuration

server # dhtadm -A -s SrootIP4 -d 'Vendor=SUNW.i86pc,2,IP,1,1' server # dhtadm -A -s SrootNM -d 'Vendor=SUNW.i86pc,3,ASCII,1,0' server # dhtadm -A -s SrootPTH -d 'Vendor=SUNW.i86pc,4,ASCII,1,0' server # dhtadm -A -s SinstIP4 -d 'Vendor=SUNW.i86pc,10,IP,1,1' server # dhtadm -A -s SinstNM -d 'Vendor=SUNW.i86pc,11,ASCII,1,0' server # dhtadm -A -s SinstPTH -d 'Vendor=SUNW.i86pc,12,ASCII,1,0' server # dhtadm -A -s SsysidCF -d 'Vendor=SUNW.i86pc,13,ASCII,1,0' server # dhtadm -A -s SjumpsCF -d 'Vendor=SUNW.i86pc,14,ASCII,1,0' server # dhtadm -P Name Type Value ================================================== server Macro :Include=Locale: Timeserv=10.0.0.10:LeaseTim=86400:LeaseNeg: DNSdmain="edu.sun.com":DNSserv=4.2.2.2: Locale Macro :UTCoffst=3600: SjumpsCF Symbol Vendor=SUNW.i86pc,14,ASCII,1,0 SsysidCF Symbol Vendor=SUNW.i86pc,13,ASCII,1,0 SinstPTH Symbol Vendor=SUNW.i86pc,12,ASCII,1,0 SinstNM Symbol Vendor=SUNW.i86pc,11,ASCII,1,0 SinstIP4 Symbol Vendor=SUNW.i86pc,10,IP,1,1 SrootPT Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SrootNM Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SrootIP4 Symbol Vendor=SUNW.i86pc,2,IP,1,1

A complete list of all supported DHCP symbols can be found in /etc/dhcp/inittab.

4.4   Configure jumpstart client

server # cd /jumpstart/x86/Solaris_10/Tools/ server # ./add_install_client -d SUNW.i86pc i86pc copying boot file to /tftpboot/pxegrub.I86PC.Solaris_10-1 If not already configured, enable PXE boot by creating a macro named PXEClient:Arch:00000:UNDI:002001 with: Boot server IP (BootSrvA) : 10.0.0.10 Boot file (BootFile) : SUNW.i86pc server # ls /tftpboot I86PC.Solaris_10-1 nbp.SUNW.i86pc SUNW.i86pc pxegrub.I86PC.Solaris_10-1 boot rm.SUNW.i86pc server # mount -p | grep boot /jumpstart/x86/boot - /tftpboot/I86PC.Solaris_10-1 lofs - no ro

4.5   Enable PXE boot

server # dhtadm -A \ > -m PXEClient:Arch:00000:UNDI:002001 \ > -d ':BootFile="SUNW.i86pc":BootSrvA=10.0.0.10:' server # dhtadm -P Name Type Value ================================================== PXEClient:Arch:00000:UNDI:002001 Macro :BootFile="SUNW.i86pc":BootSrvA=10.0.0.10: server Macro :Include=Locale: Timeserv=10.0.0.10:LeaseTim=86400:LeaseNeg: DNSdmain="edu.sun.com":DNSserv=4.2.2.2: Locale Macro :UTCoffst=3600: SrootPTH Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SjumpsCF Symbol Vendor=SUNW.i86pc,14,ASCII,1,0 SsysidCF Symbol Vendor=SUNW.i86pc,13,ASCII,1,0 SinstPTH Symbol Vendor=SUNW.i86pc,12,ASCII,1,0 SinstNM Symbol Vendor=SUNW.i86pc,11,ASCII,1,0 SinstIP4 Symbol Vendor=SUNW.i86pc,10,IP,1,1 SrootNM Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SrootIP4 Symbol Vendor=SUNW.i86pc,2,IP,1,1

4.6   Create client in DHCP server

server # dhtadm -A \ > -m 0100E0815F2BB5 \ > -d ':SinstNM="server1"\ > :SinstIP4=10.0.0.10:\ > SinstPTH="/jumpstart/x86":\ > SrootNM="server1":\ > SrootIP4=10.0.0.10:\ > SrootPTH="/jumpstart/x86/Solaris_10/Tools/Boot":\ > SjumpsCF="10.0.0.10:/jumpstart/config":\ > SsysidCF="10.0.0.10:/jumpstart/config":' server # dhtadm -P Name Type Value ================================================== 0100E0815F2BB5 Macro :SinstNM="server1": SinstIP4=10.0.0.10:SinstPTH="/jumpstart/x86": SrootNM="server1":SrootIP4=10.0.0.10: SrootPTH="/jumpstart/x86/Solaris_10/Tools/Boot": SjumpsCF="10.0.0.10:/jumpstart/config":SsysidCF="10.0.0.10: /jumpstart/config": PXEClient:Arch:00000:UNDI:002001 Macro :BootFile="SUNW.i86pc":BootSrvA=10.0.0.10: server Macro :Include=Locale: Timeserv=10.0.0.10:LeaseTim=86400:LeaseNeg: DNSdmain="edu.sun.com":DNSserv=4.2.2.2: Locale Macro :UTCoffst=3600: SrootPTH Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SjumpsCF Symbol Vendor=SUNW.i86pc,14,ASCII,1,0 SsysidCF Symbol Vendor=SUNW.i86pc,13,ASCII,1,0 SinstPTH Symbol Vendor=SUNW.i86pc,12,ASCII,1,0 SinstNM Symbol Vendor=SUNW.i86pc,11,ASCII,1,0 SinstIP4 Symbol Vendor=SUNW.i86pc,10,IP,1,1 SrootNM Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SrootIP4 Symbol Vendor=SUNW.i86pc,2,IP,1,1

4.7   Assign permanent addresses to clients

server # pntadm -C 10.0.0.0 server # pntadm -A client1 \ > -f PERMANENT \ > -i 0100E0815F2BB5 \ > -m 0100E0815F2BB5 \ > -s server1 \ > 10.0.0.0 server # pntadm -L 10.0.0.0 server # pntadm -P 10.0.0.0 Client ID Flags Client IP Server IP Lease Expiration Macro Comment 0100E0815F2BB5 01 10.0.0.100 10.0.0.10 Forever 0100E0815F2BB5

5   Configure GRUB menu

In this step we have to edit the grub menu used by the install clients. In this grub menu we have to make the system is boot with the install keyword.

!!!! Watch Out !!!!
The output shown below only contains 5 lines. Make sure that the lines starting with kernel and - install are actually one line.

server # cat /tftpboot/boot/grub/menu.lst default=0 timeout=10 title Install Solaris10 6/06 X86/X64 kernel /I86PC.Solaris_10-1/multiboot kernel/unix - install -B install_media=10.0.0.10:/jumpstart/solaris10 module /I86PC.Solaris_10-1/x86.miniroot

6   PXE boot client

Now you can (re)boot your client. On the Ultra 20 workstations you can press F12 during boot (Sun logo) to force the client into a PXE boot (DHCP). When you have other clients you need to check the manual which keys to use on your hardware.

7   Troubleshooting PXE boot

A typo is made within a blink of an eye and then your client is not booting from the network. Here are some pointers how to debug your environment.

7.1   DHCP server in debug mode

It can be very handy to have the DHCP server running in debig mode. This enables you to see requests are maed by clients, what the server sends back to the client, etc.

server # svcadm disable dhcp-server server # /usr/lib/inet/in.dhcpd -dv 455aeed6: Daemon Version: 3.5 455aeed6: Maximum relay hops: 4 455aeed6: Run mode is: DHCP Server Mode. 455aeed6: Datastore resource: SUNWfiles 455aeed6: Location: /var/dhcp 455aeed6: DHCP offer TTL: 10 455aeed6: ICMP validation timeout: 1000 milliseconds, Attempts: 1. 455aeed6: Maximum concurrent clients: 1024 455aeed6: Maximum threads: 256 455aeed6: Read 4 entries from DHCP macro database on Wed Nov 15 11:41:26 2006 455aeed6: Monitor (0003/nge0) started... 455aeed6: Thread Id: 0003 - Monitoring Interface: nge0 ***** 455aeed6: MTU: 1500 Type: SOCKET 455aeed6: Broadcast: 10.0.0.255 455aeed6: Netmask: 255.255.255.0 455aeed6: Address: 10.0.0.10 455aeffe: Datagram received on network device: nge0(limited broadcast) 455aefff: Sending datagram to broadcast address. 455aefff: Added offer: 10.0.0.100 455af000: Datagram received on network device: nge0(limited broadcast) 455af000: Updated offer: 10.0.0.100 455af000: Client: 0100E0815F2BB5 maps to IP: 10.0.0.100 455af000: Sending datagram to broadcast address. 455af059: Datagram received on network device: nge0(limited broadcast) 455af059: Freeing offer: 10.0.0.100 455af05a: Unicasting datagram to 10.0.0.100 address. 455af05a: Adding ARP entry: 10.0.0.100 == 00E0815F2BB5 455af05a: Added offer: 10.0.0.100 455af05c: Datagram received on network device: nge0(limited broadcast) 455af05c: Updated offer: 10.0.0.100 455af05c: Client: 0100E0815F2BB5 maps to IP: 10.0.0.100 455af05c: Unicasting datagram to 10.0.0.100 address. 455af05c: Adding ARP entry: 10.0.0.100 == 00E0815F2BB5 455af0dc: Datagram received on network device: nge0(limited broadcast) 455af0dc: Freeing offer: 10.0.0.100 455af0dd: Unicasting datagram to 10.0.0.100 address. 455af0dd: Adding ARP entry: 10.0.0.100 == 00E0815F2BB5 455af0dd: Added offer: 10.0.0.100 455af0df: Datagram received on network device: nge0(limited broadcast) 455af0df: Updated offer: 10.0.0.100 455af0df: Client: 0100E0815F2BB5 maps to IP: 10.0.0.100 455af0df: Unicasting datagram to 10.0.0.100 address. 455af0df: Adding ARP entry: 10.0.0.100 == 00E0815F2BB5

7.2   Capture network traffic

With snoop you can look into network packets and see what data is them.

server # snoop -v | grep -i dhcp ... output skipped ... DHCP: DHCP: Message type = DHCPDISCOVER DHCP: Requested Options: DHCP: 1 (Subnet Mask) DHCP: 2 (UTC Time Offset) DHCP: 3 (Router) DHCP: 5 (IEN 116 Name Servers) DHCP: 6 (DNS Servers) DHCP: 11 (RFC 887 Resource Location Servers) DHCP: 12 (Client Hostname) DHCP: 13 (Boot File size in 512 byte Blocks) DHCP: 15 (DNS Domain Name) DHCP: 16 (SWAP Server) DHCP: 17 (Client Root Path) DHCP: 18 (BOOTP options extensions path) DHCP: 43 (Vendor Specific Options) DHCP: 54 (DHCP Server Identifier) DHCP: 60 (Client Class Identifier =) DHCP: 67 (Option BootFile Name) DHCP: 128 (Site Option) DHCP: 129 (Site Option) DHCP: 130 (Site Option) DHCP: 131 (Site Option) DHCP: 132 (Site Option) DHCP: 133 (Site Option) DHCP: 134 (Site Option) DHCP: 135 (Site Option) DHCP: Maximum DHCP Message Size = 1260 bytes DHCP: Unrecognized Option = 97, length = 17 octets DHCP: Value = 0x00 0x00 0xE0 0x81 0x5F 0x2B 0xB5 0x00 0x00 0x01 0x80 0xB5 0x2B 0x5F 0x81 0xE0 0x00 (unprintable) DHCP: Unrecognized Option = 93, length = 2 octets DHCP: Value = 0x00 0x00 (unprintable) DHCP: Unrecognized Option = 94, length = 3 octets DHCP: Value = 0x01 0x02 0x01 (unprintable) DHCP: Client Class Identifier = "PXEClient:Arch:00000:UNDI:002001" ... output skipped ... DHCP: Message type = DHCPOFFER DHCP: DHCP Server Identifier = 10.0.0.10 DHCP: IP Address Lease Time = -1 seconds DHCP: Client Hostname = client1 DHCP: Subnet Mask = 255.255.255.0 DHCP: Boot File Name = SUNW.i86pc ... output skipped ... DHCP: DHCP: Message type = DHCPDISCOVER DHCP: Maximum DHCP Message Size = 1472 bytes DHCP: IP Address Lease Time = -1 seconds DHCP: Client Class Identifier = "SUNW.i86pc" DHCP: Requested Options: DHCP: 1 (Subnet Mask) DHCP: 3 (Router) DHCP: 6 (DNS Servers) DHCP: 12 (Client Hostname) DHCP: 15 (DNS Domain Name) DHCP: 28 (Broadcast Address) DHCP: 43 (Vendor Specific Options) ... output skipped ... DHCP: Message type = DHCPOFFER DHCP: DHCP Server Identifier = 10.0.0.10 DHCP: IP Address Lease Time = -1 seconds DHCP: Client Hostname = client1 DHCP: Subnet Mask = 255.255.255.0 DHCP: Broadcast Address = 10.0.0.255 DHCP: Vendor-specific Options (136 total octets): DHCP: (13) 27 octets "10.0.0.10:/jumpstart/config" DHCP: (14) 27 octets "10.0.0.10:/jumpstart/config" DHCP: (02) 04 octets 0x0A 0x00 0x00 0x0A (unprintable) DHCP: (03) 36 octets "/jumpstart/x86/Solaris_10/Tools/Boot" DHCP: (12) 17 octets "/jumpstart/x86" DHCP: (10) 04 octets 0x0A 0x00 0x00 0x0A (unprintable) DHCP: (11) 07 octets "server1" ... output skipped ... DHCP: Message type = DHCPACK DHCP: DHCP Server Identifier = 10.0.0.10 DHCP: IP Address Lease Time = -1 seconds DHCP: Client Hostname = client1 DHCP: Subnet Mask = 255.255.255.0 DHCP: Broadcast Address = 10.0.0.255 DHCP: Vendor-specific Options (136 total octets): DHCP: (13) 27 octets "10.0.0.10:/jumpstart/config" DHCP: (14) 27 octets "10.0.0.10:/jumpstart/config" DHCP: (02) 04 octets 0x0A 0x00 0x00 0x0A (unprintable) DHCP: (03) 36 octets "/jumpstart/x86/Solaris_10/Tools/Boot" DHCP: (12) 17 octets "/jumpstart/x86" DHCP: (10) 04 octets 0x0A 0x00 0x00 0x0A (unprintable) DHCP: (11) 07 octets "server1"

7.3   DHCP configuration files / directories

7.4   Jumpstart log files

7.4.1   During installation on client

• /tmp/begin.log
• /tmp/finish.log
• /tmp/install_log
• /var/sadm/system/logs/sysidtool.log

7.4.2   After installation (after reboot) on client

• /var/sadm/system/logs/begin.log
• /var/sadm/system/logs/finish.log
• /var/sadm/system/logs/install_log
• /var/sadm/system/logs/sysidtool.log

8   A more flexible setup

The configuration outlined above can be made more flexible by adding specific macro's. What we basically did is create a macro for a client (Identifier is 0100E0815F2BB5) and define all settings with this client. Now imagine have 1,000 systems that you need to setup with the same settings: a lot of work. Or having setup 1,000 systems and one of your settings changes: even more work.

By placing all the settings in one macro and then link clients to this macro it means less work and changing settings is easier as well.

8.1   Extra exercise

If you feel lucky, try to get the following setup and try to install your client again.

server # dhtadm -P Name Type Value ================================================== 0100E0815F2BB5 Macro :Include=std_config: std_config Macro :SinstNM="server1":SinstIP4=10.0.0.10: SinstPTH="/jumpstart/x86":SrootNM="server1": SrootIP4=10.0.0.10:SrootPTH="/jumpstart/x86/Solaris_10/Tools/Boot": SjumpsCF="10.0.0.10:/jumpstart/config": SsysidCF="10.0.0.10:/jumpstart/config": PXEClient:Arch:00000:UNDI:002001 Macro :BootFile="SUNW.i86pc":BootSrvA=10.0.0.10: server Macro :Include=Locale:Timeserv=10.0.0.10:LeaseTim=86400: LeaseNeg:DNSdmain="edu.sun.com":DNSserv=4.2.2.2: Locale Macro :UTCoffst=3600: SrootPTH Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SjumpsCF Symbol Vendor=SUNW.i86pc,14,ASCII,1,0 SsysidCF Symbol Vendor=SUNW.i86pc,13,ASCII,1,0 SinstPTH Symbol Vendor=SUNW.i86pc,12,ASCII,1,0 SinstNM Symbol Vendor=SUNW.i86pc,11,ASCII,1,0 SinstIP4 Symbol Vendor=SUNW.i86pc,10,IP,1,1 SrootNM Symbol Vendor=SUNW.i86pc,3,ASCII,1,0 SrootIP4 Symbol Vendor=SUNW.i86pc,2,IP,1,1

9   Automate setting up jumpstart and PXE boot

This document was written to show you all the steps involved in supporting PXE clients from a jumpstart server. The Jumpstart Enterprise Toolkit (JET) is an environment provided by Sun which will automate the setup of your jumpstart server and additional DHCP server for PXE clients.

JET can be found at http://www.sun.com/bigadmin/content/jet/ and is provided as 'as-is' software without support.

10   Credits

Pim (Leemans) and Jan (Sepp) thank you for your help, advice and comments.

11   Disclaimer

I'm in no way responsible for what you do. Not even when you do it after reading my documents.