Xen On Funtoo From Scratch
STUB - WORK IN PROGRESS
Hardware Configuration
- VGA: Nvidia GeForce 9800 GT
 - CPU: Intel Core i7 3770
 - Motherboard: DQ77MK
 
Used Software
- Dom0 OS: Funtoo GNU/Linux distro (derrived from gentoo).
 - Kernel: 3.4.4
 - Xen: 4.2.0-unstable rev 25099
 - DomU OS: Windows XP SP3
 
Reference documentation
- Creating bootable USB-stick from gentoo livecd: http://www.gentoo.org/doc/en/liveusb.xml
 - Funtoo installation: http://www.funtoo.org/wiki/Funtoo_Linux_Installation
 - Xen 4.1 installation on gentoo: http://en.gentoo-wiki.com/wiki/Xen4.1
 - Xen 4.2 installation on ubuntu: http://www.davidgis.fr/blog/index.php?2011/12/07/860-xen-%2042unstable-patches-for-vga-pass-through
 - LVM installation guide on funtoo: http://www.funtoo.org/wiki/Rootfs_over_encrypted_lvm
 
Make bootable USB
Preparation
# emerge -av dosfstools syslinux
Make partitions
   # fdisk -l /dev/sdb  
   
   Disk /dev/sdb: 8422 MB, 8422162432 bytes
   239 heads, 47 sectors/track, 1464 cylinders, total 16449536 sectors
   Units = sectors of 1 * 512 = 512 bytes
   Sector size (logical/physical): 512 bytes / 512 bytes
   I/O size (minimum/optimal): 512 bytes / 512 bytes
   Disk identifier: 0x0008aec7
   
      Device Boot      Start         End      Blocks   Id  System
   /dev/sdb1   *        2048    16449535     8223744    b  W95 FAT32
Install MBR
# dd if=/usr/share/syslinux/mbr.bin of=/dev/sdb 0+1 records in 0+1 records out 440 bytes (440 B) copied, 0.0190098 s, 23.1 kB/s
Make fat32 filesystem
# mkdosfs -F32 /dev/sdb1 mkdosfs 3.0.9 (31 Jan 2010)
Download Gentoo LiveCD iso
Go to http://www.gentoo.org/main/en/where.xml ; pick mirror you like and download install-amd64-minimal-[0-9]*.iso, for example - this one:
wget http://distfiles.gentoo.org/releases/amd64/autobuilds/current-iso/install-amd64-minimal-20120621.iso
Mount gentoo LiveCD
# mkdir -p /mnt/cdrom/ # mount -o loop install-amd64-minimal-20120621.iso /mnt/cdrom/ mount: warning: /mnt/cdrom/ seems to be mounted read-only.
Mount usb stick
# mkdir -p /mnt/usb/ # mount /dev/sdb1 /mnt/usb/
Copy contents of LiveCD to usb stick
   # cp -aR /mnt/cdrom/* /mnt/usb/
   # mv /mnt/usb/isolinux/* /mnt/usb
   # mv /mnt/usb/isolinux.cfg /mnt/usb/syslinux.cfg
   # rm -rf /mnt/usb/isolinux*
   # mv /mnt/usb/memtest86 /mnt/usb/memtest
   # sed -i \
        -e "s:cdroot:cdroot slowusb:" \
        -e "s:kernel memtest86:kernel memtest:" \
        /mnt/usb/syslinux.cfg
Unmount medias
# umount /mnt/cdrom/ # umount /mnt/usb/
Install syslinux
note guide # syslinux /dev/sdb1
Boot from USB-stick
If in trouble, try following gentoo handbook
Install Funtoo
Once booted, do this:
Partition hard drive
   # gdisk -l /dev/sda  
   GPT fdisk (gdisk) version 0.8.4
   
   Partition table scan:
     MBR: protective
     BSD: not present
     APM: not present
     GPT: present
   
   Found valid GPT with protective MBR; using GPT.
   Disk /dev/sda: 1953525168 sectors, 931.5 GiB
   Logical sector size: 512 bytes
   Disk identifier (GUID): DDF92951-E1C2-4138-B01C-71051D08D1FB
   Partition table holds up to 128 entries
   First usable sector is 34, last usable sector is 1953525134
   Partitions will be aligned on 2048-sector boundaries
   Total free space is 2014 sectors (1007.0 KiB)
   
   Number  Start (sector)    End (sector)  Size       Code  Name
      1            2048           67583   32.0 MiB    EF02  BIOS boot partition
      2           67584         1091583   500.0 MiB   8300  Linux filesystem
      3         1091584        17868799   8.0 GiB     8200  Linux swap
      4        17868800      1953525134   923.0 GiB   8E00  Linux LVM
Setup LVM
   # pvcreate /dev/sda4 
     Writing physical volume data to disk "/dev/sda4"
     Physical volume "/dev/sda4" successfully created
   # vgcreate data /dev/sda4 
     Volume group "data" successfully created
   # lvcreate -L40G -n root data
     Logical volume "root" created
   # lvcreate -L40G -n winxp data
     Logical volume "winxp" created
Setup Filesystems
# mkfs.ext3 /dev/sda2 # mkswap /dev/sda3 # mkfs.ext4 /dev/data/root
Mount filesystems
# mkdir /mnt/funtoo # mount /dev/data/root /mnt/funtoo/ # mkdir /mnt/funtoo/boot # mount /dev/sda2 /mnt/funtoo/boot/ # cd /mnt/funtoo/
Setup networking inside of LiveUSB OS
# /etc/init.d/dhcpcd start
Download Funtoo stage3 distribution
# wget http://ftp.osuosl.org/pub/funtoo/funtoo-current/x86-64bit/corei7/stage3-current.tar.xz
Unpack Funtoo distribution
# tar xJpf stage3-current.tar.xz
Chrooting
# mount --bind /dev/ /mnt/funtoo/dev/ # mount --bind /proc/ /mnt/funtoo/proc # cp /etc/resolv.conf /mnt/funtoo/etc/ # chroot /mnt/funtoo/
Syncing
# emerge --sync
Configure Funtoo
/etc/fstab
# <fs> <mountpoint> <type> <opts> <dump/pass> /dev/sda2 /boot ext3 defaults 1 2 /dev/sda3 none swap sw 0 0 /dev/data/root / ext4 noatime 0 1
/etc/localtime
# cp /usr/share/zoneinfo/Europe/Moscow /etc/localtime
/etc/make.conf
ACCEPT_KEYWORDS="~amd64" CHOST="x86_64-pc-linux-gnu" CFLAGS="-march=corei7 -O2 -pipe" CXXFLAGS="-march=corei7 -O2 -pipe" SYNC="git://github.com/funtoo/ports-2012.git" USE="X xinerama" VIDEO_CARDS="nvidia" MAKEOPTS="-j10"
Install system-wide services
# echo "sys-boot/boot-update" >> /etc/portage/package.unmask # echo "sys-devel/automake" >> /etc/portage/package.unmask # emerge -av eix lvm2 grub bridge-utils vixie-cron syslog-ng logrotate =sys-boot/boot-update-1.6.2 # eix-update # rc-update add lvm default # rc-update add vixie-cron default # rc-update add syslog-ng default # rc-update add sshd default # rc-update add dhcpcd default # passwd
Install Kernel
# emerge -av gentoo-sources
Configure kernel
# cd /usr/src/linux # make menuconfig
   
   General setup  --->
      <*> Kernel .config support
         [*]   Enable access to .config through /proc/config.gz
   
   Bus options (PCI etc.)  --->
      <*> PCI Stub driver
   
   Processor type and features  ---> 
      [*] Paravirtualized guest support  ---> 
         [*]   Xen guest support
   
   [*] Networking support  --->
      Networking options  --->
         <*> 802.1d Ethernet Bridging    
   
   Device Drivers  ---> 
      [*] Block devices (NEW)  --->
         <*>   Xen virtual block device support
         <*>   Xen block-device backend driver
   
   Device Drivers  ---> 
      [*] Network device support  --->
         [*]   Ethernet driver support (NEW)  ---> 
            [*]   Intel devices (NEW)
            < >     Intel(R) PRO/100+ support
            < >     Intel(R) PRO/1000 Gigabit Ethernet support
            <*>     Intel(R) PRO/1000 PCI-Express Gigabit Ethernet support
            < >     Intel(R) 82575/82576 PCI-Express Gigabit Ethernet support
            < >     Intel(R) 82576 Virtual Function Ethernet support
            < >     Intel(R) PRO/10GbE support
            < >     Intel(R) 10GbE PCI Express adapters support
            < >     Intel(R) 82599 Virtual Function Ethernet support
            [ ]     Intel (82586/82593/82596) devices
            <*>     NetXen Multi port (1/10) Gigabit Ethernet NIC
   
   Device Drivers  ---> 
      [*] Network device support  --->
         <*>   Universal TUN/TAP device driver support 
         <*>   Xen network device frontend driver
         <*>   Xen backend network device
        
   Device Drivers  ---> 
      Xen driver support  ---> 
         [*] Xen memory balloon driver (NEW) 
         [*]   Scrub pages before returning them to system (NEW) 
         <*> Xen /dev/xen/evtchn device (NEW) 
         [*] Backend driver support (NEW) 
         <*> Xen filesystem (NEW) 
         [*]   Create compatibility mount point /proc/xen (NEW) 
         [*] Create xen entries under /sys/hypervisor (NEW) 
         <*> userspace grant access device driver (NEW) 
         <*> User-space grant reference allocator driver (NEW) 
         <*> xen platform pci device driver (NEW)
         <*> Xen ACPI processor
   
   File systems  --->
      <*> Ext3 journalling file system support
      <*> The Extended 4 (ext4) filesystem
      [*]   Use ext4 for ext2/ext3 file systems (NEW)
      [*]   Ext4 extended attributes (NEW)
# make -j 10 # make install # make modules_install
Install initramfs
# mkdir /root/initramfs # cd /root/initramfs/ # git clone git://github.com/slashbeast/better-initramfs.git # cd better-initramfs # bootstrap/bootstrap-all # make prepare # make image # cp output/initramfs.cpio.gz /boot/
Configure bootloader
# grub-install --no-floppy /dev/sda
/etc/boot.cfg
   boot {
       generate grub
       default "Funtoo Linux XEN"  
       timeout 3 
   }
   
   "Funtoo Linux" {
       kernel vmlinuz[-v]
       initrd /initramfs.cpio.gz
       params += root=/dev/data/root lvm
   }
   
   "Funtoo Linux XEN" {
       type xen
       xenkernel xen.gz
       kernel vmlinuz[-v]
       initrd /initramfs.cpio.gz
       params += root=/dev/data/root lvm
   }
Update
# boot-update
Booting in new system
When booting, select regular (non-XEN) kernel at the first time. It is because we don't have XEN userspace tools to operate with yet.
# reboot
Install xen 4.2-unsable
Get current Nvidia flash ROM
# wget http://www.davidgis.fr/download/nvflash_5.100.1_usb.iso.tar.bz2 # tar xvf nvflash_5.100.1_usb.iso.tar.bz2 # dd if=nvflash_5.100.1_usb.iso of=/dev/sdb # reboot
Boot from USB stick
C:\> nvflash.exe --save vgabios.rom
Boot back to the system
Choose non-xen kernel again
Install XEN 4.2
# emerge mercurial yajl dev86 bin86 iasl # rev=25099; hg clone -r $rev http://xenbits.xensource.com/staging/xen-unstable.hg/ xen-unstable.hg-rev-${rev} # cd xen-unstable.hg-rev-25099/tools/ # ./configure # sed '/Werror/d' -i tests/mce-test/tools/Makefile # make FLEX=flex -j 10 # make clean # cd ../ # wget http://www.davidgis.fr/download/xen-4.2_rev24798_gfx-passthrough-patchs.tar.bz2 # tar -xvf xen-4.2_rev24798_gfx-passthrough-patchs.tar.bz2 # for file in xen-4.2_rev24798_gfx-passthrough-patchs/*; do patch -p1 < $file; done
Now the tricky part. You have to tune one of asl-files to support your very own VGA card memory ranges. It goes like there:
# lspci | grep VGA 01:00.0 VGA compatible controller: NVIDIA Corporation G92 [GeForce 9800 GT] (rev a2) # dmesg | grep 01:00.0 | grep mem | head -n3 [ 0.281769] pci 0000:01:00.0: reg 10: [mem 0xf6000000-0xf6ffffff] [ 0.281776] pci 0000:01:00.0: reg 14: [mem 0xe0000000-0xefffffff 64bit pref] [ 0.281783] pci 0000:01:00.0: reg 1c: [mem 0xf4000000-0xf5ffffff 64bit]
These three ranges goes to tools/firmware/hvmloader/acpi/dsdt.asl by formula
MaxRange - MinRange + 1
(consider using some hex calculator (emerge wcalc), for example - `wcalc -h`)
In this example this would be:
- 0xf6ffffff - 0xf6000000 + 1 = 0x01000000
 - 0xefffffff - 0xe0000000 + 1 = 0x10000000
 - 0xf5ffffff - 0xf4000000 + 1 = 0x02000000
 
Then edit tools/firmware/hvmloader/acpi/dsdt.asl file as follows:
                   /* reserve MMIO BARs of gfx for 1:1 mapping */
                   DWordMemory(
                       ResourceProducer, PosDecode, MinFixed, MaxFixed,
                       Cacheable, ReadWrite,
                       0x00000000,
                       0xf6000000,
                       0xf6ffffff,
                       0x00000000,
                       0x01000000)
   
                   DWordMemory(
                       ResourceProducer, PosDecode, MinFixed, MaxFixed,
                       NonCacheable, ReadWrite,
                       0x00000000,
                       0xe0000000,
                       0xefffffff,
                       0x00000000,
                       0x10000000)
   
                   DWordMemory(
                       ResourceProducer, PosDecode, MinFixed, MaxFixed,
                       Cacheable, ReadWrite,
                       0x00000000,
                       0xf4000000,
                       0xf5ffffff,
                       0x00000000,
                       0x02000000)
Remember USB stick with vgabios.rom on it we dumped before? Now we need it.
# mkdir /mnt/usb # mount /dev/sdb1 /mnt/usb/ # cp /mnt/usb/VGABIOS.ROM tools/firmware/vgabios/vgabios-pt.bin
Thats it. Now simply (and dirty) make && make install all needed components:
# make xen && make tools && make stubdom # make install-xen && make install-tools PYTHON_PREFIX_ARG= && make install-stubdom
Add following script to /etc/init.d/xen
   #!/sbin/runscript
   # Copyright 1999-2011 Gentoo Foundation
   # Distributed under the terms of the GNU General Public License v2
   # $Header: /var/cvsroot/gentoo-x86/net-misc/openssh/files/sshd.rc6.3,v 1.2 2011/09/14 21:46:19 polynomial-c Exp $
       
   start() {
       /etc/init.d/xencommons start
       /etc/init.d/xend start
   }
   
   stop() {
       /etc/init.d/xend stop
       /etc/init.d/xencommons stop
   }
# chmod +x /etc/init.d/xen # rc-update add xen default
Now you can safely choose XEN kernel - it should be bootable.
# reboot
- install winxp
 - integreate
 
