Setup LVM based Intrepid Server PV DomU for PV-Grub load at Xen 3.3.1-RC4 CentOS 5.2 Dom0

December 31, 2008

Been creating Intrepid (lbex) HVM image,supposed to be loaded as PV DomU, i’ve got an issue with default LVM partitioning been done by Ubuntu Intrepid Server. Image been created may be easily loaded at Xen 3.3.X Dom0 via traditional xm-profile by not via “pygrub” or “pv-grub”, expecting /boot partition not of LVM’s type. Up on creating Intrepid HVM image, boot partition and LVM’s Group , containing “/” filesystem and swap as logical volumes have been setup.Notice,that Disk Druid RH’s partitioner always does so by default.
Intrepid KVM with image device (/dev/sdb8) has been created via virt-manager on Ubuntu Intrepid Server dual booting with
Xen 3.3.1 CentOS 5.2 Dom0. Actually, it’s not important where to create this image. It could be also done via standard hvm profile at Xen 3.3.1 CentOS 5.2 Dom0. I have to notice, that “qcow2″ format for image files supported by the most recent python-vm-builder for intrepid’s KVMs is not acceptable for convertion into PV DomU’s images.



Setting up Intrepid HVM at Xen 3.3.1-RC4 CentOS 5.2 Dom0 :-















Once HVM got loaded /etc/event.d/tty1 has been copied to /etc/event.d/hvc0

# tty1 - getty
#
# This service maintains a getty on tty1 from the point the system is
# started until it is shut down again.
start on stopped rc2
start on stopped rc3
start on stopped rc4
start on stopped rc5
stop on runlevel 0
stop on runlevel 1
stop on runlevel 6
respawn
exec /sbin/getty 38400 hvc0

The first time Intrepid PV DomU has been loaded via profile :

[root@dhcppc0 vm]# cat xen.conf
name = 'UbuntuPVS810'
memory = 4096
kernel = '/etc/xen/vm/vmlinuz-2.6.27-7-server'
ramdisk = '/etc/xen/vm/initrd.img-2.6.27-7-server'
disk = [ 'phy:/dev/sdb8,xvda,w']
vif = [ 'bridge = eth0']
on_poweroff = 'destroy'
on_reboot = 'restart'
on_crash = 'restart'
root = '/dev/mapper/vg01-vol01 ro'
extra = '2 console=hvc0'

At DomU side :-

# apt-get vim
# apt-get upgrade
# apt-get linux-server-image

have been run.
File /boot/grub/menu.lst modified as follows :-

title Ubuntu 8.10, kernel 2.6.27-9-server (PV DomU)
root (hd0,0)
kernel /vmlinuz-2.6.27-9-server root=/dev/mapper/vg01-vol01 ro 2 console=hvc0
initrd /initrd.img-2.6.27-9-server
quiet

Then Intrepid PV DomU may be loaded via profile :-

[root@dhcppc0 vm]# cat IntrepidPVG.pv-grub
name = "InterpidPV-Grub"
memory = 4096
vcpus = 1
disk = [ 'phy:/dev/sdb8,xvda,w' ]
vif = [ "bridge=eth0" ]
kernel = "/usr/lib/xen/boot/pv-grub-x86_64.gz"
extra = "(hd0,0)/grub/menu.lst"

Startup log

[root@ServerXen331 vm]# xm create -c IntrepidPVG.pv-grub
Using config file "./IntrepidPVG.pv-grub".
Started domain InterpidPV-Grub
Xen Minimal OS!
start_info: 0x118d000
nr_pages: 1048576 shared_inf: ceff0000
Booting 'Ubuntu 8.10, kernel 2.6.27-9-server (PV DomU)'
root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
kernel /vmlinuz-2.6.27-9-server root=/dev/mapper/vg01-vol01 ro 2 console=hvc0
initrd /initrd.img-2.6.27-9-server
close blk: backend at /local/domain/0/backend/vbd/1/51712
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.27-9-server (buildd@yellow) (gcc version 4.3.2 (Ubuntu 4.3.2-1ubuntu11) ) #1 SMP Thu Nov 20 22:56:07 UTC 2008 (Ubuntu 2.6.27-9.19-server)
[ 0.000000] Command line: root=/dev/mapper/vg01-vol01 ro 2 console=hvc0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] ACPI in unprivileged domain disabled
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable)
[ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved)
[ 0.000000] Xen: 0000000000100000 - 0000000002251000 (usable)
[ 0.000000] Xen: 0000000002251000 - 0000000002a54000 (reserved)
[ 0.000000] Xen: 0000000002a54000 - 0000000100000000 (usable)
[ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x3ffffffff
[ 0.000000] init_memory_mapping
[ 0.000000] last_map_addr: 100000000 end: 100000000
[ 0.000000] RAMDISK: 008b9000 - 02251000
[ 0.000000] DMI not present or invalid.
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-0000000100000000
[ 0.000000] Bootmem setup node 0 0000000000000000-0000000100000000
[ 0.000000] NODE_DATA [0000000000001000 - 0000000000005fff]
[ 0.000000] bootmap [0000000000008000 - 0000000000027fff] pages 20
[ 0.000000] (6 early reservations) ==> bootmem [0000000000 - 0100000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #2 [0002a54000 - 0002a6d000] XEN PAGETABLES ==> [0002a54000 - 0002a6d000]
[ 0.000000] #3 [0000200000 - 00008b8f9c] TEXT DATA BSS ==> [0000200000 - 00008b8f9c]
[ 0.000000] #4 [00008b9000 - 0002251000] RAMDISK ==> [00008b9000 - 0002251000]
[ 0.000000] #5 [0002a6d000 - 0003256000] PGTABLE ==> [0002a6d000 - 0003256000]
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000000 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00100000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[3] active PFN ranges
[ 0.000000] 0: 0x00000000 -> 0x000000a0
[ 0.000000] 0: 0x00000100 -> 0x00002251
[ 0.000000] 0: 0x00002a54 -> 0x00100000
[ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] No local APIC present
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[ 0.000000] PM: Registered nosave memory: 0000000002251000 - 0000000002a54000
[ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range
[ 0.000000] PCI: Unassigned devices with 32bit resource registers may break!
[ 0.000000] Allocating PCI resources starting at 100200000 (gap: 100100000:400000)
[ 0.000000] PERCPU: Allocating 64928 bytes of per cpu data
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1028322
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=/dev/mapper/vg01-vol01 ro 2 console=hvc0
[ 0.000000] Initializing CPU#0
[ 0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 0.000000] Detected 3005.554 MHz processor.
[ 0.010000] Console: colour dummy device 80x25
[ 0.010000] console [tty0] enabled
[ 0.010000] console [hvc0] enabled
[ 0.010000] Checking aperture...
[ 0.010000] No AGP bridge found
[ 0.010000] Memory: 4078468k/4194304k available (3111k kernel code, 107248k reserved, 1577k data, 536k init)
[ 0.010000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.010000] installing Xen timer for CPU 0
[ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6011.10 BogoMIPS (lpj=30055540)
[ 0.010000] Security Framework initialized
[ 0.010000] SELinux: Disabled at boot.
[ 0.010000] AppArmor: AppArmor initialized
[ 0.010000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[ 0.010000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.010000] Mount-cache hash table entries: 256
[ 0.010000] Initializing cgroup subsys ns
[ 0.010000] Initializing cgroup subsys cpuacct
[ 0.010000] Initializing cgroup subsys memory
[ 0.010000] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.010000] CPU: L2 cache: 6144K
[ 0.010000] CPU 0/0 -> Node 0
[ 0.010000] CPU: Physical Processor ID: 0
[ 0.010000] CPU: Processor Core ID: 0
[ 0.010000] SMP alternatives: switching to UP code
[ 0.016842] Freeing SMP alternatives: 24k freed
[ 0.016895] cpu 0 spinlock event irq 1
[ 0.016954] Brought up 1 CPUs
[ 0.017209] net_namespace: 1552 bytes
[ 0.017216] Booting paravirtualized kernel on Xen
[ 0.017219] Xen version: 3.3.1-rc4 (preserve-AD)
[ 0.017317] Grant table initialized
[ 0.037343] Time: 165:165:165 Date: 165/165/65
[ 0.037366] NET: Registered protocol family 16
[ 0.040123] PCI: Fatal: No config space access function found
[ 0.040780] ACPI: Interpreter disabled.
[ 0.040785] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 0.040814] pnp: PnP ACPI: disabled
[ 0.040824] xen_balloon: Initialising balloon driver.
[ 0.040824] PCI: System does not support PCI
[ 0.040824] PCI: System does not support PCI
[ 0.070048] NET: Registered protocol family 8
[ 0.070054] NET: Registered protocol family 20
[ 0.070086] NetLabel: Initializing
[ 0.070090] NetLabel: domain hash size = 128
[ 0.070093] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.070105] NetLabel: unlabeled traffic allowed by default
[ 0.070111] PCI-GART: No AMD northbridge found.
[ 0.070438] tracer: 1286 pages allocated for 65536 entries of 80 bytes
[ 0.070443] actual entries 65586
[ 0.070511] AppArmor: AppArmor Filesystem Enabled
[ 0.070902] NET: Registered protocol family 2
[ 0.160144] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.161337] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[ 0.164068] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.164490] TCP: Hash tables configured (established 524288 bind 65536)
[ 0.164495] TCP reno registered
[ 0.190086] NET: Registered protocol family 1
[ 0.190168] checking if image is initramfs... it is
[ 0.207743] Freeing initrd memory: 26208k freed
[ 0.215888] platform rtc_cmos: registered platform RTC device (no PNP device found)
[ 0.216287] audit: initializing netlink socket (disabled)
[ 0.216302] type=2000 audit(1230734886.996:1): initialized
[ 0.220775] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.223202] VFS: Disk quotas dquot_6.5.1
[ 0.223281] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.223371] msgmni has been set to 8243
[ 0.223472] io scheduler noop registered
[ 0.223476] io scheduler anticipatory registered
[ 0.223480] io scheduler deadline registered (default)
[ 0.223596] io scheduler cfq registered
[ 0.251350] Linux agpgart interface v0.103
[ 0.251361] Serial: 8250/16550 driver4 ports, IRQ sharing enabled
[ 0.253154] brd: module loaded
[ 0.253215] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.253369] PNP: No PS/2 controller found. Probing ports directly.
[ 0.254190] i8042.c: No controller found.
[ 0.270584] mice: PS/2 mouse device common for all mice
[ 0.270631] rtc_cmos: probe of rtc_cmos failed with error -16
[ 0.270708] cpuidle: using governor ladder
[ 0.270711] cpuidle: using governor menu
[ 0.270954] TCP cubic registered
[ 0.270969] IO APIC resources could be not be allocated.
[ 0.271132] registered taskstats version 1
[ 0.271143] XENBUS: Device with no driver: device/vbd/51712
[ 0.271147] XENBUS: Device with no driver: device/vif/0
[ 0.271150] XENBUS: Device with no driver: device/console/0
[ 0.271161] Magic number: 1:252:3141
[ 0.271232] /build/buildd/linux-2.6.27/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 0.271239] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 0.271242] EDD information not available.
[ 0.271260] Freeing unused kernel memory: 536k freed
[ 0.271402] Write protecting the kernel read-only data: 4348k
Loading, please wait...
Couldnt get a file descriptor referring to the console
Begin: Loading essential drivers... ...
[ 0.353491] fuse init (API version 7.9)
[ 0.400923] thermal: Unknown symbol acpi_processor_set_thermal_limit
[ 0.411210] device-mapper: uevent: version 1.0.3
[ 0.411363] device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised: dm-devel@redhat.com
Done.
Begin: Running /scripts/init-premount ...
Done.
Begin: Mounting root file system... ...
Begin: Running /scripts/local-top ...
Done.
Begin: Waiting for root file system... ...
[ 1.138334] blkfront: xvda: barriers enabled
[ 1.138636] xvda: xvda1 xvda2
Done.
Begin: Running /scripts/local-premount ...
19+0 records in
19+0 records out
kinit: name_to_dev_t(/dev/mapper/vg01-vol02) = dev(254,1)
kinit: trying to resume from /dev/mapper/vg01-vol02
[ 1.508634] PM: Starting manual resume from disk
kinit: No resume image, doing normal boot...
Done.
[ 1.553487] kjournald starting. Commit interval 5 seconds
[ 1.553499] EXT3-fs: mounted filesystem with ordered data mode.
Begin: Running /scripts/local-bottom ...
Done.
Done.
Begin: Running /scripts/init-bottom ...
Done.
* Setting preliminary keymap... [ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Wed Dec 31 14:48:09 UTC 2008
* Starting basic networking... [ OK ]
* Starting kernel event manager... [ 2.754835] udevd version 124 started
[ OK ]
* Loading hardware drivers... [ 3.064621] Initialising Xen virtual ethernet driver.
[ 3.076929] input: PC Speaker as /devices/platform/pcspkr/input/input1
[ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Wed Dec 31 14:48:10 UTC 2008
* Loading kernel modules... * Loading manual drivers... [ 4.045033] loop: module loaded
[ 4.100426] lp: driver loaded but no devices found
[ OK ]
* Setting kernel variables (/etc/sysctl.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-console-messages.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-network-security.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-process-security.conf)... [ OK ]
* Activating swap... [ OK ]
* Checking root file system... fsck 1.41.3 (12-Oct-2008)
/dev/mapper/vg01-vol01: clean, 26035/765536 files, 263631/3058688 blocks
[ OK ]
* Checking file systems... fsck 1.41.3 (12-Oct-2008)
/dev/xvda1: clean, 38/122880 files, 52386/489948 blocks
[ OK ]
* Mounting local filesystems... [ OK ]
* Activating swapfile swap... [ OK ]
$Mounting securityfs on /sys/kernel/security: done.
Loading AppArmor profiles : done.
* Skipping firewall: ufw (not enabled)... [ OK ]
* Configuring network interfaces... [ OK ]
* Setting up console font and keymap... [ OK ]
* Starting system log daemon... [ OK ]
* Starting kernel log daemon... [ OK ]
* Starting system message bus dbus [ OK ]
* Starting OpenBSD Secure Shell server sshd [ OK ]
* Starting deferred execution scheduler atd [ OK ]
* Starting periodic command scheduler crond [ OK ]

Ubuntu 8.10 UbuntuSRV hvc0

UbuntuSRV login: root
Password:
Last login: Wed Dec 31 07:06:32 EST 2008 on hvc0
Linux UbuntuSRV 2.6.27-9-server #1 SMP Thu Nov 20 22:56:07 UTC 2008 x86_64

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To access official Ubuntu documentation, please visit:

http://help.ubuntu.com/

root@UbuntuSRV:~#


At Dom0 side Intrepid Server PV DomU’s configuration looks like :-

[root@ServerXen331 ~]# xm list -l InterpidPV-Grub
(domain
(domid 1)
(on_crash restart)
(uuid e622894a-7c14-b6b2-fc3d-58f5628002d0)
(bootloader_args )
(vcpus 1)
(name InterpidPV-Grub)
(on_poweroff destroy)
(on_reboot restart)
(bootloader )
(maxmem 4096)
(memory 4096)
(shadow_memory 0)
(features )
(on_xend_start ignore)
(on_xend_stop ignore)
(start_time 1230734876.15)
(cpu_time 13.595148826)
(online_vcpus 1)
(image
(linux
(kernel /usr/lib/xen/boot/pv-grub-x86_64.gz)
(args '(hd0,0)/grub/menu.lst')
(notes)
)
)
(status 2)
(state -b----)
(store_mfn 2211302)
(console_mfn 2211301)
(device
(vif
(bridge eth0)
(mac 00:16:3e:31:42:b7)
(script /etc/xen/scripts/vif-bridge)
(uuid 55c1e4ae-34b6-2f4a-7ed1-43a5fdfc13d9)
(backend 0)
)
)
(device
(vbd
(protocol x86_64-abi)
(uuid a8da65b0-382a-d8ed-d54d-8b9670b2e0d9)
(dev xvda:disk)
(uname phy:/dev/sdb8)
(mode w)
(backend 0)
(bootable 1)
(VDI )
)
)
(device
(console
(protocol vt100)
(location 2)
(uuid 9c764e32-0f57-78b9-f228-2504c16be5f2)
)
)
)

Ubuntu Desktop has been installed via tasksel
and vnc has been set up at PV DomU :-




Running 64-bit Solaris 10U6 HVM DomU (2 vcpus) at Xen 3.3.1-RC3 CentOS 5.2 Dom0

December 19, 2008

Xen 3.3.1-RC3 contains fix for bug SMP 64bit Solaris10u5 cause Xen crash

Bug detailed description:
--------------------------
With Xen unstable, booting SMP 64bit Solaris10u5 will cause Xen crash. Booting
UP 64 bit Solaris10u5 or SMP 32 bit Solaris10u5 has no such issue.
BTW, to boot up 64 bit Solaris10u5 on unstable xen, we should set PSE36=1 by
cpuid=[ '1:edx=xxxxxxxxxxxxxx1xxxxxxxxxxxxxxxxx' ] in hvm guest config file.

RC3 & RC4 handle running mentioned 64-bit HVM with 2 vcpus (C2D box) , what causes openSUSE 11.1 Xen Host to reboot .OpenSUSE 11.1 Xen host may run 64-bit S10U6 HVM with vcpus=1 only. Current Solaris Nevada build 104 has the same limitation. Solaris 10U6 (64 bit) HVM runtime profile for Xen 3.3.1-RC3 Linux Dom0 :-

[root@ServerXen vm]# cat solaris.hvm
name = "S10U6"
builder = "hvm"
memory = "2048"
disk = ['phy:/dev/sda11,hda,w']
vif = [ 'bridge=eth0' ]
device_model = "/usr/lib64/xen/bin/qemu-dm"
kernel = "/usr/lib/xen/boot/hvmloader"
cpuid=[ '1:edx=xxxxxxxxxxxxxx1xxxxxxxxxxxxxxxxx' ]
vnc=1
boot="c"
usb=1
usbdevice="tablet"
vcpus=2
serial = "pty" # enable serial console
on_reboot = 'restart'
on_crash = 'restart'

Runtime reports:-

****************************
Solaris 10U6 HVM Console
****************************
bash-3.00# uname -a
SunOS dhcppc7 5.10 Generic_137138-09 i86pc i386 i86pc
bash-3.00# /usr/bin/isainfo -kv
64-bit amd64 kernel modules
***************************************
SSH to Xen 3.3.1-rc3 CentOS 5.2 Dom0
***************************************
bash-3.00# ssh root@192.168.1.33
root@192.168.1.33's password:
Last login: Fri Dec 19 00:47:10 2008 from 192.168.1.39
[root@ServerXen ~]# uname -a
Linux ServerXen 2.6.18.8-xen #1 SMP Thu Dec 18 08:01:37 EST 2008 x86_64 x86_64 x86_64 GNU/Linux
[root@ServerXen ~]# xm info|grep xen_
xen_major : 3
xen_minor : 3
xen_extra : .1-rc3
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
xen_changeset : Wed Dec 17 13:52:35 2008 +0000 18540:f802623e6e5d
[root@ServerXen ~]# xm list
Name ID Mem VCPUs State Time(s)
Domain-0 0 3897 2 r----- 51.6
S10U6 1 4096 2 -b---- 106.3
[root@ServerXen ~]# xm list -l S10U6
(domain
(domid 1)
(on_crash restart)
(uuid 24a31321-7e3e-dfae-498f-cfac71c66ab8)
(bootloader_args )
(vcpus 2)
(name S10U6)
(on_poweroff destroy)
(on_reboot restart)
(bootloader )
(maxmem 4096)
(memory 4096)
(shadow_memory 34)
(features )
(on_xend_start ignore)
(on_xend_stop ignore)
(start_time 1229685596.76)
(cpu_time 107.551384624)
(online_vcpus 2)
(image
(hvm
(kernel )
(hpet 0)
(stdvga 0)
(loader /usr/lib/xen/boot/hvmloader)
(serial pty)
(vncunused 1)
(boot c)
(rtc_timeoffset 0)
(pci ())
(pae 1)
(hap 1)
(acpi 1)
(localtime 0)
(timer_mode 0)
(vnc 1)
(nographic 0)
(guest_os_type default)
(apic 1)
(monitor 0)
(usbdevice tablet)
(device_model /usr/lib64/xen/bin/qemu-dm)
(usb 1)
(xauthority /tmp/.gdm4XFKMU)
(isa 0)
(display :0.0)
(notes (SUSPEND_CANCEL 1))
)
)
(status 2)
(state -b----)
(store_mfn 983037)
(device
(vif
(bridge eth0)
(mac 00:16:3e:00:2a:49)
(script /etc/xen/scripts/vif-bridge)
(uuid 55fdc200-264b-071f-6f9a-3f310a9eef09)
(backend 0)
)
)
(device
(vbd
(protocol x86_64-abi)
(uuid 6b42a822-3dab-6e9c-ac86-661be9d8f8e5)
(dev hda:disk)
(uname phy:/dev/sda11)
(mode w)
(backend 0)
(bootable 1)
(VDI )
)
)
(device
(vfb
(vncunused 1)
(type vnc)
(uuid 2366bafb-242b-4f5d-a685-d81a4b2794a3)
(location localhost:5900)
)
)
(device
(console
(protocol vt100)
(location 4)
(uuid 1a1fa007-0687-f4e6-0a7a-f2dada4dc85e)
)
)
(cpuid ((1 ((edx xxxxxxxxxxxxxx1xxxxxxxxxxxxxxxxx)))))
)
[root@ServerXen ~]# xm list -l S10U6
(domain
(domid 1)
(on_crash restart)
(uuid 24a31321-7e3e-dfae-498f-cfac71c66ab8)
(bootloader_args )
(vcpus 2)
(name S10U6)
(on_poweroff destroy)
(on_reboot restart)
(bootloader )
(maxmem 4096)
(memory 4096)
(shadow_memory 34)
(features )
(on_xend_start ignore)
(on_xend_stop ignore)
(start_time 1229685596.76)
(cpu_time 159.908389507)
(online_vcpus 2)
(image
(hvm
(kernel )
(hpet 0)
(stdvga 0)
(loader /usr/lib/xen/boot/hvmloader)
(serial pty)
(vncunused 1)
(boot c)
(rtc_timeoffset 0)
(pci ())
(pae 1)
(hap 1)
(acpi 1)
(localtime 0)
(timer_mode 0)
(vnc 1)
(nographic 0)
(guest_os_type default)
(apic 1)
(monitor 0)
(usbdevice tablet)
(device_model /usr/lib64/xen/bin/qemu-dm)
(usb 1)
(xauthority /tmp/.gdm4XFKMU)
(isa 0)
(display :0.0)
(notes (SUSPEND_CANCEL 1))
)
)
(status 2)
(state -b----)
(store_mfn 983037)
(device
(vif
(bridge eth0)
(mac 00:16:3e:00:2a:49)
(script /etc/xen/scripts/vif-bridge)
(uuid 55fdc200-264b-071f-6f9a-3f310a9eef09)
(backend 0)
)
)
(device
(vbd
(protocol x86_64-abi)
(uuid 6b42a822-3dab-6e9c-ac86-661be9d8f8e5)
(dev hda:disk)
(uname phy:/dev/sda11)
(mode w)
(backend 0)
(bootable 1)
(VDI )
)
)
(device
(vfb
(vncunused 1)
(type vnc)
(uuid 2366bafb-242b-4f5d-a685-d81a4b2794a3)
(location localhost:5900)
)
)
(device
(console
(protocol vt100)
(location 4)
(uuid 1a1fa007-0687-f4e6-0a7a-f2dada4dc85e)
)
)
(cpuid ((1 ((edx xxxxxxxxxxxxxx1xxxxxxxxxxxxxxxxx)))))
)






Install Intrepid Server PV DomU at opensolaris 2008.11 Dom0 (Intel) per Fred Oliver

December 16, 2008

Download script customize from [1] and make one fix to it:-

#! /bin/sh -x

#source_iso=/files/ubuntu-8.10-server-amd64.iso
source_iso=$1
dest_iso=ubuntu-8.10-server-amd64-pv.iso
remaster_dir=~/tmp
mkdir -p $remaster_dir

# libdir=/lib/modules/2.6.27-7-generic - this entry been modified
libdir=/lib/modules/2.6.27-7-server
driverdir=$libdir/kernel/drivers
modules_dep=$libdir/modules.dep

kbd_drv=input/xen-kbdfront.ko
blk_drv=block/xen-blkfront.ko
fb_drv=video/xen-fbfront.ko
net_drv=net/xen-netfront.ko

drivers="$kbd_drv $blk_drv $fb_drv $net_drv"
driver_dirs="input block video net"

uck-remaster-unpack-iso $source_iso
uck-remaster-unpack-initrd
vol_id=`dd bs=32k skip=1 count=1 < $source_iso | dd bs=8 skip=5 count=4`
mkdir $remaster_dir/customization-scripts
echo $vol_id PV > $remaster_dir/customization-scripts/iso_description

for driver_dir in $driver_dirs ; do
mkdir -p $remaster_dir/remaster-initrd$driverdir/$driver_dir
done

for driver in $drivers ; do
cp $driverdir/$driver $remaster_dir/remaster-initrd$driverdir/$driver
echo $driverdir/$driver: >> $remaster_dir/remaster-initrd$modules_dep
done

cat > $remaster_dir/remaster-initrd/usr/lib/finish-install.d/10console <<-EOF
#! /bin/sh -x
mkdir -p /target/etc/event.d
cat > /target/etc/event.d/hvc0 << XEOF
# hvc0 - getty
#
# This service maintains a getty on hvc0 from the point the system is
# started until it is shut down again.

start on stopped rc2
start on stopped rc3
start on stopped rc4
start on stopped rc5

stop on runlevel 0
stop on runlevel 1
stop on runlevel 6

respawn
exec /sbin/getty 38400 hvc0
XXEOF
EOF
chmod a+x $remaster_dir/remaster-initrd/usr/lib/finish-install.d/10console
uck-remaster-pack-initrd
uck-remaster-pack-iso $dest_iso

Prepare modified Intrepid Server ISO image at Intrepid Server HVM via uck scipts:-

root@IntrepidHVM:/files# ./customize
+ source_iso=/files/intrepidsrv.iso
+ dest_iso=ubuntu-8.10-server-amd64-pv.iso
+ remaster_dir=/root/tmp
+ mkdir -p /root/tmp
+ libdir=/lib/modules/2.6.27-7-server
+ driverdir=/lib/modules/2.6.27-7-server/kernel/drivers
+ modules_dep=/lib/modules/2.6.27-7-server/modules.dep
+ kbd_drv=input/xen-kbdfront.ko
+ blk_drv=block/xen-blkfront.ko
+ fb_drv=video/xen-fbfront.ko
+ net_drv=net/xen-netfront.ko
+ drivers=input/xen-kbdfront.ko block/xen-blkfront.ko video/xen-fbfront.ko net/xen-netfront.ko
+ driver_dirs=input block video net
+ uck-remaster-unpack-iso /files/intrepidsrv.iso
Removing ISO remastering dir...
Mounting ISO image...
Unpacking ISO image...
Unmounting ISO image...
+ uck-remaster-unpack-initrd
Removing initrd remastering dir...
Unpacking initrd image...
~/tmp/remaster-initrd /files
33796 blocks
/files
+ dd bs=32k skip=1 count=1
+ dd bs=8 skip=5 count=4
4+0 records in
4+0 records out
32 bytes (32 B) copied, 0.0751666 s, 0.4 kB/s
1+0 records in
1+0 records out
32768 bytes (33 kB) copied, 0.0584111 s, 561 kB/s
+ vol_id=Ubuntu-Server 8.10 amd64
+ mkdir /root/tmp/customization-scripts
mkdir: cannot create directory `/root/tmp/customization-scripts': File exists
+ echo Ubuntu-Server 8.10 amd64 PV
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/input
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/block
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/video
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/net
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko:
+ cat
+ chmod a+x /root/tmp/remaster-initrd/usr/lib/finish-install.d/10console
+ uck-remaster-pack-initrd
Packing initrd image...
~/tmp/remaster-initrd /files
34062 blocks
/files
+ uck-remaster-pack-iso ubuntu-8.10-server-amd64-pv.iso
Preparing directory for new files
Updating md5sums...
~/tmp/remaster-iso /files
/files
Packing ISO image...
ISO description set to: Ubuntu-Server 8.10 amd64 PV
/usr/lib/uck/remaster-live-cd.sh: line 418: mkisofs: command not found
Failed to pack ISO image, error=127
root@IntrepidHVM:/files# apt-get install mkisofs
Reading package lists... Done
Building dependency tree
Reading state information... Done
Note, selecting genisoimage instead of mkisofs
You might want to run `apt-get -f install' to correct these:
The following packages have unmet dependencies:
uck: Depends: gfxboot but it is not going to be installed
Depends: dialog but it is not going to be installed or
xdialog but it is not going to be installed or
zenity but it is not going to be installed or
kdebase-bin but it is not going to be installed
Depends: squashfs-tools (>= 2.0) but it is not going to be installed
Depends: dpkg-dev but it is not going to be installed
Depends: fakeroot but it is not going to be installed
E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution).

root@IntrepidHVM:/# apt-get -f install
Reading package lists... Done
Building dependency tree
Reading state information... Done
Correcting dependencies... Done
The following extra packages will be installed:
binutils build-essential dialog dpkg-dev fakeroot g++ g++-4.3 gcc gcc-4.3 genisoimage
gfxboot libc6-dev libfreetype6 libgomp1 libstdc++6-4.3-dev linux-libc-dev make
squashfs-tools
Suggested packages:
binutils-doc debian-keyring g++-multilib g++-4.3-multilib gcc-4.3-doc
libstdc++6-4.3-dbg gcc-multilib manpages-dev autoconf automake1.9 libtool flex bison
gdb gcc-doc gcc-4.3-multilib libmudflap0-4.3-dev gcc-4.3-locales libgcc1-dbg
libgomp1-dbg libmudflap0-dbg wodim cdrkit-doc gfxboot-theme-ubuntu gfxboot-theme-suse
gfxboot-theme-sles gfxboot-theme-nld glibc-doc libfreetype6-dev libstdc++6-4.3-doc
make-doc squashfs-source lzma-source
The following NEW packages will be installed:
binutils build-essential dialog dpkg-dev fakeroot g++ g++-4.3 gcc gcc-4.3 genisoimage
gfxboot libc6-dev libfreetype6 libgomp1 libstdc++6-4.3-dev linux-libc-dev make
squashfs-tools
0 upgraded, 18 newly installed, 0 to remove and 26 not upgraded.
1 not fully installed or removed.
Need to get 16.3MB of archives.
After this operation, 59.0MB of additional disk space will be used.
Do you want to continue [Y/n]? Y
Get:1 http://us.archive.ubuntu.com intrepid/main libfreetype6 2.3.7-2ubuntu1 [385kB]
Get:2 http://us.archive.ubuntu.com intrepid/main gfxboot 3.3.39-0ubuntu2 [82.9kB]
Get:3 http://us.archive.ubuntu.com intrepid/universe dialog 1.1-20080316-1 [275kB]
Get:4 http://us.archive.ubuntu.com intrepid/main genisoimage 9:1.1.8-1ubuntu1 [639kB]
Get:5 http://us.archive.ubuntu.com intrepid/main squashfs-tools 1:3.3-7ubuntu1 [123kB]
Get:6 http://us.archive.ubuntu.com intrepid/main make 3.81-5 [165kB]
Get:7 http://us.archive.ubuntu.com intrepid/main binutils 2.18.93.20081009-0ubuntu1 [1635kB]
Get:8 http://us.archive.ubuntu.com intrepid/main dpkg-dev 1.14.20ubuntu6 [612kB]
Get:9 http://us.archive.ubuntu.com intrepid/main fakeroot 1.9.5ubuntu1 [116kB]
Get:10 http://us.archive.ubuntu.com intrepid-updates/main linux-libc-dev 2.6.27-9.19 [653kB]
Get:11 http://us.archive.ubuntu.com intrepid/main libc6-dev 2.8~20080505-0ubuntu7 [2590kB]
Get:12 http://us.archive.ubuntu.com intrepid/main libgomp1 4.3.2-1ubuntu11 [15.6kB]
Get:13 http://us.archive.ubuntu.com intrepid/main gcc-4.3 4.3.2-1ubuntu11 [2790kB]
Get:14 http://us.archive.ubuntu.com intrepid/main gcc 4:4.3.1-1ubuntu2 [5108B]
Get:15 http://us.archive.ubuntu.com intrepid/main libstdc++6-4.3-dev 4.3.2-1ubuntu11 [1392kB]
Get:16 http://us.archive.ubuntu.com intrepid/main g++-4.3 4.3.2-1ubuntu11 [4819kB]
Get:17 http://us.archive.ubuntu.com intrepid/main g++ 4:4.3.1-1ubuntu2 [1446B]
Get:18 http://us.archive.ubuntu.com intrepid/main build-essential 11.4 [7170B]
Fetched 16.3MB in 5min31s (49.1kB/s)
Selecting previously deselected package libfreetype6.
(Reading database ... 19368 files and directories currently installed.)
Unpacking libfreetype6 (from .../libfreetype6_2.3.7-2ubuntu1_amd64.deb) ...
Selecting previously deselected package gfxboot.
Unpacking gfxboot (from .../gfxboot_3.3.39-0ubuntu2_amd64.deb) ...
Selecting previously deselected package dialog.
Unpacking dialog (from .../dialog_1.1-20080316-1_amd64.deb) ...
Selecting previously deselected package genisoimage.
Unpacking genisoimage (from .../genisoimage_9%3a1.1.8-1ubuntu1_amd64.deb) ...
Selecting previously deselected package squashfs-tools.
Unpacking squashfs-tools (from .../squashfs-tools_1%3a3.3-7ubuntu1_amd64.deb) ...
Selecting previously deselected package make.
Unpacking make (from .../archives/make_3.81-5_amd64.deb) ...
Selecting previously deselected package binutils.
Unpacking binutils (from .../binutils_2.18.93.20081009-0ubuntu1_amd64.deb) ...
Selecting previously deselected package dpkg-dev.
Unpacking dpkg-dev (from .../dpkg-dev_1.14.20ubuntu6_all.deb) ...
Selecting previously deselected package fakeroot.
Unpacking fakeroot (from .../fakeroot_1.9.5ubuntu1_amd64.deb) ...
Selecting previously deselected package linux-libc-dev.
Unpacking linux-libc-dev (from .../linux-libc-dev_2.6.27-9.19_amd64.deb) ...
Selecting previously deselected package libc6-dev.
Unpacking libc6-dev (from .../libc6-dev_2.8~20080505-0ubuntu7_amd64.deb) ...
Selecting previously deselected package libgomp1.
Unpacking libgomp1 (from .../libgomp1_4.3.2-1ubuntu11_amd64.deb) ...
Selecting previously deselected package gcc-4.3.
Unpacking gcc-4.3 (from .../gcc-4.3_4.3.2-1ubuntu11_amd64.deb) ...
Selecting previously deselected package gcc.
Unpacking gcc (from .../gcc_4%3a4.3.1-1ubuntu2_amd64.deb) ...
Selecting previously deselected package libstdc++6-4.3-dev.
Unpacking libstdc++6-4.3-dev (from .../libstdc++6-4.3-dev_4.3.2-1ubuntu11_amd64.deb) ...
Selecting previously deselected package g++-4.3.
Unpacking g++-4.3 (from .../g++-4.3_4.3.2-1ubuntu11_amd64.deb) ...
Selecting previously deselected package g++.
Unpacking g++ (from .../g++_4%3a4.3.1-1ubuntu2_amd64.deb) ...
Selecting previously deselected package build-essential.
Unpacking build-essential (from .../build-essential_11.4_amd64.deb) ...
Processing triggers for man-db ...
Setting up libfreetype6 (2.3.7-2ubuntu1) ...

Setting up gfxboot (3.3.39-0ubuntu2) ...
Setting up dialog (1.1-20080316-1) ...
Setting up genisoimage (9:1.1.8-1ubuntu1) ...
Setting up squashfs-tools (1:3.3-7ubuntu1) ...
Setting up make (3.81-5) ...
Setting up binutils (2.18.93.20081009-0ubuntu1) ...

Setting up dpkg-dev (1.14.20ubuntu6) ...
Setting up fakeroot (1.9.5ubuntu1) ...

Setting up uck (2.0.4) ...
Setting up linux-libc-dev (2.6.27-9.19) ...
Setting up libc6-dev (2.8~20080505-0ubuntu7) ...
Setting up libgomp1 (4.3.2-1ubuntu11) ...

Setting up gcc-4.3 (4.3.2-1ubuntu11) ...
Setting up gcc (4:4.3.1-1ubuntu2) ...

Setting up g++-4.3 (4.3.2-1ubuntu11) ...
Setting up libstdc++6-4.3-dev (4.3.2-1ubuntu11) ...
Setting up g++ (4:4.3.1-1ubuntu2) ...

Setting up build-essential (11.4) ...
Processing triggers for libc6 ...
ldconfig deferred processing now taking place

I had to rerun customize script due to uck refreshed

root@IntrepidHVM:/files# ./customize
+ source_iso=/files/intrepidsrv.iso
+ dest_iso=ubuntu-8.10-server-amd64-pv.iso
+ remaster_dir=/root/tmp
+ mkdir -p /root/tmp
+ libdir=/lib/modules/2.6.27-7-server
+ driverdir=/lib/modules/2.6.27-7-server/kernel/drivers
+ modules_dep=/lib/modules/2.6.27-7-server/modules.dep
+ kbd_drv=input/xen-kbdfront.ko
+ blk_drv=block/xen-blkfront.ko
+ fb_drv=video/xen-fbfront.ko
+ net_drv=net/xen-netfront.ko
+ drivers=input/xen-kbdfront.ko block/xen-blkfront.ko video/xen-fbfront.ko net/xen-netfront.ko
+ driver_dirs=input block video net
+ uck-remaster-unpack-iso /files/intrepidsrv.iso
Removing ISO remastering dir...
Mounting ISO image...
Unpacking ISO image...
Unmounting ISO image...
+ uck-remaster-unpack-initrd
Removing initrd remastering dir...
Unpacking initrd image...
~/tmp/remaster-initrd /files
33796 blocks
/files
+ dd bs=32k skip=1 count=1
+ dd bs=8 skip=5 count=4
4+0 records in
4+0 records out
32 bytes (32 B) copied, 0.221877 s, 0.1 kB/s
1+0 records in
1+0 records out
32768 bytes (33 kB) copied, 0.202118 s, 162 kB/s
+ vol_id=Ubuntu-Server 8.10 amd64
+ mkdir /root/tmp/customization-scripts
mkdir: cannot create directory `/root/tmp/customization-scripts': File exists
+ echo Ubuntu-Server 8.10 amd64 PV
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/input
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/block
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/video
+ mkdir -p /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/net
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/input/xen-kbdfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/block/xen-blkfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/video/xen-fbfront.ko:
+ cp /lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko /root/tmp/remaster-initrd/lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko
+ echo /lib/modules/2.6.27-7-server/kernel/drivers/net/xen-netfront.ko:
+ cat
+ chmod a+x /root/tmp/remaster-initrd/usr/lib/finish-install.d/10console
+ uck-remaster-pack-initrd
Packing initrd image...
~/tmp/remaster-initrd /files
34062 blocks
/files
+ uck-remaster-pack-iso ubuntu-8.10-server-amd64-pv.iso
Preparing directory for new files
Updating md5sums...
~/tmp/remaster-iso /files
/files
Packing ISO image...
ISO description set to: Ubuntu-Server 8.10 amd64 PV
Size of boot image is 4 sectors -> No emulation
1.50% done, estimate finish Sat Dec 13 12:18:19 2008
2.99% done, estimate finish Sat Dec 13 12:18:19 2008
4.49% done, estimate finish Sat Dec 13 12:18:19 2008
5.99% done, estimate finish Sat Dec 13 12:18:35 2008
. . . . . . . . . .
94.24% done, estimate finish Sat Dec 13 12:24:10 2008
95.74% done, estimate finish Sat Dec 13 12:24:14 2008
97.23% done, estimate finish Sat Dec 13 12:24:16 2008
98.73% done, estimate finish Sat Dec 13 12:24:25 2008
Total translation table size: 2048
Total rockridge attributes bytes: 312528
Total directory bytes: 1664680
Path table size(bytes): 13654
Max brk space used 2ec000
334250 extents written (652 MB)

Scp created ISO image to opensolaris 2008.11 Dom0
and create HVM DomU:-

# virt-install -n Ubuntu810HVM --hvm -r 1024 --vnc \
-f /dev/zvol/dsk/xvmpool/snv-disk -l /export/home/isos/ubuntu-8.10-server-amd64-pv.iso

Add new entry to /boot/menu.lst at HVM DomU:-

title Ubuntu 8.10, kernel 2.6.27-7-server (new)
kernel /boot/vmlinuz-2.6.27-7-server root=/dev/xvda1 ro 2 console=hvc0
initrd /boot/initrd.img-2.6.27-7-server

Download from [1] new versions of /usr/lib/xen/bin/pygrub and /usr/lib/fs/ext2fs/fsimage.so. This patches address issues mentioned in CRs:

http://bugs.opensolaris.org/view_bug.do?bug_id=6780879

http://bugs.opensolaris.org/view_bug.do?bug_id=6762035

http://bugs.opensolaris.org/view_bug.do?bug_id=6769739

and seems to be uncommitted at mean time.
Per Fred installation via virt-install works on AMD based boxes and fails on Intel. I’ve also tried virt-install on C2D box . Virt-install started , but appeared to fail attach to DomU modified ISO image. That’s why i’ve attempted to load Intrepid Server PV DomU via image been created by HVM installation.

boris@opensolaris:~$ pfexec xm dmesg
xVM version 3.1.4-xvm
(xVM) Command line:
(xVM) Video information:
(xVM) VGA is text mode 80x25, font 8x16
(xVM) VBE/DDC methods: none; EDID transfer time: 0 seconds
(xVM) EDID info not retrieved because no DDC retrieval method detected
(xVM) Disc information:
(xVM) Found 0 MBR signatures
(xVM) Found 2 EDD information structures
(xVM) Xen-e820 RAM map:
(xVM) 0000000000000000 - 000000000009ec00 (usable)
(xVM) 000000000009ec00 - 00000000000a0000 (reserved)
(xVM) 00000000000e4000 - 0000000000100000 (reserved)
(xVM) 0000000000100000 - 00000000cff80000 (usable)
(xVM) 00000000cff80000 - 00000000cff8e000 (ACPI data)
(xVM) 00000000cff8e000 - 00000000cffe0000 (ACPI NVS)
(xVM) 00000000cffe0000 - 00000000d0000000 (reserved)
(xVM) 00000000fee00000 - 00000000fee01000 (reserved)
(xVM) 00000000ffe00000 - 0000000100000000 (reserved)
(xVM) 0000000100000000 - 0000000230000000 (usable)
(xVM) System RAM: 8191MB (8387704kB)
(xVM) Xen heap: 14MB (14520kB)
(xVM) Domain heap initialised: DMA width 32 bits
(xVM) Processor #0 7:7 APIC version 20
(xVM) Processor #1 7:7 APIC version 20
(xVM) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(xVM) Enabling APIC mode: Flat. Using 1 I/O APICs
(xVM) Using scheduler: SMP Credit Scheduler (credit)
(xVM) Detected 3005.626 MHz processor.
(xVM) HVM: VMX enabled
(xVM) VMX: MSR intercept bitmap enabled
(xVM) CPU0: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping 06
(xVM) Booting processor 1/1 eip 90000
(xVM) CPU1: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping 06
(xVM) Total of 2 processors activated.
(xVM) ENABLING IO-APIC IRQs
(xVM) -> Using new ACK method
(xVM) Platform timer overflows in 14998 jiffies.
(xVM) Platform timer is 14.318MHz HPET
(xVM) Brought up 2 CPUs
(xVM) xenoprof: Initialization failed. Intel processor model 23 for P6 class family is not supported
(xVM) *** LOADING DOMAIN 0 ***
(xVM) Xen kernel: 64-bit, lsb, compat32
(xVM) Dom0 kernel: 64-bit, lsb, paddr 0x40000000 -> 0x40826ea8
(xVM) PHYSICAL MEMORY ARRANGEMENT:
(xVM) Dom0 alloc.: 0000000224000000->0000000228000000 (2013930 pages to be allocated)
(xVM) VIRTUAL MEMORY ARRANGEMENT:
(xVM) Loaded kernel: 0000000040000000->0000000040826ea8
(xVM) Init. ramdisk: 0000000040827000->0000000042341000
(xVM) Phys-Mach map: 0000000042341000->00000000432be750
(xVM) Start info: 00000000432bf000->00000000432bf49c
(xVM) Page tables: 00000000432c0000->00000000432dd000
(xVM) Boot stack: 00000000432dd000->00000000432de000
(xVM) TOTAL: 0000000040000000->0000000043400000
(xVM) ENTRY ADDRESS: 0000000040800000
(xVM) Dom0 has maximum 2 VCPUs
(xVM) Initrd len 0x1b1a000, start at 0x40827000
(xVM) Scrubbing Free RAM: .done.
(xVM) Xen trace buffers: disabled
(xVM) Std. Loglevel: Errors and warnings
(xVM) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(xVM) Xen is relinquishing VGA console.

# boris@opensolaris:~$ pfexec cat /export/home/vm/intrepid.cfg

memory = 2048
name ="IntrepidServerPV"
bootloader="/usr/lib/xen/bin/pygrub"
vif = [ ' ' ]
disk = [ 'phy:/dev/zvol/dsk/snvpool/snv-disk,xvda,w']

#boris@opensolaris:~$ pfexec xm create -c /export/home/vm/intrepid.cfg

pyGRUB version 0.6
┌────────────────────────────────────────────────────────────────────────┐
│ Ubuntu 8.10, kernel 2.6.27-7-server (new)
│ Ubuntu 8.10, kernel 2.6.27-7-server
│ Ubuntu 8.10, kernel 2.6.27-7-server (recovery mode)
│ Ubuntu 8.10, memtest86+

└────────────────────────────────────────────────────────────────────────┘
Use the ^ and v keys to select which entry is highlighted.
Press enter to boot the selected OS. 'e' to edit the
commands before booting, 'a' to modify the kernel arguments
before booting, or 'c' for a command line.

Will boot selected entry in 1 seconds

GZipped kernel probably begins at offset 13452
Started domain IntrepidServerPV
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Linux version 2.6.27-7-server (buildd@yellow) (gcc version 4.3.2 (Ubuntu 4.3.2-1ubuntu10) ) #1 SMP Fri Oct 24 07:20:47 UTC 2008 (Ubuntu 2.6.27-7.14-server)
[ 0.000000] Command line: root=/dev/xvda1 ro 2 console=hvc0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] ACPI in unprivileged domain disabled
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable)
[ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved)
[ 0.000000] Xen: 0000000000100000 - 000000000241e000 (usable)
[ 0.000000] Xen: 000000000241e000 - 0000000002821000 (reserved)
[ 0.000000] Xen: 0000000002821000 - 0000000080000000 (usable)
[ 0.000000] last_pfn = 0x80000 max_arch_pfn = 0x3ffffffff
[ 0.000000] init_memory_mapping
[ 0.000000] last_map_addr: 80000000 end: 80000000
[ 0.000000] RAMDISK: 008b7000 - 0241e000
[ 0.000000] DMI not present or invalid.
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at 0000000000000000-0000000080000000
[ 0.000000] Bootmem setup node 0 0000000000000000-0000000080000000
[ 0.000000] NODE_DATA [0000000000001000 - 0000000000005fff]
[ 0.000000] bootmap [0000000000008000 - 0000000000017fff] pages 10
[ 0.000000] (6 early reservations) ==> bootmem [0000000000 - 0080000000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #2 [0002821000 - 000283a000] XEN PAGETABLES ==> [0002821000 - 000283a000]
[ 0.000000] #3 [0000200000 - 00008b6f9c] TEXT DATA BSS ==> [0000200000 - 00008b6f9c]
[ 0.000000] #4 [00008b7000 - 000241e000] RAMDISK ==> [00008b7000 - 000241e000]
[ 0.000000] #5 [000283a000 - 0002c21000] PGTABLE ==> [000283a000 - 0002c21000]
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000000 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00100000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[3] active PFN ranges
[ 0.000000] 0: 0x00000000 -> 0x000000a0
[ 0.000000] 0: 0x00000100 -> 0x0000241e
[ 0.000000] 0: 0x00002821 -> 0x00080000
[ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] No local APIC present
[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
[ 0.000000] PM: Registered nosave memory: 000000000241e000 - 0000000002821000
[ 0.000000] Allocating PCI resources starting at 88000000 (gap: 80000000:80000000)
[ 0.000000] PERCPU: Allocating 64928 bytes of per cpu data
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 513252
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: root=/dev/xvda1 ro 2 console=hvc0
[ 0.000000] Initializing CPU#0
[ 0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 0.000000] Detected 3005.552 MHz processor.
[ 0.010000] Console: colour dummy device 80x25
[ 0.010000] console [tty0] enabled
[ 0.010000] console [hvc0] enabled
[ 0.010000] Checking aperture...
[ 0.010000] No AGP bridge found
[ 0.010000] Memory: 2020552k/2097152k available (3110k kernel code, 72108k reserved, 1573k data, 536k init)
[ 0.010000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.010000] installing Xen timer for CPU 0
[ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6011.10 BogoMIPS (lpj=30055520)
[ 0.010000] Security Framework initialized
[ 0.010000] SELinux: Disabled at boot.
[ 0.010000] AppArmor: AppArmor initialized
[ 0.010000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.010000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.010000] Mount-cache hash table entries: 256
[ 0.010043] Initializing cgroup subsys ns
[ 0.010049] Initializing cgroup subsys cpuacct
[ 0.010053] Initializing cgroup subsys memory
[ 0.010079] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.010083] CPU: L2 cache: 6144K
[ 0.010089] CPU 0/0 -> Node 0
[ 0.010093] CPU: Physical Processor ID: 0
[ 0.010096] CPU: Processor Core ID: 0
[ 0.010114] SMP alternatives: switching to UP code
[ 0.027768] Freeing SMP alternatives: 24k freed
[ 0.027843] cpu 0 spinlock event irq 1
[ 0.027913] Brought up 1 CPUs
[ 0.028166] net_namespace: 1552 bytes
[ 0.028173] Booting paravirtualized kernel on Xen
[ 0.028176] Xen version: 3.1.4-xvm
[ 0.028279] Grant table initialized
[ 0.048317] Time: 165:165:165 Date: 165/165/65
[ 0.048367] NET: Registered protocol family 16
[ 0.060134] PCI: Fatal: No config space access function found
[ 0.060860] ACPI: Interpreter disabled.
[ 0.060865] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 0.060897] pnp: PnP ACPI: disabled
[ 0.060908] xen_balloon: Initialising balloon driver.
[ 0.060908] PCI: System does not support PCI
[ 0.060908] PCI: System does not support PCI
[ 0.100108] NET: Registered protocol family 8
[ 0.100119] NET: Registered protocol family 20
[ 0.100200] NetLabel: Initializing
[ 0.100204] NetLabel: domain hash size = 128
[ 0.100208] NetLabel: protocols = UNLABELED CIPSOv4
[ 0.100225] NetLabel: unlabeled traffic allowed by default
[ 0.100233] PCI-GART: No AMD northbridge found.
[ 0.100558] tracer: 1286 pages allocated for 65536 entries of 80 bytes
[ 0.100562] actual entries 65586
[ 0.100646] AppArmor: AppArmor Filesystem Enabled
[ 0.101093] NET: Registered protocol family 2
[ 0.190172] IP route cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.191187] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[ 0.193192] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.193674] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.193679] TCP reno registered
[ 0.220117] NET: Registered protocol family 1
[ 0.220201] checking if image is initramfs... it is
[ 0.238404] Freeing initrd memory: 28060k freed
[ 0.246884] platform rtc_cmos: registered platform RTC device (no PNP device found)
[ 0.247311] audit: initializing netlink socket (disabled)
[ 0.247327] type=2000 audit(1229409774.250:1): initialized
[ 0.253224] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.255981] VFS: Disk quotas dquot_6.5.1
[ 0.256069] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.256173] msgmni has been set to 4150
[ 0.256285] io scheduler noop registered
[ 0.256290] io scheduler anticipatory registered
[ 0.256302] io scheduler deadline registered (default)
[ 0.256427] io scheduler cfq registered
[ 0.287268] Linux agpgart interface v0.103
[ 0.287286] Serial: 8250/16550 driver4 ports, IRQ sharing enabled
[ 0.290803] brd: module loaded
[ 0.290881] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.291066] PNP: No PS/2 controller found. Probing ports directly.
[ 0.291893] i8042.c: No controller found.
[ 0.310198] mice: PS/2 mouse device common for all mice
[ 0.310257] rtc_cmos: probe of rtc_cmos failed with error -16
[ 0.310344] cpuidle: using governor ladder
[ 0.310348] cpuidle: using governor menu
[ 0.310600] TCP cubic registered
[ 0.310617] IO APIC resources could be not be allocated.
[ 0.310794] registered taskstats version 1
[ 0.310805] XENBUS: Device with no driver: device/vbd/51712
[ 0.310809] XENBUS: Device with no driver: device/vif/0
[ 0.310812] XENBUS: Device with no driver: device/console/0
[ 0.310824] Magic number: 1:252:3141

[ 0.310915] /build/buildd/linux-2.6.27/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 0.310921] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 0.310925] EDD information not available.
[ 0.310944] Freeing unused kernel memory: 536k freed
[ 0.311098] Write protecting the kernel read-only data: 4344k
Loading, please wait...
Couldnt get a file descriptor referring to the console
Begin: Loading essential drivers... ...
[ 0.387912] fuse init (API version 7.9)
[ 0.441089] thermal: Unknown symbol acpi_processor_set_thermal_limit
Done.
Begin: Running /scripts/init-premount ...
Done.
Begin: Mounting root file system... ...
Begin: Running /scripts/local-top ...
Done.
Begin: Waiting for root file system... ...
[ 0.623961] blkfront: xvda: barriers enabled
[ 0.624340] xvda: xvda1 xvda2
Done.
Begin: Running /scripts/local-premount ...
Begin: Waiting for resume device... ...
Done.
Done.
[ 6.393897] kjournald starting. Commit interval 5 seconds
[ 6.393915] EXT3-fs: mounted filesystem with ordered data mode.
Begin: Running /scripts/local-bottom ...
Done.
Done.
Begin: Running /scripts/init-bottom ...
Done.
* Reading files needed to boot... [ OK ]
* Setting preliminary keymap... [ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Tue Dec 16 06:43:00 UTC 2008
* Starting basic networking... [ OK ]
* Starting kernel event manager... [ 6.828806] udevd version 124 started
[ OK ]
* Loading hardware drivers... [ 7.446305] input: PC Speaker as /devices/platform/pcspkr/input/input1
[ 7.463570] Initialising Xen virtual ethernet driver.
[ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Tue Dec 16 06:43:02 UTC 2008
* Loading kernel modules... [ 8.419688] loop: module loaded
[ 8.467406] lp: driver loaded but no devices found
[ OK ]
* Setting kernel variables (/etc/sysctl.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-console-messages.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-network-security.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-process-security.conf)... [ OK ]
* Setting kernel variables (/etc/sysctl.d/10-tcp-timestamps-workaround.c[ OK ]
* Setting kernel variables (/etc/sysctl.d/30-tracker.conf)... [ OK ]
* Activating swap... [ OK ]
* Checking root file system... fsck 1.41.3 (12-Oct-2008)
/dev/xvda1: clean, 124022/1444608 files, 810734/5767168 blocks
[ OK ]
* Checking file systems... fsck 1.41.3 (12-Oct-2008)
[ OK ]
* Mounting local filesystems... [ OK ]
* Activating swapfile swap... [ OK ]
$Mounting securityfs on /sys/kernel/security: done.
Loading AppArmor profiles : done.
* Skipping firewall: ufw (not enabled)... [ OK ]
* Configuring network interfaces... [ OK ]
* Setting up console font and keymap... [ OK ]
* Starting system log daemon... [ OK ]
* Doing Wacom setup... cat: */id: No such file or directory
[ OK ]
* Starting kernel log daemon... [ OK ]
* Starting system message bus dbus [ OK ]
* Starting Avahi mDNS/DNS-SD Daemon avahi-daemon [ OK ]
* Starting OpenBSD Secure Shell server sshd [ OK ]
* Starting Common Unix Printing System: cupsd [ OK ]
* Starting powernowd... * CPU frequency scaling not supported... [ OK ]
* Starting internet superserver xinetd [ OK ]
* Starting Hardware abstraction layer hald [ OK ]
* Starting bluetooth [ OK ]
[ 25.642563] pan0: Dropping NETIF_F_UFO since no NETIF_F_HW_CSUM feature.
* Starting NetworkManager... [ OK ]
* Starting GNOME Display Manager... [ OK ]
* Starting System Tools Backends system-tools-backends [ OK ]
* Starting anac(h)ronistic cron anacron [ OK ]
* Starting deferred execution scheduler atd [ OK ]
* Starting periodic command scheduler crond [ OK ]
* Enabling additional executable binary formats binfmt-support [ OK ]
* Checking battery state... [ OK ]

Ubuntu 8.10 IntrepidUCKPV hvc0

IntrepidUCKPV login: root
Password:
Last login: Tue Dec 16 03:20:34 EST 2008 on hvc0
Linux IntrepidUCKhvm 2.6.27-7-server #1 SMP Fri Oct 24 07:20:47 UTC 2008 x86_64

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To access official Ubuntu documentation, please visit:

http://help.ubuntu.com/

root@IntrepidUCKPV:~# ssh boris@192.168.1.33
Password:
Last login: Tue Dec 16 09:37:01 2008 from 192.168.1.44
Sun Microsystems Inc. SunOS 5.11 snv_101b November 2008
root@IntrepidUCKPV:~# ssh boris@192.168.1.33
Password:
Last login: Tue Dec 16 09:37:01 2008 from 192.168.1.44
Sun Microsystems Inc. SunOS 5.11 snv_101b November 2008
boris@opensolaris:~$ pfexec xm list
Name ID Mem VCPUs State Time(s)
Domain-0 0 6002 2 r----- 277.0
F9PV 1024 1 63.8
IntrepidHVM 1024 1 106.2
IntrepidHVMuck 2048 1 36.0
IntrepidServerPV 4 2048 1 -b---- 6.8
UbuntuHVM 2048 1 40.5
boris@opensolaris:~$ pfexec xm list -l IntrepidServerPV
(domain
(domid 4)
(on_crash restart)
(uuid c3c19ab1-1a70-4125-81ce-5dd3961a09ff)
(bootloader_args )
(vcpus 1)
(name IntrepidServerPV)
(on_poweroff destroy)
(on_reboot restart)
(bootloader /usr/lib/xen/bin/pygrub)
(maxmem 2048)
(memory 2048)
(shadow_memory 0)
(cpu_weight 256)
(cpu_cap 0)
(features )
(on_xend_start ignore)
(on_xend_stop shutdown)
(start_time 1229409773.48)
(cpu_time 6.810482073)
(online_vcpus 1)
(image
(linux
(kernel )
(rtc_timeoffset 0)
(notes
(HV_START_LOW 18446603336221196288)
(FEATURES '!writable_page_tables|pae_pgdir_above_4gb')
(VIRT_BASE 18446744071562067968)
(GUEST_VERSION 2.6)
(PADDR_OFFSET 0)
(GUEST_OS linux)
(HYPERCALL_PAGE 18446744071564201984)
(LOADER generic)
(SUSPEND_CANCEL 1)
(PAE_MODE yes)
(ENTRY 18446744071569531392)
(XEN_VERSION xen-3.0)
)
)
)
(status 2)
(state -b----)
(store_mfn 2100260)
(console_mfn 2100258)
(device
(vif
(mac 00:16:3e:77:08:11)
(script vif-vnic)
(uuid 370e6eb8-78c2-d70b-5a51-0de5e88a413c)
(backend 0)
)
)
(device
(vbd
(uname phy:/dev/zvol/dsk/snvpool/snv-disk)
(uuid ec157599-9a4c-fd25-d59b-884f607ac904)
(mode w)
(dev xvda:disk)
(backend 0)
(bootable 1)
)
)
(device
(console
(protocol vt100)
(location 2)
(uuid 7144437c-a4b5-6ef0-cba5-53aae2d41a32)
)
)
)






References
1.Install Ubuntu 8.10 PV guest from (new) CD image


Ubuntu Hardy HVM vs PV DomU at opensolaris 2008.11 Dom0

December 11, 2008

Notice that installation Ubuntu HVM and runtime performance at opensolaris 2008.11 Dom0 is extremely low versus same HVM perfomance at Xen 3.3.1 openSUSE 11.1 Dom0 on the same box with C2D E8400 and 8 GB RAM. Actually, Linux as well as Nevada HVM DomUs demonstrate very low performance even been installed on zvols. Paravirtual DomUs behave at opensolaris 2008.11 absolutely normal been installed on zvol’s images.

Start with install HVM on zvol (/dev/zvol/dsk/bigpool/disk3)





When done:-

# apt-get install build-essential
# apt-get install linux-image-xen

Download ethtool-6 package and install it with intend to disable checksums offloading on PV DomU with image on same zvol. Add one more entry to /boot/grub/menu.lst :-

default 0
# hidemenu
timeout 10
title Ubuntu 8.04.1, kernel 2.6.24-22-xen
root (hd0,0)
kernel /boot/vmlinuz-2.6.24-22-xen root=UUID=d60fdbd1-29a5-452e-81b8-20af8423cb33 ro
initrd /boot/initrd.img-2.6.24-22-xen

title Ubuntu 8.04.1, kernel 2.6.24-19-generic
root (hd0,0)
kernel /boot/vmlinuz-2.6.24-19-generic root=UUID=d60fdbd1-29a5-452e-81b8-20af8423cb33 ro quiet splash
initrd /boot/initrd.img-2.6.24-19-generic
quiet

Add a console on xvc0:

# sed -e ’s/tty1/xvc0/’ /etc/event.d/tty1 | tee /etc/event.d/xvc0

Shutdown HVM DomU.
Create Ubuntu PV DomU profile at Dom0, referencing same image file as Ubuntu HVM DomU:-

name = "UbuntuPV"
memory = 2048
disk = [ 'phy:/dev/zvol/dsk/bigpool/disk3,hda,w']
vif = [ ' ' ]

Start PV DomU:-

root@opensolaris:/export/home/vm# xm create -c ub8.py





Started domain UbuntuPV
[ 0.000000] Linux version 2.6.24-22-xen (buildd@crested) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) #1 SMP Mon Nov 24 21:35:54 UTC 2008 (Ubuntu 2.6.24-4.6-generic)
[ 0.000000] Command line: root=UUID=0719122c-ad35-421e-a5bb-2781384d7fc0
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] Xen: 0000000000000000 - 0000000080800000 (usable)
[ 0.000000] end_pfn_map = 526336
[ 9603.583251] Zone PFN ranges:
[ 9603.583252] DMA 0 -> 4096
[ 9603.583253] DMA32 4096 -> 1048576
[ 9603.583254] Normal 1048576 -> 1048576
[ 9603.583255] Movable zone start PFN for each node
[ 9603.583256] early_node_map[1] active PFN ranges
[ 9603.583257] 0: 0 -> 526336
[ 9603.611871] No mptable found.
[ 9603.615908] PERCPU: Allocating 22368 bytes of per cpu data
[ 9603.615925] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 519140
[ 9603.615927] Kernel command line: root=UUID=0719122c-ad35-421e-a5bb-2781384d7fc0
[ 9603.616246] Initializing CPU#0
[ 9603.616406] PID hash table entries: 4096 (order: 12, 32768 bytes)
[ 9603.616440] Xen reported: 3005.552 MHz processor.
[ 0.153012] console [xvc0] enabled
[ 0.153041] Console: colour dummy device 80x25
[ 0.153632] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[ 0.154072] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.154201] Software IO TLB disabled
[ 0.167178] Memory: 2027452k/2105344k available (2532k kernel code, 69052k reserved, 1332k data, 220k init)
[ 0.233731] Calibrating delay using timer specific routine.. 6013.68 BogoMIPS (lpj=12027368)
[ 0.233764] Security Framework initialized
[ 0.233770] SELinux: Disabled at boot.
[ 0.233775] AppArmor: AppArmor initialized
[ 0.233778] Failure registering capabilities with primary security module.
[ 0.233788] Mount-cache hash table entries: 256
[ 0.233884] CPU: L1 I cache: 32K, L1 D cache: 32K
[ 0.233887] CPU: L2 cache: 6144K
[ 0.233893] CPU: Physical Processor ID: 0
[ 0.233894] CPU: Processor Core ID: 1
[ 0.233899] SMP alternatives: switching to UP code
[ 0.234513] Freeing SMP alternatives: 23k freed
[ 0.234593] Early unpacking initramfs... done
[ 0.247514] Brought up 1 CPUs
[ 0.247868] net_namespace: 120 bytes
[ 0.247871] failed to set up cpufreq notifier
[ 0.265754] Time: 165:165:165 Date: 165/165/65
[ 0.265774] NET: Registered protocol family 16
[ 0.277566] Brought up 1 CPUs
[ 0.277577] PCI: Fatal: No config space access function found
[ 0.277579] PCI: setting up Xen PCI frontend stub
[ 0.277943] ACPI: Interpreter disabled.
[ 0.277947] Linux Plug and Play Support v0.97 (c) Adam Belay
[ 0.277966] pnp: PnP ACPI: disabled
[ 0.278261] xen_mem: Initialising balloon driver.
[ 0.279111] Setting mem allocation to 2097152 kiB
[ 0.279279] PCI: System does not support PCI
[ 0.279282] PCI: System does not support PCI
[ 0.293390] NET: Registered protocol family 8
[ 0.293394] NET: Registered protocol family 20
[ 0.293447] AppArmor: AppArmor Filesystem Enabled
[ 0.293695] NET: Registered protocol family 2
[ 0.297369] Time: xen clocksource has been installed.
[ 0.329139] IP route cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.329332] TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
[ 0.330547] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 0.330911] TCP: Hash tables configured (established 262144 bind 65536)
[ 0.330913] TCP reno registered
[ 0.341195] checking if image is initramfs... it is
[ 0.357939] Freeing initrd memory: 23692k freed
[ 0.365241] audit: initializing netlink socket (disabled)
[ 0.365256] audit(1228988849.828:1): initialized
[ 0.365431] VFS: Disk quotas dquot_6.5.1
[ 0.365444] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.365494] io scheduler noop registered
[ 0.365496] io scheduler anticipatory registered
[ 0.365498] io scheduler deadline registered
[ 0.365502] io scheduler cfq registered (default)
[ 0.365635] Xen virtual console successfully installed as xvc0
[ 0.365665] Event-channel device installed.
[ 0.371631] Successfully initialized TPM backend driver.
[ 0.378447] netfront: Initialising virtual ethernet driver.
[ 0.379147] xen-vbd: registered block device major 3
[ 0.379160] blkfront: hda: barriers enabled
[ 0.379559] hda: hda1 hda2
[ 0.394525] rtc: IRQ 8 is not free.
[ 0.394573] Linux agpgart interface v0.102
[ 0.394911] RAMDISK driver initialized: 16 RAM disks of 65536K size 1024 blocksize
[ 0.394953] input: Macintosh mouse button emulation as /devices/virtual/input/input0
[ 0.395021] PNP: No PS/2 controller found. Probing ports directly.
[ 0.395840] i8042.c: No controller found.
[ 0.397153] mice: PS/2 mouse device common for all mice
[ 0.397176] cpuidle: using governor ladder
[ 0.397221] NET: Registered protocol family 1
[ 0.397255] registered taskstats version 1
[ 0.496912] XENBUS: Device with no driver: device/console/0
[ 0.496933] Magic number: 1:252:3141
[ 0.497030] /build/buildd/linux-2.6.24/debian/build/custom-source-xen/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[ 0.497042] Freeing unused kernel memory: 220k freed
Loading, please wait...
Begin: Loading essential drivers... ...
[ 0.718644] fuse init (API version 7.9)
[ 0.741243] thermal: Unknown symbol acpi_processor_set_thermal_limit
Done.
Begin: Running /scripts/init-premount ...
Done.
Begin: Mounting root file system... ...
Begin: Running /scripts/local-top ...
ata_id[1212]: main: HDIO_GET_IDENTITY failed for '/dev/.tmp-3-0'
Done.
Begin: Waiting for root file system... ...
Done.
Begin: Running /scripts/local-premount ...
Done.
[ 1.362433] kjournald starting. Commit interval 5 seconds
[ 1.362441] EXT3-fs: mounted filesystem with ordered data mode.
Begin: Running /scripts/local-bottom ...
Done.
Done.
Begin: Running /scripts/init-bottom ...
Done.
* Reading files needed to boot... [ OK ]
* Setting preliminary keymap... [ OK ]
* Preparing restricted drivers... [ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Thu Dec 11 09:47:31 UTC 2008
* Starting basic networking... [ OK ]
* Starting kernel event manager... [ OK ]
* Loading hardware drivers... ata_id[2237]: main: HDIO_GET_IDENTITY failed for '/dev/.tmp-3-0'
[ OK ]
* Setting the system clock
Cannot access the Hardware Clock via any known method.
Use the --debug option to see the details of our search for an access method.
* Unable to set System Clock to: Thu Dec 11 09:47:32 UTC 2008
* Loading kernel modules... * Loading manual drivers... [ 2.694121] lp: driver loaded but no devices found
[ OK ]
* Setting kernel variables... [ OK ]
* Activating swap... [ OK ]
* Checking root file system... fsck 1.40.8 (13-Mar-2008)
/dev/hda1: clean, 111149/942080 files, 650438/3755185 blocks
[ OK ]
* Checking file systems... fsck 1.40.8 (13-Mar-2008)
[ OK ]
* Mounting local filesystems... [ OK ]
* Activating swapfile swap... [ OK ]
$Mounting securityfs on /sys/kernel/security: done.
Loading AppArmor profiles : done.
* Checking minimum space in /tmp... [ OK ]
* Skipping firewall: ufw (not enabled)... [ OK ]
* Configuring network interfaces... [ OK ]
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
* Starting system log daemon... [ OK ]
* Doing Wacom setup... cat: */id: No such file or directory
[ OK ]
* Starting kernel log daemon... [ OK ]
* Starting system message bus dbus [ OK ]
* Starting network connection manager NetworkManager [ OK ]
* Starting network events dispatcher NetworkManagerDispatcher [ OK ]
* Starting System Tools Backends system-tools-backends [ OK ]
* Starting Avahi mDNS/DNS-SD Daemon avahi-daemon [ OK ]
* Starting Common Unix Printing System: cupsd [ OK ]
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
* Starting powernowd... * CPU frequency scaling not supported... [ OK ]
* Starting DHCP D-Bus daemon dhcdbd [ OK ]
* Starting Hardware abstraction layer hald [ OK ]
* Starting bluetooth [ OK ]
* Starting GNOME Display Manager... [ OK ]
* Starting anac(h)ronistic cron anacron [ OK ]
* Starting deferred execution scheduler atd [ OK ]
* Starting periodic command scheduler crond [ OK ]
* Checking battery state... /dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
/dev/mem: mmap: Bad address
[ OK ]
* Running local boot scripts (/etc/rc.local) [ OK ]

Ubuntu 8.04.1 boris-desktop xvc0
boris-desktop login: root
Password:
Linux boris-desktop 2.6.24-22-xen #1 SMP Mon Nov 24 21:35:54 UTC 2008 x86_64

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

To access official Ubuntu documentation, please visit:

http://help.ubuntu.com/

root@boris-desktop:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:3e:2c:8e:15
inet addr:192.168.1.63 Bcast:192.168.1.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5 errors:0 dropped:0 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1642 (1.6 KB) TX bytes:4552 (4.4 KB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

root@boris-desktop:~# /usr/local/sbin/ethtool -K eth0 tx off
root@boris-desktop:~# apt-get remove network-manager
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages will be REMOVED:
network-manager network-manager-gnome
0 upgraded, 0 newly installed, 2 to remove and 185 not upgraded.
After this operation, 2626kB disk space will be freed.
Do you want to continue [Y/n]? Y
(Reading database ... 99473 files and directories currently installed.)
Removing network-manager-gnome ...
Removing network-manager ...
* Stopping network connection manager NetworkManager [ OK ]
* Stopping network events dispatcher NetworkManagerDispatcher [ OK ]
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

root@boris-desktop:~# cat "auto eth0" >> /etc/network/interfaces
cat: auto eth0: No such file or directory
root@boris-desktop:~# echo "auto eth0" >> /etc/network/interfaces
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
root@boris-desktop:~# echo "iface eth0 inet dhcp" >> /etc/network/interfaces
root@boris-desktop:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp
root@boris-desktop:~# /etc/init.d/networking restart
* Reconfiguring network interfaces... There is already a pid file /var/run/dhclient.eth0.pid with pid 0
Internet Systems Consortium DHCP Client V3.0.6
Copyright 2004-2007 Internet Systems Consortium.
All rights reserved.
For info, please visit http://www.isc.org/sw/dhcp/

Listening on LPF/eth0/00:16:3e:2c:8e:15
Sending on LPF/eth0/00:16:3e:2c:8e:15
Sending on Socket/fallback
DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 4
DHCPOFFER of 192.168.1.63 from 192.168.1.1
DHCPREQUEST of 192.168.1.63 on eth0 to 255.255.255.255 port 67
DHCPACK of 192.168.1.63 from 192.168.1.1
bound to 192.168.1.63 -- renewal in 122354 seconds.
[ OK ]
root@boris-desktop:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:3e:2c:8e:15
inet addr:192.168.1.63 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::216:3eff:fe2c:8e15/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:20 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:2978 (2.9 KB) TX bytes:4453 (4.3 KB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

root@boris-desktop:~#

Add to /etc/rc.local :-

/usr/local/sbin/ethtool -K eth0 tx off

to disable checksum offloading at DomU (due to “rge” Solaris Driver at Dom0) and reboot.
Set up VNC at Ubuntu Hardy PV DOMU per [1]:-







References
1.Attempt of VNC setup on Ubuntu Hardy PV DomU at Xen 3.3 CentOS 5.2 Dom0 (all 64-bit)


xVM on opensolaris 2008.11

December 9, 2008

xVM on opensolaris 2008.11

My primary target was testing xVM performance at opensolaris 2008.11(based on 101b Nevada build). Solaris Nevada works smoothly with images located on UFS and zvols.Opensolaris 2008.11 requires only zvol as image devices for Xen Guests to be installed in reasonable time.I believe it’s a known issue caused by ZFS. From my standpoint the most impressive UI feature is Package Manager. It’s really helpful.

Install all members of Virtualization group via Package manager.




# cd /boot/grub/
# ln -s /rpool/boot/grub/menu.lst menu.lst

Add new entry to /boot/grub/menu.lst

title OpenSolaris 2008.11 snv_101b_rc2 X86 xVM
bootfs rpool/ROOT/opensolaris
kernel$ /boot/$ISADIR/xen.gz
module$ /platform/i86xpv/kernel/$ISADIR/unix /platform/i86xpv/kernel/$ISADIR/unix -B $ZFS-BOOTFS

Reboot into xen kernel and activate services as advised in [1]:-

# svcadm enable store
# svcadm enable xend
# svcadm enable console
# svcadm enable domains
# svcadm enable virtd

Make sure services are running:-

# svcs -a | grep xvm
online 13:45:52 svc:/system/xvm/vnc-config:default
online 13:45:53 svc:/system/xvm/store:default
online 13:46:03 svc:/system/xvm/xend:default
online 13:46:03 svc:/system/xvm/console:default
online 13:46:03 svc:/system/xvm/virtd:default
online 13:46:04 svc:/system/xvm/domains:default

One more test

xm info

To create zpool on Intel based PC run

root@opensolaris:~# format
Searching for disks...
The device does not support mode page 3 or page 4,
or the reported geometry info is invalid.
WARNING: Disk geometry is based on capacity data.
The current rpm value 0 is invalid, adjusting it to 3600
done
c4t1d0: configured with capacity of 232.87GB
AVAILABLE DISK SELECTIONS:
0. c4t0d0
/pci@0,0/pci1043,8277@1f,2/disk@0,0
1. c4t1d0
/pci@0,0/pci1043,8277@1f,2/disk@1,0
Specify disk (enter its number): 0
selecting c4t0d0
[disk formatted]
# format>fdisk

and create second (third) partition with type “Other OS “.

Total disk size is 30401 cylinders
Cylinder size is 16065 (512 byte) blocks
Cylinders
Partition Status Type Start End Length %
========= ====== ============ ===== === ====== ===
1 Active Solaris2 1 9136 9136 30
2 [-----] Other OS 9137 12136 3000 10
3 [-----] Linux native 12137 12149 13 0
4 [-----] EXT-DOS 12150 30400 18251 60


Creating zpool :-

# zpool create xvmpool c4t0d0p2 (3)
# zfs create -V 25G xvmpool/snv-disk

Log out root and run:-

$ pfexec virt-manager

Set installation partition to /dev/zvol/dsk/xvmpool/snv-disk
Attempt to use image file like /export/home/images/roo.img , located on ZFS will make virt-manager
(virt-install) performance unacceptable, at least through my experience.







CentOS 5.2 PV guest snapshots:-





References.
1.Getting xVM to work in Opensolaris 2008.05


Install SNV103 PV DomU with ZFS image at Xen 3.3.1 openSUSE 11.1 Dom0 (all 64-bit)

December 8, 2008

During installation phase we would have to drop to shell and undertake some special actions to prepare runtime profile.Pygrub won’t be able to load DomU utilizing ZFS based image. In particular, ZFS-ID of boot environment will be obtained to compose extra line in runtime profile.

Start install as usual via profile :-

name = 'Solaris103PV'
memory = '2048'
disk = [ 'file:/home/boris/snv103.iso,6:cdrom,r','phy:/dev/sdb12,0,w']
vif = [ 'bridge = br1' ]
bootloader = '/usr/bin/pygrub'
kernel = '/boot/platform/i86xpv/kernel/amd64/unix'
ramdisk = '/boot/amd64/x86.miniroot'
extra = '/platform/i86xpv/kernel/amd64/unix - nowin -B install_media=cdrom'

Select ZFS on image device and request manual reboot. At the end of package deployment phase drop to shell at DomU and run

# bootadm update-archive -R /a

Copy kernel and boot_archive off the image to Dom0

# /a/usr/bin/scp -S /a/usr/bin/ssh \
/a/platform/i86xpv/kernel/amd64/unix \
192.168.1.33:/etc/xen/nevada
# /a/usr/bin/scp -S /a/usr/bin/ssh \
/a/platform/i86pc/amd64/boot_archive \
192.168.1.33:/etc/xen/nevada

Get the ZFS-ID of the /ROOT/snv_103 zpool. First, find out the pool_guid.
Follow [1]:-

# zpool get guid rpool
# NAME PROPERTY VALUE SOURCE
rpool guid 17306096753167233998

************
Then run :-
************

bash-3.2# zdb -d -e 17306096753167233998
Dataset mos [META], ID 0, cr_txg 4, 1.74M, 131 objects
Dataset 17306096753167233998/swap [ZVOL], ID 37, cr_txg 15, 4.27M, 3 objects
Dataset 17306096753167233998/ROOT/snv_103 [ZPL], ID 57, cr_txg 31, 5.99G, 286127 objects
Dataset 17306096753167233998/ROOT [ZPL], ID 31, cr_txg 12, 18.0K, 4 objects
Dataset 17306096753167233998/dump [ZVOL], ID 43, cr_txg 18, 1.00G, 3 objects
Dataset 17306096753167233998/export/home [ZPL], ID 69, cr_txg 43, 18.0K, 4 objects
Dataset 17306096753167233998/export [ZPL], ID 63, cr_txg 40, 19.0K, 5 objects
Dataset 17306096753167233998 [ZPL], ID 16, cr_txg 1, 29.0K, 12 objects
# umount /a

******************************************************
Destroy DomU via “xm” and create runtime profile:-
******************************************************
name = “SNV103PV”
vcpus = 1
memory = “2048″
kernel = “/etc/xen/nevada/unix”
ramdisk = “/etc/xen/nevada/boot_archive”
extra = “/platform/i86xpv/kernel/amd64/unix – nowin -B bootpath=/xpvd/xdf@0:a -B console=xen -B zfs-bootfs=rpool/57″
disk = ['phy:/dev/sdb12,0,w']
vif = [ 'bridge=br1']
on_shutdown = “destroy”
on_reboot = “destroy”
on_crash = “destroy”
*************
Then run :-
*************

dhcppc0:/etc/xen/vm # uname -a
Linux dhcppc0 2.6.27.7-4-xen #1 SMP 2008-11-25 00:02:37 +0100 x86_64 x86_64 x86_64 GNU/Linux
dhcppc0:/etc/xen/vm # xm info|grep xen_
xen_major : 3
xen_minor : 3
xen_extra : .1_18494_03-1.2
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
xen_changeset : 18494
dhcppc0:/etc/xen/vm # xm create -c snv103zfs.run
Using config file "./snv103zfs.run".
Started domain SNV103PV
v3.3.1_18494_03-1.2 chgset '18494'
SunOS Release 5.11 Version snv_103 64-bit
Copyright 1983-2008 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
Hostname: dhcppc5
Reading ZFS config: done.
Mounting ZFS filesystems: (5/5)
syslogd: line 45: WARNING: loghost could not be resolved

dhcppc5 console login: root
Password:
Last login: Sun Dec 7 19:57:19 on console
Dec 8 05:17:46 dhcppc5 login: ROOT LOGIN /dev/console
Sun Microsystems Inc. SunOS 5.11 snv_103 November 2008
# bash
bash-3.2# df -h
Filesystem size used avail capacity Mounted on
rpool/ROOT/snv_103 15G 5.9G 7.1G 46% /
/devices 0K 0K 0K 0% /devices
/dev 0K 0K 0K 0% /dev
ctfs 0K 0K 0K 0% /system/contract
proc 0K 0K 0K 0% /proc
mnttab 0K 0K 0K 0% /etc/mnttab
swap 2.2G 424K 2.2G 1% /etc/svc/volatile
objfs 0K 0K 0K 0% /system/object
sharefs 0K 0K 0K 0% /etc/dfs/sharetab
/usr/lib/libc/libc_hwcap3.so.1
13G 5.9G 7.1G 46% /lib/libc.so.1
fd 0K 0K 0K 0% /dev/fd
swap 2.2G 40K 2.2G 1% /tmp
swap 2.2G 44K 2.2G 1% /var/run
rpool/export 15G 19K 7.1G 1% /export
rpool/export/home 15G 15M 7.1G 1% /export/home
rpool 15G 29K 7.1G 1% /rpool
bash-3.2# ifconfig -a
lo0: flags=2001000849 mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
xnf0: flags=201004843 mtu 1500 index 2
inet 192.168.1.38 netmask ffffff00 broadcast 192.168.1.255
ether 0:16:3e:42:f9:9
lo0: flags=2002000849 mtu 8252 index 1
inet6 ::1/128









References
1.Installing Opensolaris 2008.11 RC2 on a Linux (RedHat/Centos) dom0


Follow

Get every new post delivered to your Inbox.