build with SMP causes (multiple?) issues on my system

[Joe Love <joe@xxxxxxxxxxxxxxxx>]

I'm sorry if I come across as long-winded, but I figure it's better than 
having to respond with the same information anyway.

I have a dual p3-850mhz system with a L440GX+-based motherboard.  It has 
onboard ethernet (intel chipset), onboard scsi, with a AIC-7896 
controller, a 18gb u160 scsi harddrive, a generic IDE cdrom & a floppy.

Out of curiousity, I installed DragonFlyBSD on it, using the 1.0 livecd, 
and ran the installer to perform the installation.  Everything went 
smoothly, and dfbsd was installed.  The system at this point displayed 
no hiccups.

But, of course, it didn't have SMP enabled, so I followed steps 4+ on 
this page: http://www.dragonflybsd.org/docs/upgrade-freebsd.cgi which 
describes the part about grabbing the supfile, commenting out a couple 
lines, and building the source.  Prior to building the kernel, I went 
in, copied GENERIC to flaky, and edited the file, uncommenting the two 
lines for SMP (options SMP and options APIC_IO).  I rebuilt everything 
as described on that page, 'cept for using KERNCONF=flaky where appropriate.

Ok, so that's the background.  Upon reboot, the system got to the line 
"Additional TCP options:." at the end of the boot sequence, and stopped. 
 Tried banging on the keyboard a little; no response, not even lights 
from hitting numlock/capslock.  Later on, I booted the system to this 
point and tried to see if it would respond to ctl+alt+esc (which I had 
learned from GeekGod), since DDB was compiled in, but that didn't work 
either.  I had also tried to see if the computer's network connection 
was alive, but that was dead as well, it was quite locked up.  This is a 
repeatable scenario for me.

So, I went back in (after some aggrivation with booting the computer 
from a livecd, since vi nor ee wanted to agree with me when in 
single-user mode, but that's a side story), and removed the SMP from the 
kernel config, rebuilt it, and rebooted, and ran into my second issue. 
Upon trying to reboot (from single-user mode while SMP was enabled in 
the kernel), it attemped to perform the normal "Syncing discs .. " 
followed by numbers, often eventually repeating the same number over and 
over, and gives up.  It prints out the messages:

giving up on 1 buffers
Debugger("Busy buffer problem")
CPU1 stopping CPUs: 0x00000001
 stopped
Stopped at      Debugger+0x23:  mob    $0,in_Debugger.354

and then it enters the debugger (the same one from hitting ctl+alt+esc). 
 Now, when I was talking to GeekGod, it was suggested that I type 
"panic" followed by "reset".  So, I tried typing "panic" and was greeted 
by a very interesting screen of text which probably makes sense to 
someone, and the line "CHKTOKEN loop 1" repeating over and over and 
over.  At this point GeekGod suggested that I really need to send a bug 
report in, and that pretty much brings this up to speed.

I'd have liked to have given a dmesg output from the system when it 
boots with SMP normally (rather than in single-user mode) but as I 
mentioned above, it locks up before I ever have a chance to do that.

So, included here are dmesg outputs from the system when it runs 
normally without SMP, and with SMP in single-user mode.

-------------------
no-SMP normal boot:
-------------------
Copyright (c) 2003, 2004 The DragonFly Project.
Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
DragonFly 1.1-CURRENT #5: Fri Aug  6 01:03:42 CDT 2004
    root@:/usr/obj/usr/src/sys/flaky
TSC clock: 846450545 Hz, i8254 clock: 1193364 Hz
CPU: Intel Pentium III (846.32-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x683  Stepping = 3

Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 268369920 (262080K bytes)
avail memory = 252682240 (246760K bytes)
Preloaded elf kernel "/kernel" at 0xc0456000.
Preloaded elf module "/modules/acpi.ko" at 0xc0456238.
Pentium Pro MTRR support enabled
md0: Malloc disk
pcibios: BIOS version 2.10
Using $PIR table, 12 entries at 0xc00fdf00
npx0: <math processor> on motherboard
npx0: INT 16 interface
Using MMX optimized bcopy/copyin/copyout
acpi0: <PTLTD   RSDT> on motherboard
installed MI handler for int 9
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
pcib1: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib1: couldn't read bus number from cfg space
pcib1: trying bus number 1
pci1: <ACPI PCI bus> on pcib1
pcib2: <PCI to PCI bridge (vendor=1011 device=0023)> at device 15.0 on pci1
pci2: <PCI bus> on pcib2
isab0: <ACPI Generic ISA bridge> on acpi0
pcib0: <Intel 82443GX host to PCI bridge> at pcibus 0 on motherboard
pci0: <PCI bus> on pcib0
agp0: <Intel 82443GX host to PCI bridge> mem 0xf8000000-0xfbffffff at 
device 0.0 on pci0
pcib3: <Intel 82443GX (440 GX) PCI-PCI (AGP) bridge> at device 1.0 on pci0
pci3: <PCI bus> on pcib3
pcib4: <PCI to PCI bridge (vendor=1011 device=0023)> at device 15.0 on pci3
pci4: <PCI bus> on pcib4
ahc0: <Adaptec aic7896/97 Ultra2 SCSI adapter> port 0x2000-0x20ff mem 
0xf4100000-0xf4100fff irq 11 at device 12.0 on pci0
installed MI handler for int 11
aic7896/97: Ultra2 Wide Channel A, SCSI Id=7, 32/253 SCBs
ahc1: <Adaptec aic7896/97 Ultra2 SCSI adapter> port 0x2400-0x24ff mem 
0xf4101000-0xf4101fff irq 11 at device 12.1 on pci0
aic7896/97: Ultra2 Wide Channel B, SCSI Id=7, 32/253 SCBs
fxp0: <Intel 82559 Pro/100 Ethernet> port 0x2800-0x283f mem 
0xf4000000-0xf40fffff,0xf4102000-0xf4102fff irq 10 at device 14.0 on pci0
installed MI handler for int 10
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: MAC address: 00:d0:b7:a9:21:d4
isab1: <Intel 82371AB PCI to ISA bridge> at device 18.0 on pci0
isa0: <ISA bus> on isab1
atapci0: <Intel PIIX4 ATA33 controller> port 0x2860-0x286f at device 
18.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
installed MI handler for int 14
ata1: at 0x170 irq 15 on atapci0
installed MI handler for int 15
pci0: <Intel 82371AB/EB (PIIX4) USB controller> at 18.2 irq 10
pci0: <Intel 82371AB Power management controller> at 18.3
pci0: <Cirrus Logic GD5480 SVGA controller> at 20.0
pmtimer0 on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
installed MI handler for int 6
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
installed MI handler for int 1
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
installed MI handler for int 4
sio1: can't drain, serial port might not exist, disabling
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
installed MI handler for int 7
installed MI handler for int 0
acd0: CDROM <CREATIVE CD5233E> at ata0-master PIO4
Waiting 15 seconds for SCSI devices to settle
(ahc1:A:0:0): Target Initiated PPR
Mounting root from ufs:/dev/da0s1a
cd0 at ata0 bus 0 target 0 lun 0
cd0: <CREATIVE CD5233E 1.00> Removable CD-ROM SCSI-0 device
cd0: 16.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present
da0 at ahc1 bus 0 target 0 lun 0
da0: <WDIGTL WDE18310 ULTRA3 1.30> Fixed Direct Access SCSI-3 device
da0: 40.000MB/s transfers (20.000MHz, offset 31, 16bit)
da0: 17461MB (35761710 512 byte sectors: 255H 63S/T 2226C)
Loading configuration files.
. 
dumpon: crash dumps to /dev/da0s1b (13, 131073)
swapon: adding /dev/da0s1b as swap device
Starting file system checks:
WARNING: #da/0x20000 si_iosize_max=0, using DFLTPHYS.
/dev/da0s1a:
FILESYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1a:
clean, 152951 free
(103 frags, 19106 blocks, 0.0% fragmentation)
WARNING: #da/0x20003 si_iosize_max=0, using DFLTPHYS.
/dev/da0s1d:
FILESYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1d:
clean, 253751 free
(39 frags, 31714 blocks, 0.0% fragmentation)
WARNING: #da/0x20004 si_iosize_max=0, using DFLTPHYS.
/dev/da0s1e:
FILESYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1e:
clean, 254060 free
(20 frags, 31755 blocks, 0.0% fragmentation)
WARNING: #da/0x20005 si_iosize_max=0, using DFLTPHYS.
/dev/da0s1f:
FILESYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1f:
clean, 1684506 free
(1398 frags, 420777 blocks, 0.1% fragmentation)
WARNING: #da/0x20006 si_iosize_max=0, using DFLTPHYS.
/dev/da0s1g:
FILESYSTEM CLEAN; SKIPPING CHECKS
/dev/da0s1g:
clean, 7852491 free
(203 frags, 981536 blocks, 0.0% fragmentation)
Setting hostname: test.getsomewhere.net.
fxp0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
	inet 10.100.47.195 netmask 0xffffff00 broadcast 10.100.47.255
	inet6 fe80::2d0:b7ff:fea9:21d4%fxp0 prefixlen 64 tentative scopeid 0x1
	ether 00:d0:b7:a9:21:d4
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
	inet6 ::1 prefixlen 128
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
	inet 127.0.0.1 netmask 0xff000000
add net default: gateway 10.100.47.1
Additional routing options:
. 
Mounting NFS file systems:
. 
Building databases...
Checking for core dump...
WARNING: #da/0x20001 si_iosize_max=0, using DFLTPHYS.
savecore: no core dump
Generating host.conf.
 nfsiod
NFS access cache time=2
ELF ldconfig path: /usr/lib /usr/lib/gcc2 /usr/lib/gcc34 /usr/lib/compat 
/usr/local/lib
Starting local daemons:
. 
Updating motd.
Configuring syscons:
 blanktime
. 
Starting sshd.
Initial i386 initialization:
. 
Additional ABI support:
. 
Local package initialization:
. 
Additional TCP options:
. 

Fri Aug  6 01:22:01 CDT 2004



---------------------
SMP single-user mode:
---------------------
Copyright (c) 2003, 2004 The DragonFly Project.
Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
DragonFly 1.1-CURRENT #4: Thu Aug  5 23:42:41 CDT 2004
    root@xxxxxxxxxxxxxxxxxxxxx:/usr/obj/usr/src/sys/flaky
TSC clock: 846452806 Hz, i8254 clock: 1193367 Hz
CPU: Intel Pentium III (846.33-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x683  Stepping = 3

Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 268369920 (262080K bytes)
avail memory = 252592128 (246672K bytes)
Programming 24 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
DragonFly/MP: Multiprocessor motherboard
 cpu0 (BSP): apic id:  1, version: 0x00040011, at 0xfee00000
 cpu1 (AP):  apic id:  0, version: 0x00040011, at 0xfee00000
 io0 (APIC): apic id:  2, version: 0x00170011, at 0xfec00000
Preloaded elf kernel "/kernel" at 0xc046c000.
Preloaded elf module "/modules/acpi.ko" at 0xc046c238.
Pentium Pro MTRR support enabled
md0: Malloc disk
pcibios: BIOS version 2.10
Using $PIR table, 12 entries at 0xc00fdf00
npx0: <math processor> on motherboard
npx0: INT 16 interface
Using MMX optimized bcopy/copyin/copyout
acpi0: <PTLTD   RSDT> on motherboard
installed MI handler for int 9
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
pcib1: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib1: couldn't read bus number from cfg space
pcib1: trying bus number 1
pci1: <ACPI PCI bus> on pcib1
pcib2: <PCI to PCI bridge (vendor=1011 device=0023)> at device 15.0 on pci1
pci2: <PCI bus> on pcib2
isab0: <ACPI Generic ISA bridge> on acpi0
pcib0: <Intel 82443GX host to PCI bridge> at pcibus 0 on motherboard
pci0: <PCI bus> on pcib0
IOAPIC #0 intpin 19 -> irq 2
IOAPIC #0 intpin 21 -> irq 9
agp0: <Intel 82443GX host to PCI bridge> mem 0xf8000000-0xfbffffff at 
device 0.0 on pci0
pcib3: <Intel 82443GX (440 GX) PCI-PCI (AGP) bridge> at device 1.0 on pci0
pci3: <PCI bus> on pcib3
pcib4: <PCI to PCI bridge (vendor=1011 device=0023)> at device 15.0 on pci3
pci4: <PCI bus> on pcib4
ahc0: <Adaptec aic7896/97 Ultra2 SCSI adapter> port 0x2000-0x20ff mem 
0xf4100000-0xf4100fff irq 2 at device 12.0 on pci0
installed MI handler for int 2
aic7896/97: Ultra2 Wide Channel A, SCSI Id=7, 32/253 SCBs
ahc1: <Adaptec aic7896/97 Ultra2 SCSI adapter> port 0x2400-0x24ff mem 
0xf4101000-0xf4101fff irq 2 at device 12.1 on pci0
aic7896/97: Ultra2 Wide Channel B, SCSI Id=7, 32/253 SCBs
fxp0: <Intel 82559 Pro/100 Ethernet> port 0x2800-0x283f mem 
0xf4000000-0xf40fffff,0xf4102000-0xf4102fff irq 9 at device 14.0 on pci0
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: MAC address: 00:d0:b7:a9:21:d4
isab1: <Intel 82371AB PCI to ISA bridge> at device 18.0 on pci0
isa0: <ISA bus> on isab1
atapci0: <Intel PIIX4 ATA33 controller> port 0x2860-0x286f at device 
18.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
installed MI handler for int 14
ata1: at 0x170 irq 15 on atapci0
installed MI handler for int 15
pci0: <Intel 82371AB/EB (PIIX4) USB controller> at 18.2 irq 9
pci0: <Intel 82371AB Power management controller> at 18.3
pci0: <Cirrus Logic GD5480 SVGA controller> at 20.0
pmtimer0 on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
installed MI handler for int 6
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
installed MI handler for int 1
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
installed MI handler for int 4
sio1: can't drain, serial port might not exist, disabling
ppc0: parallel port not found.
installed MI handler for int 0
APIC_IO: Testing 8254 interrupt delivery
APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 
intpin 2
APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0
SMP: AP CPU #1 Launched!
acd0: CDROM <CREATIVE CD5233E> at ata0-master PIO4
Waiting 15 seconds for SCSI devices to settle
(ahc1:A:0:0): Target Initiated PPR
Mounting root from ufs:/dev/da0s1a
cd0 at ata0 bus 0 target 0 lun 0
cd0: <CREATIVE CD5233E 1.00> Removable CD-ROM SCSI-0 device
cd0: 16.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present
da0 at ahc1 bus 0 target 0 lun 0
da0: <WDIGTL WDE18310 ULTRA3 1.30> Fixed Direct Access SCSI-3 device
da0: 40.000MB/s transfers (20.000MHz, offset 31, 16bit)
da0: 17461MB (35761710 512 byte sectors: 255H 63S/T 2226C)
WARNING: / was not properly dismounted
WARNING: #da/0x20000 si_iosize_max=0, using DFLTPHYS.
WARNING: #da/0x20003 si_iosize_max=0, using DFLTPHYS.
WARNING: #da/0x20004 si_iosize_max=0, using DFLTPHYS.
WARNING: #da/0x20005 si_iosize_max=0, using DFLTPHYS.
WARNING: #da/0x20006 si_iosize_max=0, using DFLTPHYS.

(at this point, it gives you the /bin/sh prompt)


There's two lines in all of that which I find interesting, the first of 
which is the warnings:
WARNING: #da/0x20000 si_iosize_max=0, using DFLTPHYS.
and the second of which is on the APIC_IO part:
APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 
intpin 2
but, that could just be because they sound like bad things to me. :)

Any help from this point onwards would be very appreciated.  If you need 
any further information, I can reproduce the problems above rather 
easily, and can provide output in just about any format.

Thanks,
-Joe