Xorg-server 1.9 goes crazy tapping my cpu usage when I compile in a 32-bit chroot.  >60 % of the total CPU is going to Xorg rather than to gcc (running Gnome if that matters).  The htop screenshot below shows X and gdm using it.  I know that if I start gnome from init 3 without gdm the same problem occurs except htop just shows X as the culprit.

X :0

Further, packages fail to build when I run makepkg through X.  If I run it when I'm in init 3 without X at all the very same package successfully builds.

http://img440.imageshack.us/img440/4202/wtfwh.jpg

I entered the 32-bit chroot via: linux32 chroot /opt/arch32 /bin/bash

Here is the last bit of the log before the error:
gcc: vfork: Resource temporarily unavailable
make[3]: *** [drivers/dma/ioat/pci.o] Error 1
make[3]: *** Waiting for unfinished jobs....
  CC [M]  drivers/char/agp/ali-agp.o
  CC [M]  drivers/char/ipmi/ipmi_smic_sm.o
  CC [M]  drivers/char/agp/ati-agp.o
  CC [M]  drivers/char/ipmi/ipmi_bt_sm.o
gcc: vfork: Resource temporarily unavailable
make[3]: *** [drivers/char/agp/backend.o] Error 1
make[3]: *** Waiting for unfinished jobs....
  CC [M]  drivers/char/ipmi/ipmi_watchdog.o
make[2]: *** [drivers/dma/ioat] Error 2
make[1]: *** [drivers/dma] Error 2
  CC [M]  drivers/char/ipmi/ipmi_poweroff.o
  LD      drivers/char/mwave/built-in.o
  CC [M]  drivers/char/mwave/mwavedd.o
make[2]: *** [drivers/char/agp] Error 2
make[2]: *** Waiting for unfinished jobs....
  LD [M]  drivers/char/ipmi/ipmi_si.o
  CC [M]  drivers/char/mwave/smapi.o
  CC [M]  drivers/char/mwave/tp3780i.o
  CC [M]  drivers/char/mwave/3780i.o
  LD [M]  drivers/char/mwave/mwave.o
make[1]: *** [drivers/char] Error 2
make: *** [drivers] Error 2
    Aborting...