When installing the HTK Speech Recognition toolkit on 64-bit Ubuntu, the following packages are needed.
sudo apt-get install libc6-dev-i386
sudo apt-get install libx11-dev:i386 libx11-dev
Then, just go
./configure
make all
sudo make install