Well I've done a bit with the actual xLib (I believe that's what it's called, it's been a while). And although I still wasn't thrilled with the fact that it was a C style API, it was much better than the Windows API.

Sadly it seems quite lacking in the variety of controls you have. You even have to make a message box yourself with a window, button, etc. :/