Adam:
Download the version 4.1.
Login as admin, go to the control panel and click Live Support Configuration tab.
Set Show users in queue by department to true
Not seeing that option on any of the page here, using v4.1 that I downloaded yesterday.
/ChatAdmin/Config.aspx and /ChatAdmin/Live-Support-Config.aspx are both timestamped 2/5/2008.