I have it configured for Integrated Mode and all my app pools are running integrated.

As I mentioned in my post, It works fine when the port is not referenced in the URL.