Update: Didn't make a difference. A user came in and was kicked out within a minute. The "removed from the channel due to inactivity" was displayed again.
EDIT: Another Update. I've had a few users clear out their temp files, cookies..etc, and that seems to have helped them. Is it possible something is causing a conflict with old files that are stored in browsers from the old v3 program?