This turned out to be a postback issue:

The temporary directory was set in Page_Load but only initially, and not after postbacks. I'm now always setting these properties in Page_Load  and that's working just fine now.