As I fall into the tourist category, I much preferred IOA as a park. Although, in a sense I consider Diagon Alley its own thing and that probably skews my more recent opinions of the two parks.
I also think that opinion was determined predominantly New Years 2011/2012, while USF had a much different landscape.
I thought IOA was a great park and USF was a pretty bad park filled with some great rides.