>can get through it without having to think or visualize a lot.

You do not actually have to visualize fiction. I think it is a bit weird you can read non fiction without thinking, if anything I would think non fiction requires even more thinking than fiction. some non fiction actually requires visualizing to understand properly.

Can you give some examples of that non fiction which worked for you and the fiction which did not?