I would encourage you to talk to someone sooner (and be honest about your intentions of just browsing at this point). For example, if FHA is a non-starter you'll want to know as soon as possible because you will need to be saving for a better down payment. Realtors who know the area closely should be able to give you an idea of where you'd have the best shot of FHA for your desired size and budget (or if its even a possibility).

Maybe reach out to Rhode Island HUD as I think they offer free counseling on this kind of thing.