If you get them early enough (like 2 months), you can get to NYC from Providence for $27 on the regional and $56 on the Acela.

Those prices rise fast so if you're looking for something closer than that the commuter rail is cheaper, but slower, harder seats, etc.

There's no shortage of ways to go, it's just a question of how soon and how fast.