Is it possible to do a trip to Niagara Falls from New York by train or bus?

By train from Penn station to Niagra Falls, no problem.

Note that the train station at Niagra is a couple miles from the tourist areas, a taxi will be required.