Facebook does it cost to start a fan page?

nope. 100% free.

Edit: Although it is free, Facebook does suggest for you to promote your posts you make on a fan page with money so that it can reach more people though this is optional.