Would you be penalized if you filed federal taxes and not state taxes?

Yes, by the state. The states can still charge you penalties and interest on taxes owed. There is a direct communication link from the IRS and the states. You can also be charged criminally by the state and serve jail time for unfiled returns. If you file returns with the IRS and not the state your state will know and they will come after you with collections activity.