How do you bake banana nut bread without flour?

You might try soy flour. It's not really flour but it works the same way. The bread may be a bit dry and I'm not sure it will rise the same way, but if you can't eat flour this may be better than nothing.