To avoid confusion what is the best preposition to use in the following walking on over under through across a covered bridge?

I think it will be a matter of minimizing confusion, and not avoiding it altogether. Clearly, over and under are quite confusing, unless you are walking on the roofing, or through the water. I would opt for "across", which is the common concept for all roadway bridges.