Is the force in coefficient of friction experiment only due to the surface of contact between block and board?

Yes - even though there is an extremely small amount due to the block and air. In the experiment that is usually not taken into account even though strictly speaking it should be