When were aerial photographs first taken and how were the cameras carried high above the ground to take them?

I believe there was such Photography done during the Civil War using balloons. It may have been done earlier too.