Is it logical to consider the illogical?

Yes, it is perfectly logical to do so, especially where considering the boundaries of logic itself, where that logic is applied in ways contrary to normal logic forms, or where suing logic to prove that the illogical truly is illogical (for example, proving that an assumption is incorrect as it would lead to a contradiction, the basis of RAA, means logically considering the illogical).