What is correct all department or all departments?

Ah, what a lovely question! It's actually "all departments" that you'll want to use here. When we're talking about more than one department, we add an "s" to "department" to show that it's plural. Keep up the great work, my friend!