How to specify that we cannot use classroom at certain times?

As with other objects (teachers, classes,...) you can use the "Time-off" to define when you can use certain classroom.

So for example if your swimming pool has same cleaning periods and therefore no lesson can be placed there, you can specify it like this:

See also:
Time-off