How to specify that we cannot use classroom at certain times?

As with other objects (teachers, classes,...) you can use time-off to define when you can use certain classroom.

So for example if your swimming pool has same cleaning periods you can specify it like this:

More on time-off can be find in this article: שיבוץ/חסימה