One beautiful day build definitions startet to give such error:
Also getting latest on the folder with custom activities dlls gave the same error.
What a nonsense thought I, cause I am admin afterall!
Right, the problem was not enough disk space on TFS application tier machine.
Cleaning up resolved the problem.