Oh, interesting idea about the Silence. I hope it'll get cleared up in show, but it's probably that.
Of course, that'd be rather ironic, since they almost erased the universe by blowing up the Tardis ^^