We don't yet have fine-grained authorization (like "just let this server post 'follow' activities for people on this server", but there's an open issue about it: https://github.com/e14n/pump.io/issues/129