Who or Whom? which would be correct?

[Mr Downtown]

what4 wrote:
Use "the who/whom trick."
Just substitute he/him/they/them for who and whom, and that will tell you whether to use who or whom.

But in the OP's case, it isn't clear whether the clause is meant to stand alone, or to modify the object (residents) of the main clause.