Does the location of a hole in the wall matter?

Yes. What really matters is whether or not air can infiltrate through the hole in the wall or whether or not electrical items can be accessed through the hole. Either of these things would make the wall fail to pass inspection.