Filming a “performance” by an audience member does not require permission under the performers' rights provisions in the Copyright Act. Permission may be required under the Copyright Act if a member of the audience improvised a copyright work (e.g. a song).
Since playing sport is not a protected performance for the purposes of the Copyright Act, permission from people you film playing sport is not required under the Copyright Act. However, other laws (such as the law of passing off) may allow you to prevent use of the film in certain ways (for example, in a way that suggests that you endorsed a particular product).