Restrict access to repo

Hello Team,

I would like to help regarding restricting access to users/groups in an Organizational account.

I have a repository which I would like to restrict views, pulls and commits to a few users (HR and IT).

At the moment it says all 65 members in the organization have access. Is there a way to do this on Github.

Thanks

The base permissions seem to be set for the org.

Modifying this should solve it - Setting base permissions for an organization - GitHub Docs