We have over thousands of contacts, so we decided to limit user to see contact that built by other team(divisions). But I assume it's prebuilt to make all user to view all the contacts.
So I wonder if that's some way to limit user to read the record?
Like
Hello,
You can implement this using "Object permissions."
To do this, go to Settings.
Then find the "Object permissions" section.
In Object permissions, locate the "Contact" section.
Set up "Use record permissions" for each role.
For example, I added two roles: "Role1" and "Role2." 
I configured it so that if "Role1" creates a record, other roles cannot see it.
If a user with the "Role2" creates a record, users with "Role1" cannot see the data of this record.
Please note that this is an example; you can modify and adapt this example to suit your needs.
Have a great day!