Can I divide the accounts between managers and limit each person's access?

Yes. It is possible to limit the Meta accounts and Google Ads accounts for each manager. With this, each manager will only have access to the accounts you select for them.