A project can have lots of contacts but not all of them need access to the portal. By default, project contacts do not have access to the portal. You need to explicitly give them access to the portal.
Check the ‘Enabled’ box in the contact’s row, to give them portal access.
Click the Save button to apply the changes.