The unassigned to-dos will change depending on what view you are in.

If you are in the teams view, it will show all unassigned to-dos in the organization.

If you are in the projects view, it will show the project’s unassigned to-dos.