Advanced Search - Ability to choose other parties besides First Party from the columns list

If a user is trying to create an advanced search and want to pull in contact info (phone #) and the party isn't the First Party to a case they will not be able too. It isn't an option.