Having problems with relationships

I have the following relationships.

Appointment has 1 Clinic

Patient has 1 Clinic

I'm trying to create a cube that has the patient and their count of appointments.

However when I get the appointments filtering down on the patient.  They are totals (Patient A, 20, Patient B, 20, etc.)  My first instinct obviouls would be to create a relationship between the Patient and Appointments as 1 Patient has many Appointments.

However when I try and do this it says there is an ambigious relationship because of the clinic relationship.  I would think the BI would use that relationship to filter the correct appointments but it doesn't.   How do I approach solving this issue?

Thank you in advance.