Based on what you described in the question, the expiation is required only once. This is because the oath was broken with the first visit, and subsequent visits do not fall under the purview of the oath. The oath prohibited visits for a week, and the first visit nullified the oath and necessitated expiation. Thus, only one expiation is required.
Fatwā issued by Dr. Khālid Naṣr