An arbitration agreement is a written agreement between parties where they agree to settle their disputes by not going to a court and by an arbitrator appointed as per a a pre-agreed process.
An arbitration clause is a section of a contact that contains the arbitration agreement. Depending on the language of the contract, an arbitration agreement/clause will be applicable even if the contract is terminated or held to be inapplicable.