"Offshore" is a term used in the US for any financial organization with headquaters outside the country. Many banks have offshore subsidiaries that engage in activities that are either heavily regulated or taxed or are not allowed under U.S. law.

"Off-site" means away from the main place (of production)/headquaters of an organization.