We have this same problem with electric and magnetic fields. Depending on your reference frame, what appears to be a magnetic force from one spot appears to be an electric force from another.