"Twice Upon A Time" by Charles L. Fontenay

The Fontenay has a strong beginning and ending but a weak middle. It is a time paradox adventure in which a long-lived secret agent and a heroine are pitted against a deceptively charming planetary dictator. (Amazon)