Born in Bremen, Herzog attended the Academy in Dsseldorf where he was a pupil with Wilhelm Schirmer, Karl-Friedrich Lessing, Andreas Achenbach and Hans-Fredrik Gude. He travelled extensively to Switzerland, Italy and Norway. In 1869, Herzog departed for North America where he settled in Philadelphia. Even after his departure, however, he continued to exhibit throughout Germany, most notably in Berlin.