Kelly was a student of the Philadelphia Sketch Club's evening life class, taught by Thomas Eakins between 1874 and 1876. The artist exhibited several times at the Pennsylvania Academy of Fine Arts and in the year of his death, 1893, the Academy presented a major memorial exhibition, consisting of more than 200 works.