Stump was a miniaturist and landscape painter and a member of the Sketching Society. He studied at the Royal Academy Schools and exhibited at the Royal Academy from 1802-1845. In addition to landscapes and miniatures Stump also did many portraits of actors, some in watercolour.