Sergeant William Pannifor was born near Ipswich and enlisted locally in the Rifle Brigade in July 1854, aged 17 years. In his subsequent career of 21 years with the Colours, his only overseas service amounted to six years in Canada, a period that witnessed his advancement to Colour-Sergeant in July 1866 at the time of the Fenian troubles. In March 1871, however, he was reduced to Private for making a false statement, but by the time of his transferral to the 3rd Royal Middlesex Militia in August 1876, he had won back his Stripes.