The Muster family have always been closely associated with hunting. John Muster of Colwick Hall, near Nottingham, was painted with his wife, Sophia, riding at their home by George Stubbs in 1877. He kept a famous pack of hounds, and was also devoted to racing. He was one of the chief subscribers to the building of a grandstand on the original Nottingham racecourse, and he owned several racehorses.

Jack Muster was the only son of John, by his wife Sophia. He was born in Grosvenor Square on 6 July 1777. In 1798 his father made over a portion of land and ten couples of hounds from his own kennels to Jack. His career as a Master of Hounds prompted much admiration from his friends who described him as being 'top full of good nerves, firm hand' a sure seat, and a constitution which could stand any amount of wear and tear. He could go across country well, and knew the run of, and could kill, a fox better than most huntsmen going.' Jack Muster was a clever and successful breeder of hounds, and both in the field and in the kennel he was, 'The Druid' declares, 'the undisputed king of gentlemen'