Muscourt is a commune. It is found in the region Picardie in the Aisne department in the north of France.