The 3rd and 4th Battalions were formed in 1881 from the old Militia Battalions.
The 3rd Battalion had its origins in the Fifeshire Regiment of North British Militia raised in 1797, they were subsequently named the Stirling, Dumbarton, Clackmannan and Kinross Militia in 1803 and their title was finally changed to the Highland Borderers Light Infantry in 1855 .
The 4th Battalion stems from the Royal Renfrew Militia who were embodied in 1793. A further change to the Renfrewshire Militia took place in 1803. In 1855 in recognition of their service they were granted permission to call themselves The Prince of Wales Royal Regiment of Renfrewshire Militia. Both battalions served in the Boer War and were Reserve Battalions during the 1st World War. They were subsequently disbanded.