The presence of vegetation on railway tracks (amongst other issues) threatens track safety and longevity. However, vegetation inspections in Sweden (and elsewhere in the world) are currently being carried out manually. Manually inspecting vegetation is very slow and time consuming. Maintaining an even quality standard is also very difficult. A machine vision-based approach is therefore proposed to emulate the visual abilities of the human inspector. Work aimed at detecting vegetation on railway tracks has been split into two main phases. The first phase is aimed at detecting vegetation on the tracks using appropriate image analysis techniques. The second phase is aimed at detecting the rails in the image to determine the cover of vegetation that is present between the rails as opposed to vegetation present outside the rails. Results achieved in the current work indicate that the machine vision approach has performed reasonably well in detecting the presence/absence of vegetation on railway tracks when compared with a human operator.