This study has investigated the quality and reliability of manual assessments on railway embankments within the domain of railway maintenance. Manually inspecting vegetation on railway embankments is slow and time consuming. Maintenance personnel also require extensive knowledge of the plant species, ecology and bio-diversity to be able to recommend appropriate maintenance action. The overall objective of the study is to investigate the reliable nature of manual inspection routines in favour an automatic approach. Visual estimates of plant cover reported by domain experts’ have been studied on two separate railway sections in Sweden. The first study investigated visual estimates using aerial foliar cover (AFC) and sub-plot frequency (SF) methods to assess the plant cover on a railway section in Oxberg, Alvdalsbanan, Sweden. The second study investigated visual estimates using aerial canopy cover method on a railway section outside Vetlanda, Sweden. Visual estimates of the domain experts were recorded and analysis-of-variance (ANOVA) tests on the mean estimates were investigated to see whether if there were disagreements between the raters’. ICC(2, 1) was used to study the differences between the estimates. Results achieved in this work indicate statistically significant differences in the mean estimates of cover (p < 0.05) reported by the domain experts on both the occasions.