Color represents an important attribute in the field of traffic sign recognition. However, when the color of the traffic sign fades or the traffic scene is collected in gray as in the case of Infrared imaging, then color based recognition systems fail. Other problems related to color are simply that different countries use different colors. Even within the European Union, colors of traffic signs are not the same. This paper aims to present a new approach to detect traffic signs without color attributes. It is based a two-stage sliding window which detects traffic signs in the multi-scale image. Histogram of Oriented Gradients HOG descriptors are computed as a quality function which are evaluated by two SVM classifier; the coarse and the fine detectors. Different objects detected by the coarse detectors are clustered and a fine search is conducted in the areas where traffic signs are more probable to exist. Experiments conducted to detect traffic signs under different light conditions such as sunny, cloudy, fog and snow fall have showed a performance of 98% and very low false positive rate. The proposed approach was tested on the Yield traffic signs because it has a simple triangular shape which can be found in many places other than the traffic signs which represent a challenge to the proposed approach.