Songket is a historical heritage in the city of Palembang. Where Songket has many different types and motifs. Besides having historical value, Palembang's original Songket has high quality and complexity in the manufacturing process. As known Palembang Songket has a lot of motives, one of the ways to recognize Palembang Songket is through its motives, so that research was conducted for the classification of Palembang Songket motifs. The method used to extract features is the Speeded-Up Robust Feature (SURF), while the classification method is Random Forest. The process of forming the SURF feature is divided into two stages, the first stage is Interest Point Detection, which consists of Integral Images, Hessian Matrix Based Interest Points, Scale Space Representation and Interest Point Localization, the second stage of Interest Point Description consists of Orientation Assignment and Descriptor Based on Sum Haar Wavelet Responses. The resulting feature is used for the Random Forest classification. This study used 345 images of Palembang Songket motifs, among others, Bunga Cina, Cantik Manis and Pulir. The images taken are based on 5 colors from each Palembang Songket motif. For the separation of data there are 300 images used as data train and 45 images for testing data. From the tests that have been done the results of the overall overall accuracy are 68.89%, per class accuracy 79.26%, precision 69.27, and recall 68.89%.