Extracting color palettes from an image is a common practice used by artists in different visual domains. In this study, we introduce a novel tool for extracting color palettes from an image. Based on the hierarchical color model (HCM) (Jeong et al. (2019)), we develop a prototype user interface system comprising novel interactions and visualization. Our visualization is a node-link diagram tailored for the HCM; the accompanying interactions originate from the hierarchical structure. We evaluate our prototype system by performing a usability test and comparing it with contemporary alternatives for professional usage. The results from the user study validate the effectiveness of the presented approach. We also find a few user requirements that can be useful in the further development of the related tools. Moreover, we expect that the proposed interactive visualization can facilitate additional studies on the HCM. The prototype is available in the following URL: https://int-vis-hcm.web.app.