In recent years, the widespread adoption of photovoltaic (PV) installations across various sectors has created a growing demand for accurate PV design tools. In this pursuit, the latest version of IDA Indoor Climate and Energy (IDA ICE 5 beta) emerges as a contender, offering advanced PV modeling capabilities, together with the advanced building simulation capabilities it already has. This study evaluates the accuracy of PV modeling within IDA ICE by comparing predicted power outputs to real-world data from three existing PV systems located at the Research Institute of Sweden (RISE) in Borås. To achieve this, weather files are created using historical weather and radiation data. As the measured radiation data is only available as total irradiation on a tilted plane, it was deconstructed into direct and diffuse components on the horizontal plane using a modified version of the model by Erbs et al.. Additional known parameters are the geometry of the PV array, and the characteristics of PV panel and inverter, based on their product data sheets. The accuracy of the PV design tool in IDA ICE is evaluated by comparing the power output of unshaded arrays against the measured data from RISE. The calculated power output is compared to the measured power output and analyzed through ASHRAE 14-2014 guidelines for performance evaluation. It was found that the software gives an accurate prediction of both panel temperature and PV power production. A study on shading effects is an open problem to improve the generality of the results in this study.