The test technology for integrated automation system in substation based on smart grid operation supporting system is developed. The test system includes the provincial master simulation system and substation automation simulation system based on smart grid operation supporting system. The test and assessment before operation of all kinds of automation equipment in substation and the regular inspection of running automation equipment are researched. Three examples are introduced, which includes the test of RTU message slack, telesignalling signal loss and the frequent loss of total accident signal SOE. The test and fault diagnosis of the automation equipment and software in substation are realized by building a test environment for the provincial master simulation system and substation automation simulation system. And the test system has provided quantifiable assessment tools for the test and fault diagnosis.