The advent of the Fourth Industrial Revolution and the deterioration of the working environment have worsened the manufacturing environment in Korea. Manufacturing competitiveness is required to meet customer's customized mass production demands. Building a Smart Factory is becoming a necessity for SMEs. In this paper, we define the ideal image and the level required level of process / facility among the fields needed for SME to build Smart Factory. And suggested the matters that SMEs should take into consideration during the implementation.