A structure building system is described that utilizes a mat, a set of connectors and a set of structural members to build a structure. In a preferred embodiment, magnetic coupling/connection may be used to connect the piece of the structure together. The system may also have one or more pieces of material that may be draped over the structure.