Given limited terrain adaptability, most existing multirobot cooperative transportation systems (MRCTSs) mainly work on flat pavements, restricting their outdoor applications. The connectors’ finite deformation capability and the control strategies’ limitations are primarily responsible for this phenomenon. This study proposes a novel MRCTS based on tracked mobile robots (TMRs) to improve terrain adaptability and expand the application scenarios of MRCTSs. In structure design, we develop a novel 6-degree-of-freedom passive adaptive connector to link multiple TMRs and the transported object (the communal payload). In addition, the connector is set with sensors to measure the position and orientation of the robot with respect to the object for feedback control. In the control strategy, we present a virtual leader–physical follower collaborative paradigm. The leader robot is imaginary to describe the movement of the entire system and manage the follower robots. All the TMRs in the system act as follower robots to transport the object cooperatively. Having divided the whole control structure into the leader robot level and the follower robot level, we convert the motion control of the two kinds of robots to trajectory tracking control problems and propose a novel double closed-loop kinematics control framework. Furthermore, a control law satisfying saturation constraints is derived to ensure transportation stability. An adaptive control algorithm processes the wheelbase uncertainty of the TMR. Finally, we develop a prototype of the TMR-based MRCTS for experiments. In the trajectory tracking experiment, the developed MRCTS with the proposed control scheme can converge to the reference trajectory in the presence of initial tracking errors in a finite time. In the outdoor experiment, the proposed MRCTS consisting of four TMRs can successfully transport a payload weighing 60 kg on an uneven road with the single TMR’s maximum load limited to 15 kg. The experimental results demonstrate the effectiveness of the structural design and control strategies of the TMR-based MRCTS.