The advances of manufacturing techniques, such as additive manufacturing, have provided unprecedented opportunities for producing multiscale structures with intricate latticed/cellular material microstructures to meet the increasing demands for parts with customized functionalities. However, there are still difficulties for the state-of-the-art multiscale topology optimization (TO) methods to achieve manufacturable multiscale designs with cellular materials, partially due to the disconnectivity issue when tiling material microstructures. This paper attempts to address the disconnectivity issue by extending component-based TO methodology to multiscale structural design. An effective linkage scheme to guarantee smooth transitions between neighboring material microstructures (unit cells) is devised and investigated. Associated with the advantages of components-based TO, the number of design variables is greatly reduced in multiscale TO design. Homogenization is employed to calculate the effective material properties of the porous materials and to correlate the macro/structural scale with the micro/material scale. Sensitivities of the objective function with respect to the geometrical parameters of each component in each material microstructure have been derived using the adjoint method. Numerical examples demonstrate that multiscale structures with well-connected material microstructures or graded/layered material microstructures are realized.