This paper focuses on the integrated problem of long-term planning and short-term scheduling in a large-scale refinery-petrochemical complex, and considers the overall manufacturing process from the upstream refinery to the downstream petrochemical site. Different time scales are incorporated from the planning and scheduling subproblems. At the end of each discrete time period, additional constraints are imposed to ensure material balance between different time scales. Discrete time representation is applied to the planning subproblem, while continuous time is applied to the scheduling of ethylene cracking and polymerization processes in the petrochemical site. An enterprise-wide mathematical model is formulated through mixed integer nonlinear programming. To solve the problem efficiently, a heuristic algorithm combined with a convolutional neural network (CNN), is proposed. Binary variables are used as the CNN input, leading to the integration of a data-driven approach and classical optimization by which a heuristic algorithm is established. The results do not only illustrate the detailed operations in a refinery and petrochemical complex under planning and scheduling, but also confirm the high efficiency of the proposed algorithm for solving large-scale problems.