Porous polymers have been recently recognized as one of the most important precursors for fabrication of heteroatom-doped porous carbons due to the intrinsic porous structure, easy available heteroatom-containing monomers and versatile polymerization methods. However, the heteroatom elements in as-produced porous carbons are quite relied on monomers. So far, the manipulating of heteroatom in porous polymer derived porous carbons are still very rare and challenge. In this work, a sulfur-enriched porous polymer, which was prepared from a diacetylene-linked porous polymer, was used as precursor to prepare S-doped and/or N-doped porous carbons under nitrogen and/or ammonia atmospheres. Remarkably, S content can sharply decrease from 36.3% to 0.05% after ammonia treatment. The N content and specific surface area of as-fabricated porous carbons can reach up to 1.32% and 1508 m²·g⁻¹, respectively. As the electrode materials for electrical double-layer capacitors, as-fabricated porous carbons exhibit high specific capacitance of up to 431.6 F·g⁻¹ at 5 mV·s⁻¹ and excellent cycling stability of 99.74% capacitance retention after 3000 cycles at 100 mV·s⁻¹. Furthermore, as the electrochemical catalysts for oxygen reduction reaction, as-fabricated porous carbons presented ultralow half-wave-potential of 0.78 V versus RHE. This work not only offers a new strategy for manipulating S and N doping features for the porous carbons derived from S-containing porous polymers, but also paves the way for the structure-performance interrelationship study of heteroatoms co-doped porous carbon for energy applications.