Pulse Transiently Chaotic Neural Network (PTCNN) can find almost all optima including the part optima and the global with its abundance dynamical characteristic, when is used in nonlinear non-constrained optimization. The optimization problem is first unconstrained by virtue of non-differentiable exact penalty function, and is further solved by PTCNN. It is showed by an example that this method is efficient.