Physiological signal based biometric analysis has recently attracted attention as a means of meeting increasing privacy and security requirements. The real-time nature of an electrocardiogram (ECG) and the hidden nature of the information make it highly resistant to attacks. This paper focuses on three major bottlenecks of existing deep learning driven approaches: the lengthy time requirements for optimizing the hyperparameters, the slow and computationally intense identification process, and the unstable and complicated nature of ECG acquisition. We present a novel deep neural network framework for learning feature representations directly from ECG time series. The proposed framework integrates deep bidirectional long short-term memory (BLSTM) and . The overall approach not only avoids the inefficient and experience-dependent search for hyperparameters, but also fully exploits the spatial information of ordinal local features and the memory characteristics of a recognition algorithm. The effectiveness of the proposed approach is thoroughly evaluated in two ECG datasets, using two protocols, simulating the influence of electrode placement and acquisition sessions in identification. Comparing four recurrent neural network structures and four classical machine learning and deep learning algorithms, we prove the superiority of the proposed algorithm in minimizing overfitting and self-learning of time series. The experimental results demonstrated an average identification rate of 97.71%, 99.41%, and 98.89% in training, validation, and test sets, respectively. Thus, this study proves that the application of APSO and LSTM techniques to biometric can achieve a lower algorithm engineering effort and higher capacity for generalization.