Search

In recent years, as deepfake technology matures, face-swapping software and synthesized videos have become widespread. While these techniques offer entertainment, they also provide opportunities for misuse by malicious actors. Consequently, the significance of deepfake detection technology has grown markedly. Existing methods for deepfake detection commonly suffer from issues including poor cross-compression robustness, weak cross-dataset generalization, and high model training overheads. To address these challenges, this paper proposes a deepfake detection approach that combines multiple parameter-efficient fine-tuning techniques. This method utilizes a visual Transformer model pretrained with the masked image modeling self-supervised method as its backbone. Initially, it employs the low-rank adaptation (LoRA) method for fine-tuning the self-attention module parameters of the pretrained model. Concurrently, it introduces a parallel structure incorporating convolutional adapters to capture local texture information, enhancing the model’s adaptability in deepfake detection tasks. Subsequently, a serial structure introduces classical adapters to fine-tune the feed-forward network of the pretrained model, maximizing the utilization of knowledge acquired during the pretraining phase. Ultimately, a multi-layer perceptron replaces the original pretrained model’s classification head for deepfake detection. Experimental results across six datasets demonstrate that this model achieves an average frame-level AUC of approximately 0.996 with only 2×107 trainable parameters. In cross-compression experiments, the average frame-level AUC drop is 0.135. In cross-dataset generalization experiments, the frame-level AUC averages around 0.765.

Considering the problem of missing fields in the criminal case system, this article proposes a deep learning algorithm to extract the features of the case description and fill in the missing value. Due to Chinese expressions and characteristics of criminal cases, we make both character vectors and word vectors to present text embedding. Character vectors are from bert model. Word vector is trained by long short‐term memory model with attention. The experiment uses 13,890 data totally. This work is an extension of our short conference proceeding paper. The results show that the combination of characters and words can effectively improve the accuracy of the conference paper by 9%. This is the first time to cascade the character and word dimensions on the criminal case information preprocess and it can provide higher quality data especially for the crime data mining. [ABSTRACT FROM AUTHOR]