Pixelyse : ViT- VAE for Document Forgery Detection

Abstract

Ensuring the authenticity of documents is more important than ever, as forgery techniques continue to evolve. Traditional methods, which rely on predefined rules and handcrafted features, often struggle to adapt to new types of fraud. To address this, we propose a Vision Transformer-based Variational Autoencoder (ViT-VAE) designed to enhance document authentication. By combining the Vision Transformer’s ability to capture intricate details with the Variational Autoencoder’s capability to model genuine document patterns, our approach effectively detects anomalies based on reconstruction errors. This fusion of self-attention mechanisms and probabilistic modeling improves accuracy and adaptability in identifying forged elements. Our experiments on diverse datasets show that ViT-VAE outperforms conventional machine learning and deep learning methods, offering a more reliable solution for document security. These findings open the door for further advancements in fraud detection and verification technologies, strengthening trust in digital and physical documentation.