Next-Generation Payment Fraud Intelligence with Large Language Models and Event-Driven Architectures

Authors

  • BingJie Zi Northeastern University, Boston 02115, Massachusetts, USA

DOI:

https://doi.org/10.54097/sdgqfw90

Keywords:

Payment fraud detection, Event-driven features, Text embeddings, Gradient boosting, Reproducibility, Class imbalance

Abstract

Payment fraud detection at scale must reconcile three pressures: the streaming nature of transaction events, the cost-sensitivity of false alerts, and the practical need for models that can be trained and refreshed on commodity hardware. Recent work has explored advanced text representation models and event-driven architectures as separate research threads, yet relatively few reproducible studies have examined their combination in CPU-only settings. This paper presents a focused, lightweight framework that (i) computes streaming per-user rolling-window features over a chronological event log without future-information leakage, and (ii) augments them with lightweight text representations designed to approximate some subword robustness properties commonly associated with modern pretrained language models, instantiated via character n-gram TF-IDF followed by Truncated Singular Value Decomposition. Using a controlled event stream calibrated to representative fraud patterns—amount anomalies, velocity attacks, geographic and device shifts, and obfuscated merchant memos—we benchmark three feature configurations and two classifiers under a strict chronological hold-out. Adding event-driven features lifts PR-AUC from 0.470 to 0.749, and adding language-aware text representations lifts it further to 0.862; the corresponding F1 climbs from 0.517 to 0.830. The full pipeline trains in under one minute on a single CPU. We position the approach as a practical, language-aware baseline against which heavier pretrained encoders may be compared.

Downloads

Download data is not yet available.

References

[1] Bhattacharyya, S., Jha, S., Tharakunnel, K., & Westland, J. C. (2011). Data mining for credit card fraud: A comparative study. Decision Support Systems, 50(3), 602-613. https://doi.org/10.1016/j.dss.2010.08.008

[2] Dal Pozzolo, A., Caelen, O., Le Borgne, Y.-A., Waterschoot, S., & Bontempi, G. (2014). Learned lessons in credit card fraud detection from a practitioner perspective. Expert Systems with Applications, 41(10), 4915-4928. https://doi.org/10.1016/j.eswa.2014.02.026

[3] Dal Pozzolo, A., Caelen, O., Johnson, R. A., & Bontempi, G. (2015). Calibrating probability with undersampling for unbalanced classification. In Proceedings of the IEEE Symposium Series on Computational Intelligence (SSCI) (pp. 159-166). IEEE. https://doi.org/10.1109/SSCI.2015.33

[4] Correa Bahnsen, A., Aouada, D., Stojanovic, A., & Ottersten, B. (2016). Feature engineering strategies for credit card fraud detection. Expert Systems with Applications, 51, 134-142. https://doi.org/10.1016/j.eswa.2015.12.030

[5] Lopez-Rojas, E. A., Elmir, A., & Axelsson, S. (2016). PaySim: A financial mobile money simulator for fraud detection. In Proceedings of the 28th European Modeling and Simulation Symposium (EMSS).

[6] Jurgovsky, J., Granitzer, M., Ziegler, K., Calabretto, S., Portier, P.-E., He-Guelton, L., & Caelen, O. (2018). Sequence classification for credit-card fraud detection. Expert Systems with Applications, 100, 234-245. https://doi.org/10.1016/j.eswa.2018.01.037

[7] Carcillo, F., Le Borgne, Y.-A., Caelen, O., Kessaci, Y., Oblé, F., & Bontempi, G. (2021). Combining unsupervised and supervised learning in credit card fraud detection. Information Sciences, 557, 317-331. https://doi.org/10.1016/j.ins.2019.05.042

[8] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825-2830.

[9] Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794). ACM. https://doi.org/10.1145/2939672.2939785

[10] Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., & Liu, T.-Y. (2017). LightGBM: A highly efficient gradient boosting decision tree. In Advances in Neural Information Processing Systems 30 (NeurIPS) (pp. 3146-3154).

[11] Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29(5), 1189-1232. https://doi.org/10.1214/aos/1013203451

[12] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems 30 (NeurIPS) (pp. 5998-6008).

[13] Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (Vol. 1, pp. 4171-4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423

[14] Wu, S., Irsoy, O., Lu, S., Dabravolski, V., Dredze, M., Gehrmann, S., Kambadur, P., Rosenberg, D., & Mann, G. (2023). BloombergGPT: A large language model for finance. arXiv, arXiv:2303.17564. https://doi.org/10.48550/arXiv.2303.17564

[15] Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6), 391-407. https://doi.org/10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9

[16] Halko, N., Martinsson, P.-G., & Tropp, J. A. (2011). Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM Review, 53(2), 217-288. https://doi.org/10.1137/090771806

[17] Saito, T., & Rehmsmeier, M. (2015). The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLOS ONE, 10(3), e0118432. https://doi.org/10.1371/journal.pone.0118432

[18] Kreps, J., Narkhede, N., & Rao, J. (2011). Kafka: A distributed messaging system for log processing. In Proceedings of the NetDB Workshop.

Downloads

Published

22-07-2026

Issue

Section

Articles

How to Cite

Zi, B. (2026). Next-Generation Payment Fraud Intelligence with Large Language Models and Event-Driven Architectures. Computer Life, 14(3), 30-35. https://doi.org/10.54097/sdgqfw90