Development of a Vehicle Detection and Classification System Using YOLO and Real-Time API With The Rapid Application Development (RAD) Method

Rizqo Sahala Putra; Muhammad Asep Subandri

doi:10.36378/jtos.v9i1.5716

Rizqo Sahala Putra Politeknik Negeri Bengkalis
Muhammad Asep Subandri Department of Computer Engineering, Bengkalis State Polytechnic, Indonesia

DOI: https://doi.org/10.36378/jtos.v9i1.5716

Keywords: YOLOv8, Vehicle Detection, Rule-Based Post-Processing, ByteTrack, CCTV, Computer Vision

Abstract

This study developed a real-time, computer vision-based traffic monitoring system to address safety concerns regarding uncontrolled public vehicle access within the Politeknik Negeri Bengkalis campus environment. As the existing CCTV infrastructure lacked intelligent analytical capabilities, an automated solution was required to extract objective traffic data. The system utilized the YOLOv8n model for vehicle detection and the ByteTrack algorithm for multi-object tracking to prevent duplicate counting across frames. To overcome classification inaccuracies inherent in pre-trained models without relying on resource-intensive retraining, a rule-based post-processing method was implemented. This method evaluated bounding box geometries, including pixel area, aspect ratio, and a vertical camera perspective factor, to filter raw detections. Evaluation results demonstrated that the rule-based approach significantly minimized false positives, achieving a total precision of 93.48% and an overall accuracy of 86.00%, which vastly outperformed both baseline and fine-tuned configurations. Furthermore, comparative tests across model variants confirmed that YOLOv8n provided the most stable CPU execution, maintaining the highest frame rate and lowest inference latency. The integrated system successfully tracked vehicle counts and estimated relative speeds, providing a reliable, GPU-independent analytical tool to support data-driven campus traffic management policies.

Downloads

Download data is not yet available.

References

A. Krizhevsky, I. Sutskever, And G. E. Hinton, “Imagenet Classification With Deep Convolutional Neural Networks.” [Online]. Available: Http://Code.Google.Com/P/Cuda-Convnet/

R. G. Fajri, I. Santoso, And Y. A. Adi Soetrisno, “Perancangan Program Pendeteksi Dan Pengklasifikasi Jenis Kendaraan Dengan Metode Convolutional Neural Network (Cnn) Deep Learning,” Transient: Jurnal Ilmiah Teknik Elektro, Vol. 9, No. 1, Pp. 97–106, Mar. 2020, Doi: 10.14710/Transient.V9i1.97-106.

D. Iskandar Mulyana And M. A. Rofik, “Implementasi Deteksi Real Time Klasifikasi Jenis Kendaraan Di Indonesia Menggunakan Metode Yolov5,” Jurnal Pendidikan Tambusai, Vol. 6, No. 3, Pp. 13971–13982, Jul. 2022, Doi: 10.31004/Jptam.V6i3.4825.

A. S. Kusuma, A. I. Pradana, And B. W. Pamekas, “Pengembangan Sistem Perhitungan Jumlah Kendaraan Berdasarkan Jenis Kendaraan Menggunakan Algoritma Yolo Secara Realtime,” Skanika: Sistem Komputer Dan Teknik Informatika, Vol. 7, No. 2, Pp. 166–179, Jul. 2024, Doi: 10.36080/Skanika.V7i2.3201.

L. Adi Kurniawan Et Al., “Sistem Klasifikasi Jenis Dan Warna Kendaraan Secara Real-Time Menggunakan Metode K-Nearest Neighbor Dan Framework Yolact,” Jepin (Jurnal Edukasi Dan Penelitian Informatika), Apr. 2021.

A. A. B, A. Amin, And M. W. Kasrani, “Penerapan Metode Yolo Object Detection V1 Terhadap Proses Pendeteksian Jenis Kendaraan Di Parkiran,” Jurnal Teknik Elektro Uniba (Jte Uniba), Vol. 6, No. 1, Pp. 194–199, Oct. 2021, Doi: 10.36277/Jteuniba.V6i1.130.

A. Riansyah And A. H. Mirza, “Pendeteksi Mobil Berdasarkan Merek Dan Tipe Menggunakan Algoritma Yolo,” Smatika Jurnal, Vol. 13, No. 01, Pp. 43–52, Jun. 2023, Doi: 10.32664/Smatika.V13i01.719.

F. Jupiter, E. S. Negara, Y. N. Kunang, And M. I. Herdiansyah, “Implementasi Algoritma Cnn Dan Yolo Untuk Mendeteksi Jenis Kendaraan Pada Jalan Raya,” Explore: Jurnal Sistem Informasi Dan Telematika, Vol. 14, No. 2, P. 110, Dec. 2023, Doi: 10.36448/Jsit.V14i2.3259.

B. Aditya Pratama, S. Rahman, And A. Sembiring, “Klasifikasi Jenis Kendaraan Pada Jalan Raya Menggunakan Yolov7,” Jurnal Informatika Teknologi Dan Sains (Jinteks), Vol. 5, No. 4, Pp. 661–666, Dec. 2023, Doi: 10.51401/Jinteks.V5i4.3493.

W. P. N. Putra, A. I. Pradana, And N. Nurchim, “Implementasi Sistem Penghitungan Volume Kendaraan Menggunakan Yolov8,” Jurnal Fasilkom, Vol. 14, No. 2, Pp. 443–450, Aug. 2024, Doi: 10.37859/Jf.V14i2.7395.

Muhammad Rosyan Amanullah, R. M. Akbar, And Y. D. Rosita, “Simulasi Deteksi Dan Hitung Jumlah Kendaraan Menggunakan Yolov4 Pada Cctv Persimpangan Jalan Raya,” Seminar Nasional Fakultas Teknik, Vol. 2, No. 1, Pp. 96–101, Sep. 2023, Doi: 10.36815/Semastek.V2i1.128.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,”in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Las Vegas, NV, USA, 2016, pp. 779–788, doi: 10.1109/CVPR.2016.91.

J. Redmon and A. Farhadi, “YOLO9000: Better, Faster, Stronger,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Honolulu, HI, USA, 2017, pp. 6517–6525, doi: 10.1109/CVPR.2017.690.

J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement,” arXiv preprint arXiv:1804.02767, Apr. 2018.

A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao, “YOLOv4: Optimal Speed and Accuracy of Object Detection,” arXiv preprint arXiv:2004.10934, Apr. 2020.

Z. Ge, S. Liu, F. Wang, Z. Li, and J. Sun, “YOLOX: Exceeding YOLO Series in 2021,” arXiv preprint arXiv:2107.08430, Jul. 2021.

Y. Zhang, P. Sun, Y. Jiang, D. Yu, F. Weng, Z. Yuan, P. Luo, W. Liu, and X. Wang, “ByteTrack: Multi-Object Tracking by Associating Every Detection Box,” in Proc. Eur. Conf. Comput. Vis. (ECCV), vol. 13682, Tel Aviv, Israel, 2022, pp. 1–21, doi: 10.1007/978-3-031-20047-2_1.

A. Bewley, Z. Ge, L. Ott, F. Ramos, and B. Upcroft, “Simple Online and Realtime Tracking,” in Proc. IEEE Int. Conf. Image Process. (ICIP), Phoenix, AZ, USA, 2016, pp. 3464–3468, doi: 10.1109/ICIP.2016.7533003.

N. Wojke, A. Bewley, and D. Paulus, “Simple Online and Realtime Tracking with a Deep Association Metric,” in Proc. IEEE Int. Conf. Image Process. (ICIP), Beijing, China, 2017, pp. 3645–3649, doi: 10.1109/ICIP.2017.8296962.

Y. Zhang, C. Wang, X. Wang, W. Zeng, and W. Liu, “FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking,” Int. J. Comput. Vis., vol. 129, no. 11, pp. 3069–3087, Nov. 2021, doi: 10.1007/s11263-021-01513-4.

M. W. Ahmed, M. Adnan, M. Ahmed, D. Janssens, G. Wets, A. Ahmed, and W. Ectors, “From Stationary to Nonstationary UAVs: Deep-Learning-Based Method for Vehicle Speed Estimation,” Algorithms, vol. 17, no. 12, p. 558, 2024, doi: 10.3390/a17120558.

M. A. Rahmat, I. Indrabayu, A. Achmad, and A. E. U. Salam, “A Thorough Review of Vehicle Detection and Distance Estimation Using Deep Learning in Autonomous Cars,” JOIV: International Journal on Informatics Visualization, vol. 8, no. 4, pp. 2362–2369, 2024, doi: 10.62527/joiv.8.4.2665.

S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137–1149, Jun. 2017, doi: 10.1109/TPAMI.2016.2577031.

W. Liu et al., “SSD: Single Shot MultiBox Detector,” in Proc. Eur. Conf. Comput. Vis. (ECCV), Amsterdam, Netherlands, 2016, pp. 21–37, doi: 10.1007/978-3-319-46448-0_2.

T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, “Focal Loss for Dense Object Detection,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Venice, Italy, 2017, pp. 2980–2988, doi: 10.1109/ICCV.2017.324.

M. S. Sawah, “Advancements in UAV-based traffic monitoring: a systematic review of deep learning and edge computing,” Bulletin of Electrical Engineering and Informatics, vol. 13, no. 1, pp. 451–460, 2024, doi: 10.11591/eei.v13i1.6521.