Creativity in the digital era: a comparison between human and AI evaluation in graphic design processes
DOI:
https://doi.org/10.26441/RC24.2-2025-3963Keywords:
Artificial intelligence, Creativity, Graphic design, Higher education, Educational technology, Educational innovation, Comparative analysis, Assessment methods, AdvertisingAbstract
Purpose. This study investigates whether evaluation using artificial intelligence (AI) with a customized GPT model can be comparable to, or complementary to, human evaluation in graphic design projects created by master's degree students. Methodology. A total of 180 logos were evaluated over six years using a 10-item Likert scale rubric. Each project received a double assessment, one by human experts and one by AI. Results and Conclusions. The results show agreement in five categories between human evaluators and AI (e.g., originality, relevance) while, in another five categories (e.g., balance, design principles), AI tended to overvalue the works when compared to human assessment. The qualitative analysis of the AI’s feedback identified strengths, but also limitations. In conclusion, a hybrid human-AI evaluation could improve fairness and efficiency in creativity grading, although AI alone fails to capture all subjective nuances. Original Contributions. This paper provides novel empirical evidence on the capabilities and limitations of AI (GPT) as a graphic design evaluator when compared to human assessment. It proposes a hybrid evaluation model that combines the sensitivity and expert judgment of the human evaluator, with the consistency and speed of AI, providing an innovative way to increase objectivity without losing subjective nuances in creativity evaluation.
Metrics
References
Assefa, E. A. (2024). The Double-Edged Sword of Artificial Intelligence (AI) in Education: Maximizing benefits while mitigating risks. The Journal of Quality in Education, 14(24), 154–176. https://doi.org/10.37870/joqie.v14i24.450 DOI: https://doi.org/10.37870/joqie.v14i24.450
Avotina, A., & Froloviceva, V. (2023). Rubrics as a tool for objective assessment in art education. To be or not to be a great educator, 525-538. https://doi.org/10.22364/atee.2022 DOI: https://doi.org/10.22364/atee.2022.35
Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52-62. https://doi.org/10.61969/jai.1337500 DOI: https://doi.org/10.61969/jai.1337500
Cao, M. L. F. (1998). La Retórica visual como análisis posible en la didáctica del arte y de la imagen. Arte, individuo y sociedad, 10, 39-62.
Carrere, A. (2009). Retórica tipográfica. Editorial Universitat Politècnica de València.
Chaves, N. (2003). La marca corporativa. Paidós.
Chaves, N., & Belluccia, R. (2005). La imagen corporativa: Gestión y diseño de símbolos y logotipos. Paidós.
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. Ieee Access, 8, 75264-75278. https://doi.org/10.1109/ACCESS.2020.2988510 DOI: https://doi.org/10.1109/ACCESS.2020.2988510
Comisión Europea. (2023, abril 19). Qué es la Inteligencia Artificial. Recuperado de https://planderecuperacion.gob.es/noticias/que-es-inteligencia-artificial-ia-prtr
Dulundu, A. (2024). AI in Education: Benefits and Concerns. Next Generation Journal for the Young Researches, 8(1) 81-84 https://doi.org/10.62802/3fr4f412 DOI: https://doi.org/10.62802/3fr4f412
Estrada-Gutiérrez, C. E., Sánchez-Paz, M. L., & Ruiz-Tapia, J. A. (2024). La inteligencia artificial como herramienta en el aprendizaje de alumnos de nivel profesional. Revista de Ciencia Básica, Humanidades, Arte y Educación, 2(4), 63-68. https://doi.org/10.5281/zenodo.10676939
Farina, M., Lavazza, A., Sartori, G., & Pedrycz, W. (2024). Machine learning in human creativity: status and perspectives. AI & Society, 1-13. https://doi.org/10.1007/s00146-023-01836-5 DOI: https://doi.org/10.1007/s00146-023-01836-5
González Solas, J. (2002). Identidad Visual Corporativa. La imagen de nuestro tiempo. Síntesis.
Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., & Steinhardt, J. (2020). Measuring massive multitask language understanding. arXiv preprint https://doi.org/10.48550/arXiv.2009.03300
Hernández Sampieri, R., Fernández Collado, C., & Baptista Lucio, María del Pilar. (2010). Metodologia de la investigación (5ª edición ed.). México: McGraw-Hill.
Herrera-Ortiz, J. J., Peña-Avilés, J. M., Herrera-Valdivieso, M. V., & Moreno-Morán, D. X. (2024). La inteligencia artificial y su impacto en la comunicación: recorrido y perspectivas. Telos: Revista De Estudios Interdisciplinarios En Ciencias Sociales, 26(1), 278-296. https://doi.org/10.36390/telos261.18 DOI: https://doi.org/10.36390/telos261.18
Karmakar, S., & Das, T. Effect of artificial intelligence on education. In Optimization and Computing using Intelligent Data-Driven Approaches for Decision-Making (pp. 198-211). CRC Press. https://doi: 10.1201/9781003536796-8 DOI: https://doi.org/10.1201/9781003536796-8
Kietzmann, J., Paschen, J., & Treen, E. (2018). Artificial intelligence in advertising: How marketers can leverage artificial intelligence along the consumer journey. Journal of Advertising Research, 58(3), 263-267. https://doi.org/10.2501/JAR-2018-035 DOI: https://doi.org/10.2501/JAR-2018-035
Kovanović, V., Joksimović, S., Mirriahi, N., Blaine, E., Gašević, D., Siemens, G., & Dawson, S. (2018). Understand students' self-reflections through learning analytics. In Proceedings of the 8th international conference on learning analytics and knowledge (pp. 389-398). https://doi.org/10.1145/3170358.3170374 DOI: https://doi.org/10.1145/3170358.3170374
Kujundziski, A. P., & Bojadjiev, J. (2025). Artificial Intelligence in Education: Transforming Learning Landscapes. In M. Stevkovska, M. Klemenchich, & N. Kavaklı Ulutaş (Eds.), Reimagining Intelligent Computer-Assisted Language Education (pp. 1-54). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3693-4310-4.ch00 DOI: https://doi.org/10.4018/979-8-3693-4310-4.ch001
La-Rosa, L., Ortega-Fernández, E., & Perlado, M. (2025). Capítulo 2. Inteligencia Artificial en el periodismo, el marketing y la publicidad: una revisión sistématica de la literatura. Espejo De Monografías De Comunicación Social, (36), 33–53. https://doi.org/10.52495/c2.emcs.36.p114 DOI: https://doi.org/10.52495/c2.emcs.36.p114
Li, H., Xue, T., Zhang, A., Luo, X., Kong, L., & Huang, G. (2024). The application and impact of artificial intelligence technology in graphic design: A Critical Interpretive Synthesis. Heliyon. DOI: https://doi.org/10.1016/j.heliyon.2024.e40037
López-Regalado, Ó., Núñez-Rojas, N., López-Gil, Ó. R., & Sánchez-Rodríguez, J. (2024). Análisis del uso de la inteligencia artificial en la educación universitaria: una revisión sistemática. Pixel-Bit. Revista de Medios y Educación 70, 97-122 https://dx.doi.org/10.12795/pixelbit.106336 DOI: https://doi.org/10.12795/pixelbit.106336
Marconi, F. (2020). Newsmakers: Artificial intelligence and the future of journalism. Columbia University Press. DOI: https://doi.org/10.7312/marc19136
Martín-Sanromán, J.-R., Suárez-Carballo, F., & Galindo-Rubio, F. (2022). Identidad Visual Editorial Dinámica y diseño de portadas: el caso de La Luna de Metrópoli (2018-2020). Revista De Comunicación, 21(2), 157–178. DOI: https://doi.org/10.26441/RC21.2-2022-A8
Okhanashvili, S. (2024). Artificial Intelligence in Education. International Scientific Conference EDUCATION, RESEARCH, PRACTICE Proceedings, 5, 71–78. https://doi.org/10.52340/erp.2024.05.06 DOI: https://doi.org/10.52340/erp.2024.05.06
Özdal, M. A. (2024). Artificial Intelligence, Transformation and Expectations in Graphic Design Processes. Journal of Human and Social Sciences, 7(2), 191-211 https://doi.org/10.53048/johass.1490251 DOI: https://doi.org/10.53048/johass.1490251
Panadero, E., & Jonsson, A. (2020). A critical review of the arguments against the use of rubrics. Educational Research Review, 30, 100329. https://doi.org/10.1016/j.edurev.2020.100329 DOI: https://doi.org/10.1016/j.edurev.2020.100329
Río, O., & Velázquez, T. (2005). Planificación de la investigación en comunicación: Fases del proceso. In M. Berganza Conde, & Ruiz San Román, José A. (Eds.), Investigar en comunicación. guía práctica de métodos y técnicas de investigación social en comunicación (pp. 43-76). Madrid: McGraw-Hill.
Rodríguez Valenzuela, P., & Díaz Fernández, N. A. (2024). Estudios sobre la inteligencia artificial como herramienta del diseño gráfico: una investigación documental. Artificio, (5). https://doi.org/10.33064/artificio520244772 DOI: https://doi.org/10.33064/artificio520244772
Russell, S. J., & Norvig, P. (2021). Artificial Intelligence: A Modern Approach (4th ed.). Pearson.
Sanabria-Navarro, J. R., Silveira-Pérez, Y., Pérez-Bravo, D. D., & de-Jesús-Cortina-Núñez, M. (2023). Incidencias de la inteligencia artificial en la educación contemporánea. Comunicar: Revista Científica de Comunicación y Educación, (77), 97-107. https://doi.org/10.3916/C77-2023-08 DOI: https://doi.org/10.3916/C77-2023-08
Sánchez-Vera, F., Perdomo-Reyes, I., & Estévez-Cedeño, B. (2024). Artificial Intelligence and Education: Is It Necessary, Is It Convenient? In Díaz-Noguera, M. D., Hervás-Gómez, C., Sánchez-Vera, F. (Coords.), Artificial Intelligence and Education (pp. 13-30). Octaedro. https://doi.org/10.36006/09643-1-01 DOI: https://doi.org/10.36006/09643-1-01
Sanguineti, R. G. B., Córdova, C. D. C., & Baltazar, A. T. (2024). La inteligencia artificial en la publicidad: una revisión sistemática de la década 2020-2024. Journal of the Academy, (11), 53-82. https://doi.org/10.47058/joa11.4 DOI: https://doi.org/10.47058/joa11.4
Soundarya, M., Devapitchai, J. J., Krishnakumari, S., & Manickam, T. (2025). Applications of Artificial Intelligence Techniques in Education. In Integrating Micro-Credentials With AI in Open Education (pp. 429-450). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3693-5488-9.ch017 DOI: https://doi.org/10.4018/979-8-3693-5488-9.ch017
Vera, F. (2023). Integración de la Inteligencia Artificial en la Educación superior: Desafíos y oportunidades. Transformar, 4(1), 17-34. DOI: https://doi.org/10.56219/dialctica.v1i21.2322
Waghmare, P. (2022). Rubrics in Evaluation: Tool for Outcome Based Education. International journal of health sciences, 6(S2), 4831-4836. https://doi.org/10.53730/ijhs.v6nS2.6166 DOI: https://doi.org/10.53730/ijhs.v6nS2.6166
Wangdi, P. (2024). Integrating Artificial Intelligence in Education: Trends and Opportunities. International Journal of Research in STEM Education, 6(2), 50–60. https://doi.org/10.33830/ijrse.v6i2.1722 DOI: https://doi.org/10.33830/ijrse.v6i2.1722
Zhang, W., & Seong, D. (2024). Using Artificial Intelligence to Strengthen the Interaction between Humans and Computers and Biosensor Cooperation. Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications (JoWUA),15(4), pp. 53-68. doi: 10.58346/JOWUA.2024.I4.005 DOI: https://doi.org/10.58346/JOWUA.2024.I4.005
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Revista de Comunicación

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.