???global.info.a_carregar???
Ricardo Malheiro is a researcher in Artificial Intelligence, with a PhD in Informatics Engineering from the University of Coimbra and a member of the Cognitive and Media Systems group at CISUC. His research focuses on Natural Language Processing, affective computing, and multimodal analysis of music, with particular emphasis on emotion modelling in lyrics, audio, and combined modalities. His work has advanced the modelling of emotions in music through the development of datasets, methodologies, and machine learning approaches for Music Emotion Recognition, including sustained contributions in high-impact venues such as IEEE Transactions on Affective Computing. His recent research extends this line of work towards generative AI, targeting controllable music and lyrics generation based on psychological models of emotion. He is currently an Assistant Professor at the Polytechnic Institute of Leiria, where he teaches in the areas of data science, text mining, and decision support systems, and supervises MSc and PhD students in AI-related topics. He has been actively involved several research projects, contributing to the advancement of intelligent and multimodal systems.
Identification

Personal identification

Full name
Ricardo Malheiro

Citation names

  • Malheiro, R.

Author identifiers

Ciência ID
B81A-CB99-A4DF
ORCID iD
0000-0002-3010-2732
Google Scholar ID
km30M3UAAAAJ&hl

Websites

Knowledge fields

  • Exact Sciences - Computer and Information Sciences
Education
Degree Classification
2011 - 2017
Concluded
Doutoramento em Ciências e Tecnologias da Informação (Doutoramento)
Universidade de Coimbra, Portugal
"Emotion-based Analysis and Classification of Music Lyrics" (THESIS/DISSERTATION)
16 (AUDL)
2004
Concluded
Mestrado em Engenharia Informática (Mestrado)
Universidade de Coimbra, Portugal
"Sistemas de Classificação Automática em Géneros Musicais" (THESIS/DISSERTATION)
Muito Bom
1997
Concluded
Licenciatura em Matemática - Sistemas e Métodos de Computação Gráfica (Licenciatura)
Universidade de Coimbra, Portugal
"Aplicação da Tecnologia Web em Quiosques Multimédia" (THESIS/DISSERTATION)
Affiliation

Science

Category
Host institution
Employer
2002/09 - Current Researcher (Research) Universidade de Coimbra, Portugal

Teaching in Higher Education

Category
Host institution
Employer
2022/02 - Current Adjunct Teacher (Polytechnic Teacher) Instituto Politécnico de Leiria Escola Superior de Tecnologia e Gestão, Portugal
Instituto Politécnico de Leiria Escola Superior de Tecnologia e Gestão, Portugal
2004/09 - 2022/02 Assistant Professor (University Teacher) Instituto Superior Miguel Torga, Portugal
2007/09 - 2010/08 Assistant (University Teacher) Instituto Politécnico de Leiria, Portugal
2000/09 - 2007/08 Assistant (University Teacher) Universidade Católica Portuguesa, Portugal
2005/09 - 2007/02 Assistant (University Teacher) Universidade Internacional da Figueira da Foz, Portugal
1998/09 - 1999/08 Assistant (University Teacher) Instituto Politécnico de Leiria, Portugal

Others

Category
Host institution
Employer
2012/01 - 2012/12 Outra Situação (Docente Universitário) Inweb, Portugal
2012/06 - 2012/06 Outra Situação (Docente Universitário) AFTEBI – Assoc para Formação Tecnológica e Profissional da Beira Interior, Portugal
2009/01 - 2009/12 Outra Situação (Docente Universitário) ArchivCompact, Portugal
Projects

Contract

Designation Funders
2014 - Current MOODetector Reloaded: A System for Mood-based Classification, Retrieval and Analysis of Audio and Lyrics from Music
Researcher
Universidade de Coimbra, Portugal
Fundação para a Ciência e a Tecnologia
Concluded
2023 - 2025 BLOCKCHAIN.PT – Agenda “Descentralizar Portugal com Blockchain"
Supervisor
Instituto Politécnico de Leiria, Portugal

Universidade de Aveiro UACOOPERA, Portugal
Ongoing
2021 - 2025 MERGE: Music Emotion Recognition - Next Generation
Investigador responsável pela coordenação técnica e liderança de tarefas do projeto
Universidade de Coimbra Centro de Informatica e Sistemas, Portugal
Fundação para a Ciência e a Tecnologia
Concluded

Other

Designation Funders
2010 - 2013 MOODetector: A System for Mood-based Classification and Retrieval of Audio Music
FCT PTDC/EIA-EIA/102185/2008
Researcher
Universidade de Coimbra, Portugal
Concluded
Outputs

Publications

Book
  1. Malheiro, R.. Emotions Detection in Music Lyrics using Machine Learning and Keyword-Based Approaches. 2018.
Conference paper
  1. Malheiro, R.. Corresponding author: Malheiro, R.. "PACS-to-FHIR transformation: a case of study with computed tomography". Paper presented in HCist – International Conference on Health and Social Care Information Systems and Technologies, abu Dhabi, 2025.
    Published
  2. Malheiro, R.. "BEE-MER: Bimodal Embeddings Ensemble for Music Emotion Recognition". Paper presented in In 22nd Sound and Music Computing Conference, Graz, 2025.
    Published
  3. Malheiro, R.. "Improving Music Emotion Recognition By Leveraging Handcrafted and Learned Features". Paper presented in in Proc. of the 1st Latin American Music Information Retrieval Workshop (LAMIR), Rio de Janeiro, 2024.
  4. Malheiro, R.. "Exploiting Automatic Source Separation and Music Transcription for Music Emotion Recognition". Paper presented in . in Proc. of Workshop on Affective Artificial Intelligence (A2I) at 27th International Conference on Pattern Recognition, Kolkata, 2024.
  5. Malheiro, R.. "Exploring Deep Learning Methodologies for Music Emotion Recognition". Paper presented in In Sound and Music Computing Conference – SMC 2024, Porto, 2024.
    Published
  6. Malheiro, R.. "Exploring Song Segmentation for Music Emotion Variation Detection". Paper presented in In 15th International Workshop on Machine Learning and Music (MML). MML 2024, in conjunction with the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Vilnius, 2024.
    Published
  7. Pedro Louro; Guilherme Branco; Hugo Redinho; Ricardo Correia; Ricardo Malheiro; Renato Panda; Rui Paiva. "MERGE App: A Prototype Software for Multi-User Emotion-Aware Music Management". 2024.
    10.5220/0013067800003838
  8. Malheiro, R.. "Improving Deep Learning Methodologies for Music Emotion Recognition". Paper presented in In 30th Portuguese Conference on Pattern Recognition, RECPAD 2024, Covilhã, 2024.
  9. Panda, R.; Redinho, H.; Gonçalves, C.; Malheiro, R.; Paiva, R.P.. "HOW DOES the SPOTIFY API COMPARE to the MUSIC EMOTION RECOGNITION STATE-OF-THE-ART?". 2021.
  10. Panda, Renato; Malheiro, R.; Paiva Rui Pedro. "Musical Texture and Expressivity Features for Music Emotion Recognition". Paper presented in 19TH INTERNATIONAL SOCIETY FOR MUSIC INFORMATION RETRIEVAL CONFERENCE, Paris, 2018.
  11. Ricardo Malheiro; Renato Panda; Paulo Gomes; Rui Pedro Paiva. "Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset". Paper presented in 9th International Workshop on Machine Learning and Music, Riva del Garda, 2016.
    Published
  12. Malheiro, Ricardo. "Classification and Regression of Music Lyrics: Emotionally-Significant Features". 2016.
    10.5220/0006037400450055
  13. Malheiro, R.. "Keyword-Based Approach for Lyrics Emotion Variation Detection". 2016.
    10.5220/0006037300330044
  14. Renato Panda; Ricardo Malheiro; Bruno Rocha; António Oliveira; Rui Pedro Paiva. "Multi-Modal Emotion Music Recognition (MER): A New Dataset, Methodology and Comparative Analysis". Paper presented in 10th International Symposium on Computer Music Multidisciplinary Research, Marselha, 2013.
    Published
  15. Ricardo Malheiro; Renato Panda; Paulo Gomes; Rui Pedro Paiva. "Music Emotion Recognition from Lyrics: A Comparative Study". Paper presented in 6th International Workshop on Machine Learning and Music, Praga, 2013.
    Published
  16. Francisco Reis; Ricardo Malheiro. "Jogos em ambiente 3D com uso de QR Codes para avaliação de alunos". Paper presented in Encontro sobre Jogos e Mobile Learning, Coimbra, 2012.
    Published
  17. Malheiro, R.. "Umniversity virtual world platform for massive open online courses University Platform". Paper presented in IE Challenges 2011, Braga, 2011.
    Published
  18. Francisco Reis; Ricardo Malheiro. "Umniversity Platform - Four Integration Vectors Towards Mobile Learning”". Paper presented in IADIS International Conference for Mobile Learning, Ávila, 2011.
    Published
  19. Reis, F.; Malheiro, R.. "Umniversity platform - Four integration vectors towards mobile learning". 2011.
  20. Christopher Burrows; Ricardo Malheiro. "Using Information Retrieval Techniques for Keyword and Evaluation Extraction". Paper presented in IADIS International Conference for Information Systems, Algarve, 2008.
    Published
  21. Ricardo Malheiro; Rui Pedro Paiva; Amílcar Cardoso; Teresa Mendes; António Mendes. "A Prototype for Classification of Classical Music using Neural Networks". Paper presented in 8th IASTED International Conference on Artificial Intelligence and Soft Computing, Marbella, 2004.
    Published
  22. Ricardo Malheiro; Rui Pedro Paiva; Amílcar Cardoso; Teresa Mendes; António Mendes. "Classification of Recorded Classical Music: A Methodology and a Comparative Study". Paper presented in 1st International ICSC Symposium on Brain Inspired Cognitive Systems, Stirling, 2004.
    Published
  23. Ricardo Malheiro; Rui Pedro Paiva; Amílcar Cardoso; Teresa Mendes; António Mendes. "Classification of Recorded Classical Music using Neural Networks". Paper presented in 4th International ICSC Symposium on Engineering of Intelligent Systems, Funchal, 2004.
    Published
Journal article
  1. Redinho, Hugo; Louro, Pedro Lima; Santos, André C.; Malheiro, Ricardo; Paiva, Rui Pedro; Panda, Renato. "Percussion and Instrumentation in Music Emotion Recognition: A Feature Engineering Approach". IEEE Transactions on Affective Computing 17 1 (2026): 913-929. https://doi.org/10.1109/taffc.2025.3640527.
    10.1109/taffc.2025.3640527
  2. Louro, Pedro Lima; Redinho, Hugo; Ribeiro, Tiago Filipe Rodrigues; Santos, Ricardo; Malheiro, Ricardo; Panda, Renato; Paiva, Rui Pedro. "MERGE: A Bimodal Audio-Lyrics Dataset For Static Music Emotion Recognition". IEEE Transactions on Affective Computing (2026): 1-18. https://doi.org/10.1109/taffc.2026.3668037.
    10.1109/taffc.2026.3668037
  3. João António; Ricardo Malheiro; Sandra Jardim. "Feedback Collection and Nearest-Neighbor Profiling for Recommendation Systems in Healthcare Scenarios". Technologies (2024): https://www.mdpi.com/2227-7080/12/8/127.
    10.3390/technologies12080127
  4. Pedro Lima Louro; Hugo Redinho; Ricardo Malheiro; Rui Pedro Paiva; Renato Panda. "A Comparison Study of Deep Learning Methodologies for Music Emotion Recognition". Sensors (2024): https://www.mdpi.com/1424-8220/24/7/2201.
    10.3390/s24072201
  5. Panda, R.; Malheiro, R.; Paiva, R.P.. "Audio Features for Music Emotion Recognition: A Survey". IEEE Transactions on Affective Computing 14 1 (2023): 68-88. http://www.scopus.com/inward/record.url?eid=2-s2.0-85149499244&partnerID=MN8TOARS.
    10.1109/TAFFC.2020.3032373
  6. Ricardo Malheiro; Renato Panda; Paulo Gomes; Rui Pedro Paiva. "Emotionally-Relevant Features for Classification and Regression of Music Lyrics". IEEE Transactions on Affective Computing 9 2 (2018): 240-254.
    Accepted • 10.1109/TAFFC.2016.2598569
  7. Malheiro, Ricardo. "Novel Audio Features for Music Emotion Recognition". IEEE Transactions on Affective Computing (2018): https://ieeexplore.ieee.org/document/8327886.
    10.1109/TAFFC.2018.2820691
  8. Ricardo Malheiro; Rui Pedro Paiva; Amílcar Cardoso; Teresa Mendes; António Mendes. "Sistemas de Classificação Musical com Redes Neuronais". Gestão e Desenvolvimento 12 1 (2004): 167-195.
    Published
  9. Malheiro, R; Paiva, RP; Mendes, AJ; Mendes, T; Cardoso, A. "Prototype for classification of classical music using neural networks". Proceedings of the Eighth IASTED International Conference on Artificial Intelligence and Soft Computing (2004): https://publons.com/publon/8550262/.

Other

Other output
  1. Aplicação da Tecnologia Web em Quiosques Multimédia. 1997. Ricardo Malheiro.
Activities

Oral presentation

Presentation title Event name
Host (Event location)
2016 Bi-Modal Music Emotion Recognition: Novel Lyrical Features and Dataset 9TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING AND MUSIC
MML 2016 (Riva del Garda, Italy)
2016 Classification and Regression of Music Lyrics: Emotionally-Significant Features 8TH INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL
International Conference on Knowledge Discovery and Information Retrieval (Porto, Portugal)
2016 Keyword-Based Approach for Lyrics Emotion Variation Detection 8TH INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL
International Conference on Knowledge Discovery and Information Retrieval (Porto, Portugal)
2012 Técnicas e Ferramentas para Alcançar a Eficácia e a Produtividade e Técnicas OLAP e de Data Mining para melhorar os processos de tomada de decisão
AFTEBI – Associação para a Formação Tecnológica e Profissional da Beira Interior (Covilhã, Portugal)
2009 Semantic Web Escola de Verão - Aspectos do Processamento de Linguagem Natural em português – Ferramentas e recursos existentes
Centro de Linguística da Universidade do Porto (CLUP) (Porto, Portugal)
2008 Sistemas de Apoio à Decisão nas Organizações” no Colóquio Globalização, Organizações e Flexisegurança
ISMT (Coimbra, Portugal)
2007 Web Content Mining para Português – Uma perspectiva semântica AILab Workshop
CISUC (Coimbra, Portugal)
2006 Web Content Mining for Portuguese – A Semantic Perspective AILab Winter Meeting 2006
CISUC (Coimbra, Portugal)
2004 Classification of Recorded Classical Music using Neural Networks 4º Simpósio Internacional em “Engineering of Intelligent Systems
(Funchal, Portugal)
2004 A Prototype for Classification of Classical Music using Neural Networks 8ª Conferência Internacional em Artificial Intelligence and Soft Computing
(Marbelha, Spain)

Supervision

Thesis Title
Role
Degree Subject (Type)
Institution / Organization
2024 - 2029 Lyrics-based Music Emotion Recognition
Co-supervisor
Doutoramento em Ciêncis e Tecnologia da Informação (PhD)
Universidade de Coimbra, Portugal
2023 - 2028 Feature Engineering and Learning for Music Emotion Recognition
Co-supervisor
Doutoramento em Ciências e Tecnologias de Informação (PhD)
Universidade de Coimbra, Portugal
2025 - 2026 DIÁRIO EMOCIONAL DIGITAL COM ASSISTENTE PERSONALIZADO E MEMÓRIA LONGO PRAZO
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2025 - 2026 GERAÇÃO DE ÁUDIO MUSICAL COM EMOÇÃO ESPECÍFICA
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2025 - 2026 MOODMAIL ASSISTENTE INTELIGENTE PARA REFORMULAÇÃO EMOCIONAL DE E-MAILS
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2025 - 2026 SISTEMA CONVERSACIONAL COM GERAÇÃO DE RESPOSTAS EMOCIONALMENTE COERENTES EM TEXTO E FALA
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2025 - 2026 ANÁLISE PREDITIVA E DESCOBERTA DE PADRÕES EM INCÊNDIOS FLORESTAIS EM PORTUGAL: UMA ABORDAGEM DE DATA MINING COM APLICAÇÃO REAL AO ICNF
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2024 - 2025 Self-Similarity Matrices and Localized Attention for Chorus Recognition: A Data-Efficient Music Information Retrieval Approach
Supervisor of José Daniel Luna Mena
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2024 - 2025 Criational: Generation of Song Lyrics with Emotional Context Using Deep Learning Models
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2024 - 2025 Sumarização automática de letras musicais: Identificação de temas e emoções
Supervisor
Mestrado em Ciência de Dadaos (Master)
Instituto Politécnico de Leiria, Portugal
2024 - 2025 Deep Structural Analysis: Automatic Song Segmentation and Classification for Static Music Emotion Recognition and Music Emotion Variation Detection
Co-supervisor
Informatics Engineering (Master)
Universidade de Coimbra, Portugal
2024 - 2025 Advancing Lyrics Music Emotion Recognition: Emotion-Centric Feature Extraction
Co-supervisor of Luís Pedro Maia Seco
Mestrado em Data Science and Engineering (Master)
Universidade de Coimbra, Portugal
2024 - 2025 MERGE Lyrics: Next-Generation Lyrics Music Emotion Variation Detection
Co-supervisor
Mestrado em Data Science and Engineering (Master)
Universidade de Coimbra, Portugal
2023 - 2024 MLCASE: Plataforma Automatizada de Desenvolvimento de Modelos de Machine Learning Simplificando e acelerando o processo de construção de modelos para Cientistas de Dados
Supervisor of Bruna Filipa Menó de Sousa
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2022 - 2023 MERGE Audio: Audio Analysis and Feature Engineering for Music Emotion Recognition
Co-supervisor of Hugo José Amado Redinho
Mestrado em Informatics Engineering (Master)
Universidade de Coimbra, Portugal
2022 - 2023 Aplicação de RAG em Modelos LLM com Bases de Dados Vetoriais
Supervisor of Ruben Alexandre Dias Marques
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2022 - 2023 Modelling Gamified Exercise to Support Therapeutic Monitoring of Frailty in Older Adults
Supervisor of João Miguel Abrantes Marques António
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2021 - 2022 MERGE Lyrics Lyrics Classification with Deep Learning
Supervisor
Mestrado em Ciência de Dados (Master)
Instituto Politécnico de Leiria, Portugal
2020 - 2021 Projeto de exploração e engarrafamento de água mineral Aplicação real do software Power BI da Microsoft
Supervisor
Mestrado em Controlo de Gestão (Master)
Instituto Politécnico de Coimbra Instituto Superior de Contabilidade e Administração de Coimbra, Portugal
2012 - 2012 Avaliação de condições motivacionais e satisfatórias em contexto laboral
Co-supervisor
Mestrado em Gestão de Recursos Humanos e Comportamento Organizacional (Master)
Instituto Superior Miguel Torga, Portugal
2011 - 2011 O Impacto da Implementação do Sistema de Gestão da Qualidade na Satisfação dos Clientes
Co-supervisor
Mestrado em Gestão de Recursos Humanos e Comportamento Organizacional (Master)
Instituto Superior Miguel Torga, Portugal
2010 - 2010 Caracterização dos alunos do Instituto Superior Miguel Torga: Uma abordagem motivacional
Co-supervisor
Mestrado em Gestão de Recursos Humanos e Comportamento Organizacional (Master)
Instituto Superior Miguel Torga, Portugal
2010 - 2010 O impacto da formação em contexto laboral
Co-supervisor
Mestrado em Gestão de Recursos Humanos e Comportamento Organizacional (Master)
Instituto Superior Miguel Torga, Portugal

Journal scientific committee

Journal title (ISSN) Publisher
2021 - Current Multiple international journals (including IEEE Transactions on Affective Computing and IEEE Access) Various (IEEE and others)