Developing Systemic Functional Linguistics - Theory and Application - Fang Yan

Developing Systemic Functional Linguistics - Theory and Application - Fang Yan

12. Challenges and solutions for multimodal analysis: Technology, theory and practice

Developing Systemic Functional Linguistics - Theory and Application - Fang Yan

Bradley A. Smith [+-]
School of Education at Curtin University
Bradley A. Smith is a Research Fellow in the School of Education at Curtin University, Australia. He has previously worked in a learning and teaching centre at the University of Melbourne, and in the Multimodal Analysis Lab at the National University of Singapore. His PhD thesis (2008, Macquarie University) is entitled ‘Intonation and Register: A Multidimensional Exploration’. His major research interests are intonation, register, communication in higher education, and multimodality, with a focus on the roles of sound-based semiotic resources within cultures. His publications include (with William S. Greaves) the chapter on intonation for the forthcoming Bloomsbury Companion to Halliday, co-editor (with Kay L. O’Halloran) of Multimodal Studies: Exploring Issues and Domains (2011), as well as several journal articles, book chapters, two invited encyclopaedia entries in the Encyclopedia of Applied Linguistics (2013) and an invited review for Linguistics and the Human Sciences of Halliday and Greaves’ (2008) Intonation in the Grammar of English.
Kay L. O'Halloran [+-]
Associate Professor in the School of Education, Curtin University, Australia.
Kay O’Halloran is Associate Professor in the School of Education, Curtin University, Australia. Prior to this, she was Associate Professor with tenure in the Department of English Language & Literature at the National University of Singapore. During this time, she held a joint appointment as the founding Director of the Multimodal Analysis Lab and Deputy Director of the Interactive Digital Media Institute, a university-level research institute at the National University of Singapore. Her areas of research include multimodal analysis, mathematical discourse, digital humanities and the development of digital technologies and visualization techniques for multimodal and socio-cultural analytics. Kay O’Halloran has published widely in these fields, and she is the founding editor of the Routledge Studies in Multimodality Book Series.
Alexey Podlasov
Sheer Industries Group
Victor Fei [+-]
Educational Technology Division, Ministry of Education in Singapore
View Website
Dr Victor Lim Fei is Senior Head for Technologies for Learning, and Senior Specialist, at the Educational Technology Division, Ministry of Education, Singapore. He is a multimodal discourse analyst and an educator. He is interested in different modes of knowledge representation as well as innovative teaching, learning and assessment practices enabled by technology. Victor’s research areas include multimodality, multimodal literacy, discourse analysis, sociolinguistics, educational technology and learning sciences. Victor has been active in the field of multimodality over a decade. He was a recipient of several scholarships, including the Singapore Ministry of Education Postgraduate Scholarship, the National University of Singapore Research Scholarship, and the Singapore Public Service Commission Scholarship. Victor’s publications include invited book chapters, articles, as well as papers in top-tier journals such as the Cambridge Journal of Education. He is also an invited reviewer of several journals. He blogs at Multimodal Literacy and Perspectives. Victor is a founding member and serves on the Board of directors (non-remunerative) for CityCare, a non-profit organisation set up in 2007 for local community work and international humanitarian projects. He has participated in these efforts, such as being on the disaster relief team to help in the aftermath of the 2010 earthquake in Haiti as well as leading several school-development projects in China.

Description

In what follows, the principal functionalities of Semiomix are first described (see also O’Halloran et al., 2012) and then illustrated via screenshots from Professor W. Gilbert Strang’s first lecture in Linear Algebra from Massachusetts Institute of Technology (MIT) Open Courseware (OCW).1 Following this, Professor Strang’s use of language and gesture are interpreted in relation to the different stages of the mathematics lecture. Finally, the achievements and limitations of the existing version of Semiomix are described with view to future research.

Notify A Colleague

Citation

Smith, Bradley A. ; O'Halloran, Kay L.; Podlasov, Alexey; Fei, Victor Lim. 12. Challenges and solutions for multimodal analysis: Technology, theory and practice. Developing Systemic Functional Linguistics - Theory and Application. Equinox eBooks Publishing, United Kingdom. p. 271 - 297 Feb 2014. ISBN 9781845539955. https://www.equinoxpub.com/home/view-chapter/?id=19472. Date accessed: 26 Nov 2022 doi: 10.1558/equinox.19472. Feb 2014

Dublin Core Metadata