Digital Arts and Humanities - Journal Articles
Permanent URI for this collection
Browse
Recent Submissions
Item Designing an internet of sounds sonification system with fm synthesis techniques(Institute of Electrical and Electronics Engineers (IEEE), 2024) Roddy, StephenSonification, the representation of data with sound to communicate information about the original data source, has the potential to become an important technique for the emerging Internet of Sounds (IoS) research field. This article describes the design of a sonification system for sonification-enabled IoS networks in Smart Cities. It uses FM Synthesis techniques to map data from Smart City sensors to acoustic parameters. After a brief introduction considering topics in IoS and sonification, a formal definition of sonification for the IoS is introduced. The advantages of FM synthesis are explored before a discussion of psychoacoustic constraints specific to this approach. Three data sets for which the application was developed are introduced before design considerations are described apropos of each stage of the sonification process. The article closes with a brief discussion of the design and its implications for IoS research.Item AI/ML in the sonic arts: Pitfalls and pathways(University of California Press, 2023-12-01) Roddy, Stephen; Parmar, RobinThis commentary considers the application of Artificial Intelligence (AI) and Machine Learning (ML) technologies to music and the sonic arts. It critiques the classical computational theory of mind (CCTM), a doctrine deriving from functionalism, which codifies “mind” as a mathematical function symbolic representations from one dimension (mind) can be directly mapped onto another (world) in accordance with a given transfer function. Such a function is thought to be computable on either biological or mechanical hardware, thereby rendering the internal workings of thought irrelevant. This technocratic impulse has been used to sell AI & ML products as “magical” solutions, capable of ushering in Utopian futures. This viewpoint began with the foundation of computer science itself, as metaphors for computational processes were adopted without adequate grounding in the philosophy of mind. Computers were given attributes of human cognition as a teleological basis for investment in these technologies. Our current situaItem Interview: Nao Tokui in conversation with Stephen Roddy(University of California Press, 2023-12-01) Roddy, StephenNao Tokui is an artist, researcher, and DJ who has been finding interesting new ways of integrating artificial intelligence and machine learning (AI/ML) techniques into his eclectic body of work since 2015. Stephen Roddy talked with Nao about his approach to AI in his own work and where he sees the relationship between AI and musical creativity going in the future.Item The Kyoto School and sound art: A nothingness of the absolute(University of California Press, 2023-03-01) Roddy, StephenThis paper explores the thought of key Kyoto School philosophers Nishida Kitar_ō, Tanabe Hajime, and Nishitani Keiji as a novel framework through which to consider the historical development and philosophical underpinnings of sound art. Connections and divergences between these thinkers and key developments in the history of sound art are analyzed and explored. After an introduction to Kyoto School thought, the intersections between the Kyoto School and relevant 20th-century art movements are examined. The paper then spotlights four important themes developed in Kyoto School thought and analyzes key sound art pieces in relation to these themes. The article closes with a brief concluding reflection.Item The design and formalization of an embodied soundscape sonification framework(Taylor and Francis, 2024-11-22) Roddy, StephenThis paper explores the design, evaluation, and formalisation of a framework for the creation of soundscape sonifications: data-to-sound mappings which make use of sounds recorded from real-world sources to communicate information to a listener. This approach is informed by design principles from the field of embodied cognitive science. It opens with a consideration of the relationship between soundscapes, sonification, and embodied cognition design principles. Four approaches to soundscape sonification are presented and evaluated. Evaluation results are presented and analysed before the paper closes with a discussion of the findings and a formalisation of the most effective candidate framework. The article shows how embodied cognition principles can be applied to the design of communicatively effective soundscape sonifications with the takeaway point for researchers being the formalisation of an “Embodied Soundscape Sonification Framework” as a guide to the design of effective soundscape sonifications.