Indexing Music

CILIP Update, December 2008 contains an interesting article by Charlie Inskip who describes his research at City University into ways of describing music – not in musical terms such as form, key, tempo, but in terms of its spatiotemporal context or emotional associations.  In the article, he describes how music gets matched to different sequences in films and commercials, by either the music licensee, or by one of the film directorial or editing crew on the basis of a very subjective and often imprecise description of what is required. Sometimes, when a description of what is required is beyond words, a copy of the relevant scene will simply be supplied to the music owner, in a sort of lucky dip approach. Based on a number of interviews with people involved with selecting music for use with moving images, Charlie’s research is focused on ways of improving how the context of music can be described. He says that:

“…there is a need to extract cultural and musical meaning automatically from the content and context of large numbers of digital music files. I plan now to analyse the interviews further, spread them wider within the industry, – to include games designers, DJs and radio programmers – and evaluate existing systems. By the end of this project I hope to be in a position to develop a reflexive communications model and use my findings to recommend ways to build effective search services for industry purposes.”

Well, if that’s not a fascinating area of research in KO, I don’t know what is. It relates both to the Indexing Video thread in this blog, and to the Semantic Analysis Technology event ISKO UK held on 3 November 2008. From January 2009, Charlie will be writing a regular column on music retrieval in Update. And if Charlie’s research has whet your appetite, then you can read more in a paper he has just had published, together with co-authors Andy MacFarlane and Pauline Rafferty, in the Journal of Documentation, Vol. 64 No. 5, 2008 entitled: “Meaning, communication, music: towards a revised communication model.”

Alert: KO papers of interest

The latest issues of the Journal of Documentation contain a number of papers of interest to ISKO UK members.

64(4) 2008
Chopin, Kimberly. Finding communities: alternative viewpoints through weblogs and tagging.

“This paper aims to discuss and test the claim that use-based tagging allows for access to a wider variety of viewpoints than is found using other forms of online searching.”

Olson, Hope A. & Wolfram, Dietmar. Syntagmatic relationships and indexing consistency on a larger scale.

“The purpose of this article is to examine interindexer consistency on a larger scale than other studies have done to determine if group consensus is reached by larger numbers of indexers and what, if any, relationships emerge between assigned terms.”

64(5) 2008

Inskip, Charles, MacFarlane, Andrew & Rafferty, Pauline. Meaning, communication, music: towards a revised communication model.

“If an information retrieval system is going to be of value to the user then it must give meaning to the information which matches the meaning given to it by the user. The meaning given to music varies according to who is interpreting it – the author/composer, the performer, cataloguer or the listener – and this affects how music is organized and retrieved. This paper aims to examine the meaning of music, how meaning is communicated and suggests this may affect music retrieval.”

64(6) 2008

Wang, Zhonghong, Chaudry, Abdus Sattar & Khoo, Christopher S. G.. Using classification schemes and thesauri to build an organizational taxonomy for organizing content and aiding navigation.

“Potential and benefits of classification schemes and thesauri in building organizational taxonomies cannot be fully utilized by organizations. Empirical data of building an organizational taxonomy by the top-down approach of using classification schemes and thesauri appear to be lacking. The paper seeks to make a contribution in this regard.”

Indexing Video

I detect that discussions around the pros and cons of various communication media lately are veering towards video as having the most immediate impact. I don’t doubt that assertion for a minute. But I do have reservations as to the ability of video to convey precise detail. The emotional and affective power of video is indisputable IMHO, but when it comes to detail, it has strict limitations (yes, you can challenge me on that). That’s why, I believe, the printed word (read also ‘displayed’ to embrace digital media) will take some surpassing when it comes to detail – and findability.

Digital text can be indexed fairly painlessly. But video can’t. That point is made well in David Tebbutt’s column in the current issue of IWR (Information World Review, October 2008). Videos – or slidecasts – are great as ‘experiences’, but if you want to refer back to a specific section, you can’t, because there is no way of indexing specific segments and jumping straight to them.

Am I alone in finding this a significant failing in 21st century IT/KO? Are there ways of doing this that I don’t know about? If anyone knows how to do this, please let us know.