Every film or TV programme delivered over a digital TV system – broadcast or online – is associated with a set of ‘metadata’ of one sort or another that includes descriptive information about the content, including such things as title, story-line, cast, genre, release date, running-time, and so on.
It is this data that drives Electronic Programme Guides (EPGs) and search and recommendation engines – and the more detailed it is, the greater the value it delivers. Peter Docherty, Founder and CTO of ThinkAnalytics, whose content and recommendations engine services more than 130 million subscribers worldwide via its various Pay TV customers, claims that one of the reasons his company’s technology results in viewers watching more channels and VOD is because it both re-analyses existing programme metadata (which he says is often incomplete) to extract more meaning from it and adds extra information to it from ThinkAnalytics’ own libraries (ThinkMovies and ThinkTV). Between them these contain detailed metadata for over a million titles. “It is the combination of that data, that we’ve created, with the viewing data, that lets us really understand the consumer,†he maintains.
Recently, another layer of programme metadata has become available which potentially offers even greater personalisation benefits, by subjecting the video content itself to computer analysis, producing data similar to that created through audio description or closed captioning.
Alex Phillips, Senior Managing Consultant in the Communication Practice at IBM’s Global Business Services Division, notes that IBM has developed its own technology for doing this, whereby “analysing the images in each video frame and looking at the features there, you are able to automatically produce metadata – and tag the content automatically, too. You might be able to detect that there’s a sports scene, that there’s blue sky, there’s a crowd, there’s football being played, there are footballers running around the pitch.â€
Andy Aftelak, Vice President and Director in Advanced Technology at ARRIS, whose Pay TV and broadband solutions cover the network, backoffice, headend and home, dubs this ‘temporal’ metadata, and notes that ARRIS has been running such an analytics engine, which it calls its Media Analysis Framework (or MAF), for a number of years. “The whole idea here is to extract some sort of meaning from the content, so that you can create new experiences or use your understanding of what’s going on in the context to be a trigger for something else,†he explains.
Potential use-cases for temporal metadata abound. Phillips cites one obvious application as “going back over news archives and automatically analysing them and tagging them and making them searchable.†Indeed, he suggests, one could in principle go back over any archive to re-process it if standard metadata were absent, rendering it potentially monetizable for the first time.
Aftelak suggests that once such systems can detect structure in programmes, these can automatically be “chapterisedâ€: thus a sports event could be split up “into highlights and normal play, so that you can create personalised highlights for a specific demographic.â€
Eric Abbruzzese, Research Analyst at ABI Research (the technology market intelligence provider), notes that with traditional metadata “you can search for an actor and see what he is in, but maybe with temporal metadata you can figure out exactly what scene – so if you want to see where Tom Cruise first appears in his latest movie, you can skip directly to it when that happens.â€
Suranjan Som, Media Insights Evangelist at data analysis specialists Information Management Group Ltd (IMGROUP) believes this new type of metadata “does add a lot of value on the content side, especially if that content is meant for non-linear consumption – video downloads and things like that. This metadata can then be harnessed to improve searchability. As soon as you do that, the ranking of the video goes higher, and therefore you have a better way of monetizing that video online.â€
Having more meaningful metadata at your disposal improves the prospects for television-related advertising as well. The ability of systems using temporal metadata to recognize onscreen objects – particularly faces –is regarded as potentially valuable. “If you can, for example, detect when a specific actor or actress is on the screen, you can use that as a trigger to do or not do things. You might want to trigger an overlay which is a promotion for another show that the actor is in,†suggests Aftelak. “Or you could use that to trigger an ad, because that actor or actress sponsors a particular product.â€
More reading
This is an excerpt from Videonet’s latest report, ‘Boosting television prospects with enriched data analytics’, which goes into more detail about the potential for temporal metadata to enhance advertising.
The report investigates how media companies can use a combination of viewing data, better programme metadata and network performance statistics to super-charge their content marketing and monetization, and strengthen advertising. It investigates what a holistic, enterprise-wide data analytics strategy looks like, with insights from Channel 4, Sky Media, ABI Research, ARRIS, ThinkAnalytics, IBM Global Business Services Division, Clearleap and IMGROUP, among others.
You can download the report (free) here.