BBC Lab UK

From Infogalactic: the planetary knowledge core
Jump to: navigation, search

BBC Lab UK is a BBC website that allowed the public to take part in online experiments by completing tests and surveys.[1] The website was active for four years until its data collection ceased in May 2013. It remains online and is available for participants to view their feedback.[2]

Lab UK was commissioned in 2008, in response to other online ‘citizen science’ projects such as Galaxy Zoo and BugGuide. However the intention was to harness the BBC’s audience for mass participation to achieve very high numbers of cases.[3]

A number of professional scientists were engaged to consult on the design and development of the website, as well as the design of individual experiments which the public would engage with.

Each web experiment was structured to give feedback on the activity of the participant, immediately after they had submitted their data. Collectively, the experiment data would be handed over securely to the scientist who had designed the experiment. The analysis of the experiment data would be conducted by the scientist’s research team. Where possible, the BBC actively encouraged the publication of the results in peer-reviewed journals.[4]

The first experiment was published in 2009 and the final experiment was launched in 2012. The website stopped collecting data in May 2013 after its migration to the Knowledge & Learning product.

History

The BBC’s iF&L department had published several online quizzes to accompany BBC science television programming. Scientists such as Dr Val Curtis and Dr Stian Reimers asked whether they might analyse the anonymous data generated by the completion of these online quizzes. In ‘The Disgust Test’[5] and ‘Sex ID’,[6] specific hypotheses were tested in the online experiments. The results were published in specialist journals. BBC's Multiplatform commissioners decided to make a re-usable experiment publication platform that could save all data to a common database.

Experiments

The Big Stress Test

The Big Stress Test was Lab UK’s beta launch candidate in May 2009. The experiment was designed by Professor Peter Kinderman from the University of Liverpool. The experiment was promoted via the BBC’s mental health and wellbeing website ‘Headroom’. This experiment received roughly 6,000 participants. The experiment was updated and re-launched in 2011.

Brain Test Britain

A collaboration with the Medical Research Council, Cambridge University, King's College London, the Alzheimer's Society and the BBC One Television programme, Bang Goes The Theory - this longitudinal experiment, launched in September 2009, sought to discover whether brain training games made any improvement to IQ for a healthy, general population.[7] The Lab UK website hosted a series of brain training games and the study was structured as a clinical randomised controlled trial. The study contained over 60,000 people for 6 weeks. The study designers, Dr Adrian Owen and Professor Clive Ballard analysed the data and concluded the games made no difference to a healthy adult population.[8] The results were published in Nature and televised on a BBC One special.

The Big Personality Test

Launched on BBC One’s One Show in November 2009, this cross-sectional survey was developed in partnership with University of Cambridge. It used the Big Five personality measure and a range of other well-used psychometric and health measures to determine the correlations between personality and life outcomes. The results informed the returning series ‘Child of Our Time’.[9] The online website featured interactive video presented by Professor Robert Winston which presented your personal results of the personality test. The experiment received over 100,000 participants in the first two days and has received more than 750,000 participants in total.[10]

The Web Behaviour Test

This experiment was launched in conjunction with the BBC Two programme ‘The Virtual Revolution’ in February 2010.

How Musical Are You?

Developed by researchers at Goldsmiths College, University of London, this experiment explored the relationship between potenitally untapped musical ability and musical sophistication. The test was promoted in conjunction with BBC Radio 3’s ‘Genius of Mozart' season in January 2011.

The Great British Class Survey

This was the first social science experiment to be co-commissioned by the BBC’s Current Affairs department.[11] Professor Mike Savage and Professor Fiona Devine designed a survey to measure different sociological capitals. The stated ambition was to create a new snapshot of British society and develop some newer, more relevant class labels for the 21st century. The BBC later commissioned a face-to-face recruited survey of roughly 1000 people to overcome the intrinsic class bias of the BBC audience.[12] The survey was promoted on BBC One’s One Show by Professor Mike Savage in January 2011. (also see 'The Great British Class Survey')

The Big Money Test

Collaborating with BBC One’s consumer programme Watchdog, this experiment aimed to discover the psychological traits that led to money problems in a large general population. The test was designed by researchers from the Open University and University College London. It was launched in April 2011 by Watchdog’s finance presenter, Martin Lewis, who featured in the interactive video feedback.[13]

The Big Risk Test

This experiment was developed by Professor David Spiegelhalter and Dr Mike Aitken of Cambridge University. It tested a hypothesis of linkage between numeracy and judgement of risk. The experiment contained various verified measures and a selection of interactive puzzles which tested various aspects of risk judgement. The experiment was promoted on the BBC One science TV programme, “Bang Goes the Theory” in April 2011.[14]

The BBC Stress Test

This updated version of the earlier experiment presented more comprehensive feedback and was re-launched by Claudia Hammond on BBC Radio 4’s ‘All in the Mind’ in June 2011.[15]

The Get Yourself Hired Test

This experiment into job seekers’ psychological skills accompanied BBC Three’s ‘Up For Hire’ programme. It was promoted in October 2011.[16]

Test Your Morality

This experiment was developed by researchers at the London School of Hygiene and Tropical Medicine. Building on from ‘The Disgust Test’, this test aimed to test a Human Superorganism hypothesis, and an evolutionary theory of human morals. The survey contained detailed demographic information and 33 ‘vignettes’ which attempted to test people’s responses to immoral behaviour across different moral domains. The test was promoted in November 2011.[17]

Can You Compete Under Pressure?

This experiment was developed by researchers from Sheffield and Wolverhampton Universities. The experiment aimed to test how effective 4 different sports psychology techniques were compared to a control in improving performance at a simple number grid task.[18] The test provided randomised psychological interventions to participants via video clips from Olympic sprinter, Michael Johnson. Participants played the 'Grid' game four times and their performance improvement (or not) was measured. Part of the interactive video feedback by Johnson was the first item to be filmed at Lund Point, the de-commissioned block of flats in Stratford that was to become BBC TV’s Olympic HQ . The experiment was launched by Michael Johnson on BBC One’s The One show in May 2012.[19]

Results

The Stress Test

The original data was combined with the data from the re-launched experiment. The findings were significant and were publicised both in peer-reviewed journals and on BBC News and Radio platforms. An All in the Mind special edition detailed some of the ‘thinking styles’ which can lead to depression. More than 30,000 cases of data were analysed to find these results.[20]

Brain Test Britain

The data from the longitudinal study was analysed and the results were featured in Nature - ‘Putting brain training to the test’. The results were publicised on BBC One’s Bang Goes the Theory Television programme. The results have caused some controversy, as some researchers said the study ignored the training effects on older, less healthy subjects and that the study instruments weren’t sufficiently similar to commercially available products.[21][22]

The Big Personality Test

Preliminary results were extracted from the initial data, which contained more than 100,000 cases. These were used to inform the subject matter of the BBC One TV programme, ‘Child of Our Time’ which aired in May 2010. Over 500,000 cases were recorded in the database by May 2013.[23] The first peer-reviewed paper published based on these data, concerned the psychological aspects of childhood sexual abuse survivors.[24] A study has been published examining the geographical associations between personality and life satisfaction using over 50,000 cases from residents of London. [25] A further study, mapping the regional differences in personality in Great Britain was published in PLoS One.[26] These two studies were the basis for the BBC iWonder's interactive guide "Where in Britain would you be happiest?"[27]

The Big Money Test

Over 100,000 people completed the survey. The results were written up in a report in March 2012. The test found clear linkage between impulse buying behaviour and serious financial problems.[28]

How Musical Are You?

Over 150,00 people completed the test.The researchers’ findings were published in PLoS One in February 2014.[29]

The Great British Class Survey

Over 150,000 cases of data plus the recruited GfK survey led to a paper in Sociology.[30] This was synchronised with the publication in March 2013 in the BBC News website of the Great British Class Calculator. The calculator is a web application that asks seven questions from the original survey, and categorises each person into the newly found class categories, depending on their results.[31] The calculator was extremely popular with it being used over 6.5 million times in a week.[32] However it was misunderstood in some quarters with some people thinking it generated the results itself, rather than analysis of the original survey data. The Class Calculator spawned spoofs in popular media but also serious criticism in social science circles.[33] The paper published by Sage Journals is the most downloaded Sociology journal paper of all time with over 23,000 downloads.[34] The paper revealed a new class system for Britain with seven classes which described the changing stratification of modern Britain and the reduction of size of traditional class segments like the working class and the traditional middle class.

Technical challenges

The BBC Lab UK platform was built using the BBC’s new Forge application server, and was interconnected with other BBC online services such as BBC ID, BBC EMP, MemCache amongst others. BBC ID was employed as a sign-ed service was needed to help keep participant’s data secure, and to prevent malicious submissions. The BBC Lab UK platform was re-built three times. First in 2010 to improve scalability.[35] Second, in 2011 to reduce loadtimes and server load. A third time in 2012 to re-factor after substantial changes in the BBC online infrastructure.

De-commission

After BBC Multiplatform’s dissolution in 2011, BBC Lab UK was one of a number of web products migrated to the new Knowledge & Learning product. Senior management decided in 2013 that all technical effort would now be spent building this product rather than supporting the Lab UK service. From 1 May 2013, the website stopped collecting experiment data, although most of the experiments still offer feedback to those who have already completed the tests. However, BBC Knowledge & Learning's Executive Editor has stated that Lab UK was a key inspiration for the BBC iWonder format.[36]

Data deposition

The data from the Great British Class Survey is due to be deposited in the UK Data Archive (University of Essex) for use by other academic researchers.

References

  1. ↑ http://www.bbc.co.uk/labuk/articles/
  2. ↑ http://www.bbc.co.uk/labuk/experiments/
  3. ↑ http://downloads.bbc.co.uk/aboutthebbc/insidethebbc/howwework/reports/pdf/digital_britain_exec.pdf
  4. ↑ http://www.bbc.co.uk/labuk/articles/
  5. ↑ http://www.bbc.co.uk/science/humanbody/mind/articles/emotions/disgust.shtml
  6. ↑ http://www.bbc.co.uk/science/humanbody/sex/articles/more_info.shtml
  7. ↑ https://ssl.bbc.co.uk/labuk/results/braintestbritain/1_results_summary.html
  8. ↑ http://www.nature.com/nature/journal/v465/n7299/full/nature09042.html
  9. ↑ http://www3.open.ac.uk/media/fullstory.aspx?id=18876
  10. ↑ http://www.bbc.co.uk/blogs/internet/posts/BBC-Lab-UK-The-Great-British-Class-Calculator-and-beyond
  11. ↑ http://www.broadcastnow.co.uk/news/multiplatform/bbc-to-kick-off-online-survey-on-uk-class-system/5022901.article
  12. ↑ http://www.bbc.co.uk/science/0/22006066
  13. ↑ http://www.bbc.co.uk/blogs/tv/posts/watchdogs-money-test
  14. ↑ http://www.cam.ac.uk/research/news/science-is-a-risky-quiz-ness-a-new-study-aims-to-assess-how-we-perceive-risks
  15. ↑ http://www.bbc.co.uk/blogs/radio4/posts/all_in_the_mind_take_the_bbc_s
  16. ↑ http://www.bbc.co.uk/mediacentre/latestnews/141011hire
  17. ↑ http://www.bbc.co.uk/news/magazine-15619543
  18. ↑ http://www.esrc.ac.uk/news-and-events/features-casestudies/features/20716/carousel-performing-under-pressure.aspx
  19. ↑ http://www.wlv.ac.uk/default.aspx?page=40076
  20. ↑ http://www.bbc.co.uk/science/0/24451567
  21. ↑ http://www.theguardian.com/science/2013/apr/21/brain-training-online-neuroscience-elizabeth-day
  22. ↑ http://books.google.co.uk/books?id=C1BbBAAAQBAJ&pg=PT56&lpg=PT56&dq=brain+test+britain+bbc&source=bl&ots=RfSWPPosPw&sig=88gEKFNCvqWZxx0EteK4JjbAyS8&hl=en&sa=X&ei=gY4-VLDKFIre7Ab1s4DoDQ&ved=0CDoQ6AEwBDge#v=onepage&q=brain%20test%20britain%20bbc&f=false
  23. ↑ http://www.psychol.cam.ac.uk/adprg/research-group-news
  24. ↑ http://cpx.sagepub.com/content/1/4/351.short
  25. ↑ http://www.pnas.org/content/112/3/725
  26. ↑ http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0122245
  27. ↑ http://www.bbc.co.uk/guides/z3g487h
  28. ↑ http://www.friendsprovidentfoundation.org/wp-content/uploads/2013/10/Open-University-Analysing-the-Big-Money-Test-Summary.pdf
  29. ↑ http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0089642
  30. ↑ http://soc.sagepub.com/content/47/2/219
  31. ↑ http://www.bbc.co.uk/news/magazine-22000973
  32. ↑ http://www.bbc.co.uk/blogs/legacy/theeditors/2013/04/the_great_british_class_calcul.html
  33. ↑ http://stratificationandculture.wordpress.com/2013/09/15/a-statement-on-future-research-from-the-great-british-class-survey/
  34. ↑ http://www.methodologicalinnovations.org.uk/wp-content/uploads/2013/11/2.-Geoff-Payne.pdf
  35. ↑ http://matt.chadburn.co.uk/presentations/tech-review-20100701.pdf
  36. ↑ https://www.journalism.co.uk/news/bbc-iwonder-aims-to-unlock-learning-potential-of-content/s2/a555663/
Retrieved from "https://infogalactic.com/w/index.php?title=BBC_Lab_UK&oldid=670010234"