Wednesday 5 November 2008

Finding the literature - never mind reviewing it

The first part of any research project appears to be extensive reading on and around your topic. Or any topic which might be vaguely related or in fact interesting in some way, or indeed extensive reading around a topic which is in no way related to your doctorate but looks jolly interesting, and it was okay to spend all day reading these two novels, wasn't it?

Finding the right kind of literature is not always easy. Lots of emphasis was placed on the importance of 'systematic' searching: that is to say making a search which doesn't miss anything and which could be repeated by someone else. This is jolly fine and good and totally necessary but often the most helpful search strategy is the entirely serendipitous one of finding something useful and then chasing up every reference within it and also, for the more advanced among us, finding all articles which cite it (Social Science Citation Index is useful for this, as is the more limited Google Scholar). There should be a name for this search technique, but there isn't one. Perhaps 'spiderweb searching' or 'node-based searching'. Because while systematic searching may be designed to ensure that you don't miss anything, in fact it can have the opposite effect, if you are not prepared to follow those results up with the spiderweb technique (I'm determined to coin this term).

There are perils involved in following up these kinds of leads. Last year I found a very interesting sounding article, which purported to be nice and basic and just the kind of thing I needed, cited by its author in a later paper. Searching for it on the internet I discovered that while the article itself was not available online, another eight or so people had cited it in exactly the same way as the original author. There was just one problem. When I went to the paper based copy of the journal, hidden away in my department's library's archives, the article wasn't there. The right issue was, and the right pages, but they were occupied with an entirely different article which, while not being entirely useless per se, was of no use to my research project whatsoever. After a laborious handsearching process I found it in another issue with different page numbers. But I must be the first person to cite it who has actually read it: the others all merely took what its author had said about its content and followed his citation. Which is a big no-no as anyone involved in any kind of research should know.

Well, that was last year, and last year's problem. This year's is entirely different: most of the work which has already been done in the area which I'm researching has been done by Cambridge Assessment, the lovely group made up of the OCR awarding body and Cambridge International Examinations, and their research arm. In another life, OCR was UCLES - the University of Cambridge Local Examinations Syndicate (which strangely is the name all their money remains in) - and in that guise produced a report for the Qualifications and Curriculum Authority on the reliability of marking in Key Stage 3 tests, in the course of which they did some experiments on the use of annotation. This report is cited over and over again by Cambridge Assessment people working in my field, and they presumably have copies of it kicking about in filing cabinets all over the place. If it was produced nowadays it would be bunged straight on the internet, but it's a few years old and it wasn't. And there are no copies to be found anywhere. Not in the copyright libraries, not on any catalogues, not on the internet, nowhere. Which leaves me in the not so comfortable position of wanting to cite a study which I can't actually lay my hands on... hypocrite? Moi?

I guess I will have to resort to something else which has been muttered about in the last couple of weeks (mostly by over-confident North American Continent students) which is emailing the people who wrote the articles I'm reading. I mean, presumably they had their hands on it? In fact, tomorrow I will be at Cambridge Assessment at a seminar on Equating (with the worrying instruction of 'bring your calculator'), so perhaps I can use my cover as mild-mannered DPhil student to do an Alias and search the filing cabinets while wearing impossibly tight clothes, stupidly high heels and an implausibly coloured wig. Ah well, a girl can dream.

Tuesday 4 November 2008

Frontline research, or 'Rationale'

I've been a doctoral student for a whole month now, and I'm beginning to feel the need for a blog. On a day to day basis there are two major risks as a research student: the first is that you feel that you're not achieving anything or getting anywhere; the second is the risk that you really aren't doing anything much. This blog is primarily designed to protect me against both of these risks. It will be a record of what I've been up to, on a regular basis, and it will also allow me to reflect on some of the issues pertinent to social science research and to doctoral students.

Why not just keep a diary then? Well, one reason is that I'm vain enough to think that it would be nice if someone read this. And perhaps if they did they might be putative doctoral students or other doctoral students and sharing some experiences might be a postitive support: knowing you're not in it alone is a major help. Secondly, the blog has a major advantage over a diary: it's searchable. So if in a year's time I need to find all the mentions of literature reviews, for example, I can.

A third reason is my own background: it's quite natural for me to write through anything that happens to me. Two weeks ago our cohort had a session on academic writing, and one of the things that emerged was that to a large extent being an academic means being a writer. Writing isn't something that comes at the end of a study, it's something that you do all along. We were encouraged to write every day, to practice our academic writing and to sift, digest and rationalise our thinking. Professor Geoffrey Walford has described himself as a 'compulsive writer' (I think in Doing Qualitative Educational Research: a personal guide to the research process, 2001, London, Continuum), and I think I tend towards that camp too.

So here it is: part compulsion, part self-help, part support. Dispatches from life as a beginning academic; honest reporting of the perils of friendly fire from supervisors, coalitions of the willing with fellow students, and embedded reporting from the frontline of the doctoral experience.