Tuesday, 27 February 2007
Increasing the Generalizability of Qualitative Research, J W Schofield, 1989, Vol 1 Reader, p91
At last a paper that says what it says it will say, says it succinctly and imparts a genuine new and useful understanding of educational qualitative research. The summary says it all really: the paper itself is full of reasoned argument and examples drawn from the author's own experience.
Janet Ward Schofield argues that there are two questions one should ask if one wants ones research to be transferable to others:
1. What do we want to generalise to?
2. How do we design to maximise generalisability?
If Schofield is right, generalisability "is best thought of as as a matter of the 'fit' between the situations studied and others ..." To be able to judge how fit a study is, one needs information about the studies' concepts and conclusion - a thick description.
There are 3 useful targets for generalisation:
1. what is (e.g. accepted best practice)
2. what may be (e.g. unusual, but possibly good practice)
3. what could be (e.g. practice that could take off, but might not)
I would re-write these as more the more mnemonic present, possible and potential practices.
An enjoyable paper with sage advice.
NB p107 has an error, penultimate paragraph where "may be" should be "could be".
Saturday, 17 February 2007
Action Research, 1988, S Kemmis, Vol 1 Reader, p177
K Lewin used the term Action Research (AR) in a paper in 1946, illustrating it by describing the process of reconnaissance necessary for a WWII bombing run. His emphasis was that knowledge comes from the action taken by participants in research (fact finding) and influences their next action. As will be significant, the methodology is critical, not any technique employed to carry it out e.g. fact finding is a methodology; how facts are found is the technique.
“1. It must reject positivistic notions of rationality, objectivity, and truth;" (sic).They also insist that the motivation must be emancipatory (rule 4). Any failure renders the research inadequate or incoherent they argue. Their paper was 5 years earlier, in 1983, “Becoming Critical, Knowing through Action Research”. Acceptance is presumed, so I must write at this time that the “requirements” in isolation come across as dogmatic laws without justification. However, Rules 2, 3 and 5 are just re-amplifications of Lewin but applied to education.
He spends time explaining what AR is distinguished by methodology, not techniques. This is self-evident if his laws are used to prescribe KAR. It is also inevitably so because AR, even as defined by Lewin, is a spiral (or cycle) of methodology – techniques are irrelevant. The methodology is practitioners interdependently apply iterative research and reconnaissance to hopefully attain enlightening conclusions.
Friday, 16 February 2007
Lawrence Stenhouse, The Teacher As Researcher, Offprints Reader, P31 (1975)
32 years ago Stenhouse wrote his book, and this paper was an extract. I added the italics above because he limits research by teachers to the curriculum. He wrote:
"... all well-founded curriculum research and development, whether the work of an individual teacher, if a school, of a framework of a national project, is based on the study of classrooms. It thus rests on the work of teachers."Stenhouse has no issue with objectivity for the teacher engaged in research in his or her classroom because "the teacher's subjective perception ... is crucial for practice since he is in a position to control the classroom."
He saw the main barriers to teacher research, a.k.a. action research, to be psychological and social. Notwithstanding the tensions created trying to be both a teacher and a researcher, he sees this research as accessible to teachers and feeding teaching. Indeed the self-motivating teacher-researcher is essential "if education is to be significantly improved"
The observation of one teacher by another seems to be a groundbreaking idea; so much so, that Stenhouse cites a study that provided "the careful and sympathetic help when teacher-researchers are exposed to feedback on their own lessons for the first time".
It is common place today for lecturers in colleges to be observed by colleagues on an informal basis. I wonder if Stenhouse had something to do with that.
Wednesday, 14 February 2007
W Carr, 1987, What is Educational Practice?, Vol 1 Reader, p160
What is educational practice? It is the delivery of education. What is educational theory? It is any theory associated with educational practice by practitioners. I assert these statements here for the sake of clarity; and there is not much of that in Carr's article. He does not want to look at how educational practice is presently understood. That is the failure of his paper.
Theory considers and practice delivers education. They are related to each other: theory is the academic or philosophical tool of practice, usually to seek to improve it. Carr's worry seems to be that practice is becoming the tool of educational theorists and, in my words, the tail is wagging the dog. The engineering model of education research was in vogue at the time, and that may explain this odd paper.
Why does Carr have a problem with simple but effective answers? It may be that he is worried by educational research being ruled by practitioners (those practising it) and non-practitioners (theorists) being rendered subordinate. If so, he should have realised that things have their day. A balance returns in the long run, as it has. He references the Aristotelian praxis and tries to wrench it into a different meaning to practice, saying that it implies underpinning theory. Actually, theory and praxis were quite different to Aristotle.
Was Educational Practice being misinterpreted and applied beyond its traditional commitments and roles 20 years ago? Did it need to be rescue? Unfortunately, the best Carr does is to "spell out core concepts".
The elephant-in-the-room in this paper is theory of education: Carr finds it threatened and its role and the relationship between it and education practice ambiguous.
Carr is sure that practice "can not be reduced to a form of theorising" and that "it is always the achievement of tradition". He looks into the historical roots of the word, hoping it will help him understand the answer to his eponymous question. Carr wants to rescue "practice" from misuse by "those cultural tendencies which now undermine it and degrade it." (These seem to be its practitioners ...)
He sets 3 tasks, but whether he achieved them or not becomes irrelevant because he fails to create a rationale whereby educational practice is an inherently ambiguous term or widely misunderstood. The mind and the body are one in the healthy human. The body is subordinate to the mind at most times but sometimes the body rules, as in sleep when the autonomous systems keep one alive. Carr is contriving a rational that educational practice has been ambiguously defined to put theory into a subordinate role. He does not come out and say so. He does not mention the engineering model. He does not even show that the practice of education is more esteemed than theorising about it. His arguments are invalid because he does not prove there is any real misunderstanding, or that theory and practice are out of harmony in the first place.
Saturday, 10 February 2007
Subjectivity and Objectivity: an Objective Inquiry, D C Philips, 1989, reader Vol 1, p57
The Best We Can Do - By Consensus
Objectivity in Educational Research, E. Eisner, 1992, reader Vol 1, p49
Step into the river, and it is a different river to the one you stepped into
Friday, 9 February 2007
Gender and the Sciences: Pupils’ Gender-Based Conceptions of School Subjects, Lynda Measor, 1983, Offprint Reader, p16
Sex Matters - more for Girls than Boys ...
This was a qualitative study 24 years ago and drawn from interviews and observations with pupils in a large comprehensive school about 27 years ago. The researcher believes that children build up gender identities at school and see certain subjects supporting a gender choice and others undermining peer acceptance, which are resisted passively or actively. The focus is on physical science subjects - the boys and girls traditionally seeing it as a masculine area, and domestic science, seen as a feminine area.
Interesting stories are recounted sometimes with pertinent quotations from pupils to support the original supposition. They are convincing. Some fascinating details are provided to show insight into why the pupils believed and acted as they did.
Measor speaks of negotiation of gender identities of adolescent pupils (11-13 years). She suggests:
“the girls actively use d aspects of the school to construct their identity, in this case their feminine identity… Science lessons provided an arena for acting out of feminine susceptibilities in a public setting.”The girls used passive resistance – being late, packing up early, talking etc. She says the boys’ reaction to domestic science, which was more active and noisy resistance, was similarly constructive to a masculine gender identity. She writes:
“Pupils could use their hostility to one of the science subjects - “natural” or “domestic” – to signal an interest in things masculine or feminine. At the same time pupils used strategies that they felt to be appropriate to their sex.”What the teachers thought also mattered. Measor thinks that community and teacher- expectations and prejudices make “a very solid wall of resistance to any change.”
Conclusions drawn included
- Original rationale that gender identities are constructed at school
- That pupils are not gender-neutral as learning theory had suggested
- Curriculum change, including
- Girls would benefit from single sexed schooling for science
- Science could be feminised for girls
My reaction to this paper
It demonstrates the importance of not just the question asked, but rational behind the research in the first place, and selecting data to write the story you want to tell. It all makes sense within the report, in a similar way to a novel does. Whether it is truth is arguable. That it is valuable is undeniable. After all, another researcher could emulate the research but find boys need curriculum change to have a fairer chance of constructing their gender identities in a mixed school setting, especially today when the media and governments admit that curricula seem to favour girls over boys, al least in so far as examination results show.
The quantitative versus qualitative debate continues. What I see at the moment is that qualitative studies are probably easier to do, more interesting to write up and to read when published and more likely to be understood by interested parties because the question why is the focus, rather than the questions what and how much or how often. In education people and their hopeful transformation matter. Measor used names a lot, and that made the report about people.
In a dental analogy, the toothbrush may be electric with x thousand revs per minute, but the manual inter-dental brush can reach where it can’t, preventing gum disease that the more powerful tool alone could not. Both are necessary, but one is more frequently needed than the other. The toothbrush is qualitative reseach and the small brush for focus and discrete action is quatitative research.
Equal Opportunities in the Curriculum in Single Sex Schools, Bird and Varlaam, 1985 (offprint reader)
This quantitative research took advantage of two adjacent single-sex religious schools, one for boys and the other for girls 22 years ago. They broadened curriculum by mixing the genders and seeing reactions in pupils to studying subject they would normally not have access to. They had limited facilities but got some raw data. The researchers try to make sense of that data. Girls took Craft Design and Technology and boys took Textiles (needlework).
The initial attitudes, the reactions of pupils, the impact on conception of gender roles, interest in taking further courses and teacher views were all considered in the light of the quantitative data.
It turned out that girls were initially keener on the swap than boys but both sexes had less fixed opinion that jobs could only be done by the traditional gender employed in them. Computer programming and chef were exceptions before and after the experiment, as most pupils considered gender was irrelevant.
The conclusions included that girls benefited more than boys from the mixing of genders for courses. The limitation to one school year may have biased results because of the effect and sway of novelty.
Obvious weakness in this method of research lies in the questions asked and the questions not asked. The question asked was would mixing make any difference in opinion about gender roles in employment, and if so in which genders. However significance in result was a matter if statistical computation and the data were skewed by the non-traditional nature of the schools (religious), limitation to one school year, and a possibility that the instruments for capturing the data was biased or misunderstood.
The appendix of data was neat, conveying a probably false authority to the paper. One could check the results and conclusions, if one wanted to.
The question that is the elephant in the room of course is WHY? Why did the girls and boys think the way they did? Why did opinions change (or not change)?
I know with hindsight that mixed school curricula do work, favouring girls – or, put another way, the change for traditional schools has resulted in an overall drop in performance for boys compared with girls, as admitted by governments. This straightforward study may have been influential in giving confidence to those considering mixed schools for economic or other political reasons.
Thursday, 8 February 2007
G De Landsheere, History of educational research, 1988 (Vol 1 educational Research, p3)
A Chronological Table Would Be Better
I don’t know anything yet about Piaget or what he promulgated but I suspect that Piaget considered nomothetic and ideographic approaches to research were on a continuum and thus complementary. Look at a set of events in history and you may conclude a principle. Did not Darwin do that at Galapagos when he developed his theory of natural selection, and contemporaneously but independently didn’t Wallace do the same thing; from ideography may come nomothetism? Similarly, if you have principles, one can look again at history and see particular incidents and facts in a new context. Maybe that is what Piaget came to see. I am surprised it was considered new, but then re-discovery is indeed what nomothetism is about.
Wednesday, 7 February 2007
M Hammersley (1993) On the teacher as researcher (p211, Vol. 1 Educational Research)
Integration of roles of Teacher and Education Researcher. No thank you!
Nearly 10 years after Hirst, Hammersley wrote to argue that Teacher Research (what we know as Action Research today) was OK but should be done by researchers or by teachers but as an end in itself, not co-erced or incorporated into the job of being a teacher. That was nearly 14 years ago, and the argument looks academic today. Certainly teachers are being loaded with administrative, assessment duties to add to their teaching commitments, rather than being forced to do research to improve their professionalism. But issues examined are still of interest, even if the political impetus that once threatened as, as far as I know, vanished. Action Research done by teachers as participants surely goes on, but, in my experience as a practitioner, it is voluntary and done with almost a hobbyist approach (by which mean it is accepted as self-developing, self-research and inquiry to helping reflection); "if it does not work out, ah well, it was a useful exercise from which we have all learnt something". TR, as Hammersley calls it, is cool, but should not be forced on teachers. TR may be done well by either insiders or outsiders. His teachers' learners seem to be children (see p221), by the way.
Teachers are well placed to research education because they are in a position to test educational ideas. They are also implementers of the curriculum, so perception of professionalism was tied up with curriculum development. Lawrence Stenhouse was seen as an authority and pushed the notion that professionalism should also be judged by TR. Hammersley carefully and respectfully shows this to be nonsense. (I do not yet know much about Stenhouse's work, but I suspect it has wasted a lot of people's time. For instance, he considered teachers as senior learners and that "no intelligible conclusion should be ruled out by a teacher". Well, OK James, you think that it is alright to stab people if you are called Jim. I understand that conclusion, so I won't ask you to rule it out." And I won't mention suicide bombers ... I digress...).
So, the idea came about that education research was best done by teachers than non-teaching researchers. Seems crazy to me, and maybe the likes of Hammersley saved us from this daft practice.
When is a researcher not a researcher? When she/he is a teacher. When is a researcher not a teacher? Never. Sounds like a joke to me.
Anyway, conventional research (CR) was critiqued by Stenhouse, Carr and Kremis and collaborative and practitioner research gained advocacy. Hammersley's article is in support of the conventional and goes on to show why critiques are unbalanced or flawed.
- CR is not irrelevant because although not always leading to a solution, it does sometimes and although some "solutions" are generalised, others are specific or can be adapted.
- CR is not invalid because it is so objective it is removed from practice because being an outsider can enable research and validate it; there are pros and cons to being an insider or an outsider for most research one can think of.
- CR is undemocratic, if it means anything is specious because research is not itself the practice it studies (my words).
- CR exploits teachers. (And TR forced onto a teacher's job description wouldn't?). Researchers can draw praise on themselves away from the teacher, for wisdom more rightly credited to teachers. (Who cares so long as the kids learn? - that is what I thought as I read that part...). This seems to be a reason for caution, not for prescription.
The conclusion is that TR should be an extra activity added on to teaching in classrooms and schools, not a transformation of that teaching. The proposal to integrate the roles of teacher and educational researcher "is untenable from the point of view both of research and teaching".
Not all educational research should be done by teachers. Outsiders are welcome. Nice.
Monday, 5 February 2007
Research Vehicle
It would explain this blog!
"Test teaching ideas before imposing them on children"
"A senior scientist has said education should learn from medicine and use rigorous experiments to determine the best teaching techniques."
For instance, class size. "Little good research exists on the optimum size of the groups in which pupils are taught."
Seems Hirst would be well pleased ...
And, in the same issue is the proposal to change the time-table for 11 to 14 year old school children, mixing subjects and introducing frequent 10 minute slots e.g. for language teaching. That must be based on hugely important and rigorously tested research - but I seem to have missed the memo.
Sunday, 4 February 2007
P H Hirst (1983) Educational Theory and its Foundation Disciplines, Routledge& Kegan Paul, London (p149, Vol. 1 Educational Research)
I think the title should have been "Look Before You Leap" because it is all about educational theory being misunderstood by practitioners and educationalists who put presumptuous concepts and principles into practice based on theory from other disciplines such as psychology. They should have looked fully at operational practice of practitioners, he says, and tested ideas arising from that, before forming educational theories that they could put to the test in the field.
So what does Hirst say about educational theory?
It is "concerned with explanation"; with "guiding and improving practice". He sees it as a matter for belief (he is, in his own words, unrepentant) that it is "primarily the domain which seeks to develop rational principles for educational practice". He has issues that when he wrote decades ago, some were using educational theory to develop irrational principles that were imposed on practitioners, untested. He says: " Any attempt to implement such ill-conceived principles can only serve to distort practice into indefensible activities". He asserts that the "essence of any practical theory is its concern to develop principles formulated in operationally effective practical discourse that are subjected to practical test." Yes, for him, theory is a matter of practice and practise.
Hirst considers practical knowledge of disciplines are sometimes incompatible. "Rules and principles can not be applied to situations by the exercise of knowledge of another kind, practical knowledge." Now, the application of knowledge is wisdom and the idea that wisdom is universal in all professions would seem to be self-evidently false to me. If it was, what need would there be to separate the professions? They are separated for the sake of our ignorance, to focus our search for greater wisdom, narrowing our field of study, facilitating realisation of realities with greater speed and rigour. But practical knowledge for Hirst is a necessary idiom because he wants to be specific, not generalist; he is interested in what is tacit and what is operational in education. So, he states what is rather obvious: we must take care to check what we think works in one arena that it works in our arena before we put our trust in it. Look before we leap.
His style of writing is ponderous (he would say careful) and, he equivocates too often. Say what your mean, Hirst. Don't be so afraid.
But maybe he is afraid because he still focuses too much on practical and operational research as the source for theory and he knows that. He has a hidden agenda perhaps of support for what is known now as action research - putting the researcher in to the field as a practitioner, with the aim that the researcher benefits from improved operational practice (practical knowledge), even should no one else.
Theory is academic or practical depending on what it postulates. It is legitimate to focus on practical theorising or academic theorising. He is dismissive of academic theory to emphasise practical theory. He wants "practical testing of practical principles". He thinks that is what psychology, philosophy and sociology are there for. That seems wishful thinking to me. Why can't one test principles - what is this obsession with the word "practical"? A test is a test; it either works or it doesn't; it is practical by being effected and applied. I think he may have meant that tests need to be pertinent to educational principles, and not imports that are designed from and for external disciplines. if one presumes the test correct any deviance in the field may be deemed a flaw and practitioners blamed or practice re-configured to fit the test.
It is not new that people more readily test that which is easily tested than that which is hard to test, but is much more pertinent or pressing. Maybe Hirst is railing against educationalists being to ready to stay in their comfort zone. He may have done a great service in simply doing that.
Chaplin movies are dull and not very funny because we have seen it all before. The fact that his genius enabled the great comedy that followed is not evident on the silver screen.
Doubtless Hirst pioneered and got us where we are today. Looking before we leap.
"It is therefore as mistaken to think of the practical principles of educational theory being justified by appeal to the disciplines as it is to think that a theory in physics is justified by appeal to the validity of the mathematical system it employs." - Hirst, 1983