CH 4Stratification and Discrimination
Does science reward the best work, or does work become the best by being rewarded?
The number the chapter opens on
Of the 55 Nobel laureates working in the United States in 1963, 34 had studied or collaborated with one of 46 previous prize-winners. And the ones who had worked with a laureate before doing their own important research collected their prizes at an average age of 44, against 53 for everyone else.
Then the question the whole chapter is built on, in Sismondo's own framing. Are those clusters the tip of a merit-based iceberg, or artefacts of a prestige system gone wrong? Is the knowledge elites are recognised for intrinsically valuable, or does it become valuable because of its association with elites?
Two predictions on the record, both wrong. Francis Bacon, in the week 2 packet, thought his inductive method would level the differences between intellects and let science be industrialised: anyone following the procedure would do useful work, because the method does the thinking.
Three hundred years later the Spanish philosopher José Ortega y Gasset said the levelling had happened, and was appalled by it. Science had progressed, he wrote in The Revolt of the Masses (1930), thanks in great part to the work of men astoundingly mediocre, and even less than mediocre. His point was about specialisation. A field cut into small enough pieces can be worked by somebody who knows one piece and nothing else, and that person will still produce results, because the piece is small. Ortega called the type the learned ignoramus: a man who is not ignorant, because he is a scientist, and not learned either, because he knows only his corner, and who is dangerous because his one competence makes him confident everywhere else. So Bacon and Ortega describe the same machine, Bacon as the promise and Ortega as the alarm.
The distributions say otherwise. Roughly 10 per cent of scientific authors produce 50 per cent of all papers. An estimated 80 per cent of citations go to 20 per cent of papers. Science is not flat and it is not a machine that runs on interchangeable operators. Bacon and Ortega are both wrong about its structure.
A warning about the measuring instrument, which is Box 4.1
Every number above is a citation count, so the chapter stops and asks what a citation count measures. The hopeful answer: a citation records an influence. I read your paper, it shaped my work, I cite it, and adding up the citations tells us whose work shaped whose.
Sismondo says that picture is wrong, and the reason is what a paper is for. A paper reads like a report of what happened in the lab, but it is a rational reconstruction: the false starts are dropped, the order of events is rearranged, and the messy history is rewritten as a clean line from question to result. Nobody is lying. The genre simply is not a diary. It is an argument aimed at referees and at the handful of people who will decide whether to believe the result.
Once you see the paper as an argument, the citations become part of the argument. They stop being a record of where the ideas came from. Concretely, that breaks the count in four places:
- You cite what persuades the reader you have in mind. If the referees are in a particular camp, you cite that camp's landmark papers, whether or not you learned anything from them.
- Most of what actually influenced you is uncitable. A technique a postdoc showed you at the bench, an objection somebody raised at a conference, the argument you had with your supervisor: all real influence, none of it has a citable form.
- The most influential work stops being cited at all. Once an idea becomes textbook background, citing it looks naive. Nobody cites Watson and Crick before describing a DNA sequence. Influence so complete that it becomes assumed reads as zero.
- One citation can be doing any of several jobs. Crediting a predecessor, parking a rival's objection, borrowing a method, signalling which literature you belong to, or being cited to be attacked. The count does not distinguish an endorsement from a demolition.
His conclusion is flat: citation analysis is a poor tool for studying communication and influence.
And then he uses the numbers anyway. The justification is size. If the true distribution were mildly uneven, a distorted instrument could easily manufacture the unevenness and you would learn nothing. But 20 per cent of papers holding 80 per cent of citations is not a mild effect, and no amount of rhetorical citing plausibly turns a flat field into that. The instrument is too crude to tell you who influenced whom; it is still good enough to tell you the field is steeply unequal. Notice the move, because you will see it repeatedly in this course: the measure is admitted to be bad, the effect is large enough to survive it, and the author carries on with the caveat on the record.
The same numbers, two opposite policies
This is the most useful stretch of the chapter, because it shows one fact supporting two opposite recommendations. The fact both sides accept: 20 per cent of the papers carry 80 per cent of the citations.
Jonathan and Stephen Cole read that as efficiency, and call the lopsided shape a feature. Their reasoning runs in three steps. First, a citation count is at least roughly a value measure, so the 20 per cent really are the papers that mattered. Second, a paper cited once or twice therefore contributed close to nothing, and the money and years that went into it bought close to nothing. Third, even that near-nothing is probably not lost, because important results tend to be found more than once. Calculus arrived twice, natural selection twice, oxygen twice, the telephone in two patent applications on one day. If a finding is ripe, somebody else reaches it within a few years. So the recommendation is concentration: stop spreading grants thinly across everyone and send them to the already-productive people and departments, because that is where the cited work comes from. Funding should track the stratification.
Stephen Turner and Daryl Chubin attack the first step and the whole thing reverses. Suppose citations track visibility, and not worth: a paper by a known name at a known department gets read, cited and built on, while the same result from an unknown department is not read at all. Then the 80 or 20 split is not a map of where the good work is. It is a map of who gets attention, and the uncited majority is good work that was never looked at. Their recommendation is the opposite one: level the playing field, spread support more widely, and cut the effect of prestige and old-boy networks, because the current distribution is not efficiency but waste. The multiples argument cuts their way too: if discoveries really are that ripe, the people who lose the race are competent, and starving them of funding removes the competition that made the discovery arrive quickly at all.
What the disagreement turns on, in Sismondo's words, is how accurate science's system of recognition is. Nobody has an independent measure of a paper's worth to check the citation count against, which is precisely why the same table supports both policies. So the 80 and 20 figure settles nothing by itself. First you have to say what a citation means, and that is the question nobody can answer.
Both camps assume the publication is where scientific value lives. Chandra Mukerji suggests oceanography gets government support because it maintains a pool of skilled oceanographers who can be called on when needed. On that account the government is paying to keep the people trained and available, and the papers are almost a side effect. Elsewhere, skills and knowledge move into the world directly, as laboratory tools and products, without passing through a journal at all. Sismondo does not think either alternative is right in general. He raises them to show what a narrow focus on publications leaves out.
What makes a scientist productive, and why the lists are useless
No single variable dominates. One survey builds a portrait of the most productive scientist as someone who is driven, has a strong ego, acts autonomously, plays with ideas, tolerates ambiguity, is at home with abstractions, is detached from non-scientific social relations, reserves mornings for writing, works on routinised problems, is relatively young, went to a prestigious graduate school, had a prestigious mentor, is at a prestigious employer, has freedom to choose problems, has a history of success, and has been cited before.
A later study offers shorter adjectives, in order of importance: persistent, smart, civil, creative, entrepreneurial, aggressive, tasteful, confident, adaptable.
Sismondo's verdict on both lists is worth copying. Many of the items are uncontroversial and none of them is particularly helpful to somebody trying to understand scientific processes. Peak productive years cluster around the mid-forties, and nobody knows why or what would change it. Persistence may matter enormously, and the sources of persistence are unclear. A list of correlates is not an explanation.
One variable does something, though, and it is the one that matters. Scientists at prestigious institutions are strikingly more productive, and institutional prestige is a strong predictor.
The obvious explanation is selection, and the evidence rules it out. Do prestigious departments simply hire people who were going to be more productive anyway? Not in general: the differences in productivity emerge after people have been hired. And it is hard to imagine any hiring committee picking that consistently, in a job market that is almost always tight, between candidates whose potential differs very slightly.
So prestige is doing something. Better facilities. Better networks. More intellectual stimulation. More internal pressure and reward. Or simply more visibility, and therefore more reward for the same work, which Sismondo states as a conclusion with an exclamation mark: if that is right, then prestige by itself makes people's research valuable.
The Matthew Effect, which is the chapter's engine
Robert Merton named it after a line in the Gospel of Matthew: to whoever has, more shall be given, and from whoever has not, even what he has shall be taken away.
The mechanism is a chain where each link is small and the compounding is not. Somebody with the traits on those lists is more likely to get a famous mentor. A famous mentor makes a prestigious graduate school more likely. That makes a prestigious department more likely. That brings better facilities, better conversation, and above all more visibility. More visibility means more citations. And citation is itself a reward: people whose work is cited go on publishing. The sociologist Randall Collins calls citations sources of emotional energy.
Discrimination, and the numbers he puts behind it
His framing is that women are worse represented the more elite the grouping, and the figures step down accordingly.
- United States, 2005. Women earned 46 per cent of doctorates in the social sciences, natural sciences and engineering, up from 31 per cent a decade before. But 49 per cent in the biological sciences and 18 per cent in engineering.
- United States, 2006. Only 19 per cent of senior faculty in those areas were women, heavily concentrated in the life and social sciences.
- Europe. Only 15 per cent of senior university faculty across all fields. And the variation between countries is enormous: in 2003 women earned 72 per cent of life science and 45 per cent of physical science doctorates in Italy, against 47 and 23 per cent in Germany. Senior medical faculty: 22 per cent women in the UK, 6 per cent in Germany.
- Japan stands out among large research nations as particularly gendered, with smaller percentages of women researchers of every kind than the United States or any European country.
- And in most countries women are unlikely to be gatekeepers: editors of major journals, chairs of important boards.
The country variation is the part to think about. Italy and Germany are both rich European countries with good universities, and the gap between 72 and 47 per cent has nothing to do with biology. Whatever is producing these numbers travels with the culture.
Box 4.2: the golden age that was a dark age
Margaret Rossiter's history of women scientists in America turns on one finding, and it is counter-intuitive: feminisation is linked to a fall in status, and masculinisation to a rise in it. The direction of causation is from who holds the jobs to how the jobs are regarded.
What that produced, twice. When women began entering scientific fields in the 1860s and 1870s, the men already there perceived that their work was losing its masculine status, and pushed women into marginal positions where they would be invisible. In the twentieth century women found they could enter much more easily through new fields, home economics and nutritional science, where they could do sociology, economics, biology and chemistry under another name. The fields as a whole were then poorly regarded, because they were feminised.
And the sentence in the box that people quote. Women's colleges had been a safe place for women scientists to work and build credentials. After the Second World War, as American universities expanded, those colleges and the less prestigious universities followed the leading ones in hiring more men. The golden age of American science after the war was a dark age for women in it.
What changed it was not science. The shift came in the 1960s, from outside: the National Organization for Women, Betty Friedan, and Alice Rossi's 1965 article in Science titled "Women in Science: Why So Few?", which made the case that science was no different from any other profession. Alongside that ran a legal revolution producing anti-discrimination law and affirmative action, which women then used as resources to get in.
The pipeline, and why Sismondo half rejects it
The standard metaphor is Natalie Angier's. Women flow through a pipe with leaks at every joint along its span, a pipe that begins with a high-pressure surge of young women at the source, a roiling Amazon of smart graduate students, and ends at the spigot with a trickle of women prominent enough to be deans or department heads or to win a Nobel Prize.
His objection is that the picture makes the problem one of leakage, which puts all the attention at the joints and none at either end. The metaphor only works if you also attend to intake, blockage and filters: processes of inclusion and exclusion. In many fields there is no roiling Amazon at the source to begin with, and the women who are there do not simply leak out, they are discouraged the whole way along.
The framing he prefers is Sara Delamont's three problems, and they are the three sub-headings of the rest of the chapter: getting in, staying in, and getting on.
Getting in
Science and engineering have masculine images and the stereotypical scientist is male, and that shapes what girls believe about their own capacity. Quite young girls may find it hard to think of themselves as potential scientists, and in many environments they are actively discouraged by teachers, peers and parents. The consequence is structural and not merely attitudinal: by the end of secondary school many girls who might have been interested already lack the background subjects they would need to study science at university. The door closes before anybody applies.
An analysis of the advertising in the journal Science found, in its own words, more cultural content between the covers than we would care to acknowledge. Men are more likely to be depicted as scientific heroes. They are also more likely to be shown as nerds or nonconformists, and more likely to be shown at play. The words simple and easy go with pictures of women; fast, reliable and accurate go with pictures of men. And a female figure can stand as a symbol of nature in a way a male figure cannot, which puts women on the side of the thing being investigated.
Staying in
The concept to take from this section is the unofficial PhD programme. Alongside the official courses, exams and research there runs a second curriculum: study groups, pick-up basketball, informal mentoring, and simply the ongoing conversation and consultation of a department. Even a well-integrated student can be shut out of parts of it.
We would all go to parties together and go and have beer on Friday, but if somebody came in to ask what drying agent to use to clean up THF, they would never ask me. It just wasn't something that would cross their minds.
Then the hardest number in the chapter. A study of peer review scores for postdoctoral fellowships at the Swedish Medical Research Council found reviewers rating men's accomplishments as overwhelmingly more valuable than apparently equivalent accomplishments by women. To be given the same competence score as a male colleague, a woman needed to exceed his scientific productivity by about three extra papers in Nature or Science, or twenty extra papers in an excellent specialist journal.
And a clash of clocks. Shirley Tilghman, a molecular biologist and later president of Princeton, argues that the pressure at the start of a career falls hardest on women. Research productivity decides whether a senior graduate student or postdoc gets a permanent job, and new faculty then have about six years to clear an all-or-nothing tenure hurdle. Those are exactly the years in which women are most likely to want to have children.
Getting on
The discriminations at this stage are individually small enough to argue about. Women hired at the same time as male peers tend to have smaller laboratories, and to have negotiated worse arrangements for start-up grants, for the overhead the university takes from their research money, for salary and for teaching load.
And they remain outside the informal networks. Inside their departments they tend not to have informal mentors to steer them through opaque processes. Outside them they do less collaborative research. And they are less well connected to the networks that carry unpublished work, which leaves them more dependent on the published literature and therefore always slightly behind. Sismondo quotes Jonathan Cole's formulation: women have moved into science, but they are not of the community of science.
Which is where the Matthew Effect returns and does the argument's real work. In any individual case these differences look trivial, and a woman may well shrug them off. But if competition is strong enough, and if advantage compounds, the small irritants are enough on their own to keep her from getting on. No single act of discrimination has to be large.
The maths gene, and what he says about it
One side claims a biological propensity. Claims of a maths gene or something like it go back to 1980, and as recently as 2005 the president of Harvard, Lawrence Summers, invoked biology to explain differences in men's and women's success in science and engineering.
Sismondo's reply is two lines and both are worth having. First, genes only act in environments. A gene does nothing on its own. Whether it is switched on, and how strongly, depends on what surrounds it: food, hormones, how a child is taught, what a child is praised for trying. So there is no way to measure what a gene does apart from a setting, and saying a difference is genetic is a way of calling it fixed without having shown it is. Second, the scores are moving. Boys' and girls' mathematics results have been getting closer, and genes have not changed in thirty years, so whatever was making the gap was in the setting.
The other side claims a difference in style, and he reports it without endorsing it. A number of feminists and non-feminists have argued that women tend to think in more concrete terms, are better served by problem-centred learning, think more relationally, and produce more holistic pictures. He parks the whole question for chapter 7, which is weeks 5 to 7 of this course. The question there is whether who is doing the knowing changes what gets known. The name for that field is feminist epistemology, and epistemology on its own means the study of knowledge: what knowing is, and what makes one claim better than another.
The conclusion, and the question it leaves open
Cumulative advantage is what makes the argument work. Point at any single thing on the list, a smaller lab, a worse starting salary, being left out of the conversation about the drying agent, and it looks too small to end a career. None of them on its own pushes a woman out. The claim is that they add up: a smaller lab means fewer results, fewer results mean a weaker grant, a weaker grant means a smaller lab again. Five years of that is a gap nobody can close. It also explains why two women can describe completely different careers and still be describing the same pattern, because the list is long and each person meets a different few items on it.
Then the sentence the chapter title has been leading to. Once you add the discrimination section to the funding section, it is hard to call science efficient at all, because it is throwing away the work of half the people it trained. It looks less like an efficient meritocracy and more like an inefficient old boys' network, in which people and ideas become important partly because of where they sit in a social network.
And the claim that connects this chapter to the next one. Elite groups are socially constructed: the ranking was built by people and it could have come out differently. He grants straight away that elites really do produce more and better work, because they have the money, the labs and the encouragement. Then he asks the question he opened the chapter with and leaves it open:
- Is famous work important, or is it called important because a famous person did it? The same result signed by a Harvard lab and by an unknown one gets read differently, and Sismondo has no way to tell how much of the difference is the work.
- Would science look different if the rewards were spread evenly? If prestige is part of what makes work count, then flattening it would change which results get taken up, and therefore what science ends up believing.
- Answers
- Bacon, chapter 4 of the week 2 packet, by name. Bacon predicted the method would level intellectual differences; the citation distributions say it did not.
- Rests on
- Chapter 3, which is not set, on Merton's norms of science. The line just before this chapter begins is about whether those norms shape real behaviour even when applied flexibly.
- Sets up
- Chapter 6, below: if elite groups are socially constructed, the obvious next question is what construction means. And chapter 7, which is weeks 5 to 7 of this course.
If you keep one thingSuccess in science compounds: a small early advantage produces a better mentor, a better department, more visibility and more citations, and citation is itself a reward that produces more work. So a gap too small to call unfair at any single step ends up large, which is how a culture with no single villain in it produces a measurably unequal profession.
The verse is Matthew 13:12, and Merton knew exactly what he was doing
The line is from the parable of the sower: to whoever has, more will be given, and from whoever has not, even what he has will be taken away. In the gospel it is about receptivity to a teaching. Merton borrowed it in 1968 for a paper about how scientific credit accumulates, and the borrowing is sardonic: a verse about spiritual reward describing a funding system.
His wife, the sociologist Harriet Zuckerman, did the underlying research on Nobel laureates, which is the study this chapter opens with. Merton acknowledged that her work was so central that the paper should have been co-authored, and said so publicly, years later.
The Harvard computers were paid by the star
Edward Pickering hired women at the Harvard College Observatory from the 1880s because they could be paid 25 to 50 cents an hour, roughly half a man's wage, and because the work of measuring and cataloguing photographic plates was considered clerical. Around eighty women worked there over four decades.
What they produced was not clerical. Annie Jump Cannon classified some 350,000 stars and devised the spectral scheme, O B A F G K M, that astronomy still uses. Henrietta Swan Leavitt discovered that a certain kind of variable star pulses at a rate fixed by its brightness, which gave astronomy its first reliable way of measuring distance beyond our own galaxy. Hubble used her relation to show the universe is expanding, and said she deserved a Nobel Prize. She had died four years before he could nominate her, and the prize is not awarded posthumously.
The Summers speech cost him the job
In January 2005 Lawrence Summers, then president of Harvard, spoke at a conference on diversifying the science workforce and gave three explanations for why women are under-represented at the top of science, ranked by how much he thought each one mattered. First, women are less willing to work eighty-hour weeks. Second, men and women differ in the spread of innate aptitude at the extreme high end, so there are more men at the very top of the maths distribution. Third and least important, discrimination.
It was the second one that emptied the room. The biologist Nancy Hopkins of MIT walked out while he was making the aptitude argument, and said afterwards that if she had stayed she would have blacked out or thrown up. The eighty-hour-week claim drew plenty of argument, and it is the kind of claim you can answer with evidence about childcare. The aptitude claim says the women in the room are built differently, and ranking discrimination last said their own experience did not count.
The no-confidence vote in March was about more than the speech. Harvard's Faculty of Arts and Sciences passed it 218 to 185, the first in the university's history. Complaints about his manner had been building for years, including a public clash with the philosopher Cornel West. The speech was the thing that gathered them, and the aptitude remark is what people quoted. He resigned in February 2006, having pledged 50 million dollars of Harvard money to diversity efforts. His successor was Drew Gilpin Faust, the first woman to lead Harvard in its then 371 years.
Jane Dee ran an experimental household
Box 4.3 of the chapter is about women just outside the formal borders of science. Its example is Jane Dee, wife of the Elizabethan mathematician and alchemist John Dee, who kept the largest library in England at their house in Mortlake and a laboratory alongside it.
In the 1500s there were no laboratories and no universities doing this work. Natural philosophy happened in the house. So the Dee house was the lab, and Jane Dee ran it: the apparatus, the assistants, the visitors, the money, and a good deal of the work itself.
Then science moved out of the house, into institutions, and somebody had to decide which of the old activities came along. Running the building, feeding the assistants and keeping the equipment did not come along. It got renamed housework. The experiments came along and got called science.
So here is what the box is for. Nobody is claiming Jane Dee secretly discovered something and was robbed of the credit. The claim is that the line around science was drawn in a particular place, by people, at a particular time, and it was drawn straight through what she did, with the part men were doing on the inside. She was not left out because her work was worse. She was left out because of where the line went.
Which is the same move as Rossiter's. There, a field loses status once women enter it. Here, an activity stops counting as science once it is the part women do. Either way the ranking came first and the reason was found afterwards, which is what socially constructed means in this chapter.