The Size of The Fan Effect:
Process not Representation1
Department of Psychology
Carnegie Mellon University
Pittsburgh, PA 15213
ja@cmu.edu
reder@cmu.edu
Abstract
The size of fan effects is determined by processes at retrieval, not by whether or not information is represented as situations. Evidence contradicts Radvansky's (in press) claim that time to retrieve information from a situation does not depend on number of elements in a situation. Moreover, Radvansky's principles for ascribing situational models to experiments appear to be post hoc ways of redescribing the data. On the other hand, the evidence does support the ACT-R assumption that participants can adjust their attentional weightings and so produce differential fan effects. Moreover, the ACT-R theory of the fan effect is consistent with many other findings.
In our original paper we tried to show that the retrieval processes in ACT-R provide a successful account for a wide range of phenomena surrounding the fan effect. One of these phenomena was the variation in the size of the fan effect for various concepts across experiments. Here we used some of Radvansky's data which document the variation that can occur in the size of fan effects. Radvansky (in press) challenges our claim to have plausibly accounted for the impressive amount of data he has amassed and instead argues that they can be better accounted for by situation models. In this paper we will argue that ACT-R provides both a more precise and a more plausible theory.
Like Radvansky, we believe that participants frequently set up rich representations of situations (e.g., Anderson & Reder, 1979). The issue is not between situational representations and ACT-R representations. As Radvansky notes in his paper, ACT-R chunks could quite easily implement situational representations. The issue concerns the retrieval processes that operate on the representations, situational or otherwise. We do not think the data support the retrieval process that Radvansky proposes and associates with situational representations. Rather, we think itThe data supports the retrieval process in ACT-R. The ACT-R retrieval process could easily apply to situational representations although we do not think that participants in Radvansky's experiments are creating the situational representations that he ascribes to them. In any case, the ACT-R retrieval model is neutral on this representational issue and does not, as Radvansky claims, "reduce the experimental situation to a paired-associate learning task." We next discuss the ACT-R retrieval assumptions and then Radvansky's assumptions.
ACT-R Retrieval Theory
The following is a fairly succinct characterization of the ACT-R retrieval process:
1. Based on the concepts in the probe, some cues are selected with which to attempt retrieval. These are the j's in Equation 1 of our original paper.
2. Attentional weights, Wj, are distributed to these concepts subject to the capacity constraint in Equation 4. Activation will spread from these cues proportional to these weights.
3. The amount of activation going from cue j to cue i is proportional to the strength of association, Sji, between j and i. According to Equation 2, this strength will reflect the fan.
4. According to Equation 3, latency to retrieve a chunk i is an exponential function of the amount of activation reaching chunk i.
Thus, the fan effect arises because the strengths of associations determine the amount of activation (point 3 above). The fan effect of a particular concept can be modulated by attentional weighting (point 2) above. The fundamental activation formula in ACT-R, Equation 1 in our original paper, which combines weights and strengths, is a very common formula in connectionist models (e.g., McClelland & Rumelhart, 1986). Under a logarithmic transformation, it is also equivalent to the familiarity equation in the SAM model (Raaijmakers & Shiffrin, 1981). Thus, our basic retrieval process reflects a common understanding in cognitive science.
Radvansky claims that ACT-R assumes that concepts that have been given high attentional weights (Wj) are integrated in memory and those which have been given low weights are not integrated. This is simply not so and his comments about ACT-R in the section titled "Organization" are incorrect. To reiterate, ACT-R's retrieval processes have no implications for the organization of the stored information in memory. The differential weights reflect differential attention at retrieval, and this occurs after the information has been organized during encoding.
We believe the ACT-R account because it explains so many phenomena from a single set of assumptions. Radvansky notes that ACT has been used to explain reduced fan effects associated with extended practice, the min effect, plausibility judgments, and pre-experimental associations. He implies that these are alternative explanations of the same phenomenon within the ACT theory, but this is just wrong. These are among the many phenomena that are explained within the same framework.
His Table 2 reports the fit of the ACT-R model to a wide range of his experiments. We were extremely gratified by the high quality of the fits across so many experiments. Moreover, the I, F, and S parameters stay relatively constant across these experiments. The F parameter varies the most and, as we note in footnote 4 of our original paper, the estimate of F should vary with things like amount of practice. We regard Table 2 as an unexpected triumph for the ACT-R theory.
It is clear that Radvansky does not view Table 2 in the same terms we do. He feels that there is something implausible about the fact that the relative weightings given to various concepts vary so much across experiments. He thinks that it is somehow implausible in the ACT-R theory that certain concepts should be given near zero weightings. From our perspective, zero attentional weightings can be given very plausible interpretations -- participants just are not attending to that concept at all. Any retrieval situation offers many potential cues (all the various words in the sentence plus many contextual cues) and any organism has to attend to some and ignore others. The attentional learning literature (Anderson, 1995) is full of situations where one cue completely overshadows another.
Suppose a subject completely ignored (did not read) the concept. Would we expect its fan to have an effect on retrieval time? It is not clear what Radvansky's prediction would be, but the ACT-R model is committed to predicting no effect. This can be tested by not presenting one of the concepts from a sentence and looking at time to recognize the rest of the sentence. Anderson (1974) found no effect of the fan of the concept that was not presented, which is what ACT-R would predict.
Radvansky's Retrieval TheoryPossible Retrieval Assumptions for Situation Theory
Radvansky does not present a formal specification of his retrieval theory but we believe that the essential ideas of his retrieval theory are the following:really present a retrieval theory. In his commentary he states situation theory has "little to nothing to say about the process of memory retrieval." Elsewhere, Radvansky admits to a "primitive account of how mental models are retrieved" (Radvansky & Zacks, 1991, p. 947) and makes some assertions about the retrieval processes. Without retrieval assumptions he cannot make predictions about a retrieval experiment. While he is less than explicit, these are what we think are the two key assumptions behind his predictions:
1. Based on the concepts in the probe, retrieve a situation is retrieved. that is similar to the probe. This retrieval process Somehow the retrieval process is slowed to the extent that there are multiple similar situations in memory. This is what produces the fan effect when one is obtained.
2. Inspect Tthe retrieved situation is inspected to see if it contains the elements in the probe. This inspection time at most is not affectedonly a little affected by number of elements in the situation. This is what produces the lack of fan effect when the fan effect is not obtained.
These assumptions can be explained with respect to Radvansky's basic design that is illustrated in Table 1. He manipulates, from one to three, the fan of one concept, which he takes to provideas providing the means for organizing the information into a situation model the situation, and almost orthogonally manipulates from one to three the fan of the other concept, which he takes to provide the elements of that situation. In the case of the high-element fan (row 3 of Table 1), the elements will appear in multiple situations, making the situations more similar and harder to retrieve (retrieval step 1 above). In the case of high situation fan (column 3 in Table 1), all of the elements will be in the same situation and time to inspect the situation will not be affected (retrieval step 2 above). Thus, an effect is predicted for element fan but not situation fan. It varies from experiment to experiment what constitutes the elements and what constitutes the situations.
Table 1
Radvansky's Basic Experiment Design
|
Situation Fan |
|
|
1 |
2 |
3 |
|
1 |
1-1 |
1-2 |
1-3 |
Element Fan |
2 |
2-1 |
|
2-3 |
|
3 |
3-1 |
3-2 |
3-3 |
We have little difficulty with Radvansky's the first retrieval assumption. This is basically a equivalent to the ACT-R mechanism for the fan effect, substituting the language of similarity for the language of associative strength. However, we have difficulty with the second assumption, that the time to inspect a situation is not much affected by the number of elements in the situation. Anderson (1976; Table 8.15) manipulated the number of arguments in a study proposition (e.g., A janitor chased a cat in an office versus A janitor chased a cat) and looked at the time to recognize a subset of the arguments. Presumably, each studied proposition would be encoded in a single situation and more arguments in the proposition mean more elements in that situation. In contrast to what Radvansky would predict, the time to recognize the same subset increased substantially with the number of arguments in the full proposition.
In Radvansky's own studies he finds an effect of situation fan when the element fan is greater than 1 (e.g., contrasting cells 3-1 and 3-3 in Table 1). He prefers only to consider situation fan when element fan is one (i.e., contrasting cells 1-1and 1-3) and sometimes does not report the other cells (which he considers fillers), while other times he reports those data in appendices. Thus, three can be strong effects of what Radvansky interprets as number of elements in the situation. Under the ACT-R analysis, interactions like these are to be expected because there will be greater effect of any concept's fan when the fan of the other concepts in the probe is high. This was the min effect discussed in our original paper.
The Cause of Differential Effects
In summary, we do not find the retrieval assumptions implied by Radvansky to be supported by the facts. However, there remains the question of what is the source of the differential fan effects he obtains. The ACT-R explanation of the fan asymmetry in Radvansky's experiments turns on differential attention at the time of retrieval. In contrast, in Radvansky's account, the cause is the differential organization at study. We cited a number of studies that showed that the size of the fan effect can be influenced by conditions at retrieval. Radvansky counters that none of these studies show a differential fan effect. In his view, differential fan effect refers to a result where different fan effects are obtained for different concepts. Thus, he concedes that retrieval conditions can produce different fan effects for the same material and participants but holds his result of differential fan effects as special. We can think of one manipulation at retrieval that has been shown to produce a differential fan effect. This is precueing with one of the concepts in the to-be-retrieved memory. our original research (Anderson, Anderson (1974, Experiment 3) we found there wasa non-significant greater fan for the precued concept; while King and Anderson (1976) found a highly significant greater fan for the non-precued concept; and Radvansky and Zacks (1991) found a reduced fan with location cues. These effects are instances of the frustrating lack of consistency in differential fan effects. We will elaborate further on this lack of consistency, but for now we simply note that retrieval manipulations can produce highly significant differential fan effects.
Radvansky assumes that fan effects are attenuated or not obtained for concepts that provide situational structures. The original Radvansky model, in which location served as situations and people objects were elements in the location, had intuitive appeal when explained in these terms. However, Radvansky has subsequently found the reverse asymmetry where there is less of aa large fan effect for the personlocation (when they are occupied by people). To explain these results he assumes that participants can organize situations by people. However, if participants can develop person-based and location-based organizations, it is not clear to us why they do not use both and so avoid his fan effects entirely. That is, if there are multiple people in a location subjects can organize this into a location-based situational model and if a person appears in multiple locations they can organize this into a person-based situation model. Another peculiarity is that Radvansky, Spieler, and Zacks (1993) found no effect of using indefinite versus definite articles -- i.e. no difference between "A lawyer is in a bank" versus "The lawyer is in the bank". Given the semantics of indefinite and definite articles we would have expected a greater tendency to create a single situation in the case of definite articles.
The intuitive plausibility of the situation-based explanation varies from experiment to experiment in the Radvansky set. The explanation we find least plausible is the report by Radvansky, Wyer, Curiel, and Lutz (1997) which finds a person-based organization when the verb "buy" is used but not when the verb "own" is used. We do not see why one cannot have a person-based organization in both cases.
Radvansky, Zwaan, Federico, and Franklin (in press) found reduced fan effects when the events could all occur at the same time but not when different times are involved. They claim that participants will represent events happening at different times as parts of different situations. We find this a somewhat intuitive claim. However, in other cases Radvansky claims one can organize a situation across times. For instance, Radvansky claims that this is what participants do in the case of people in small locations (and a person cannot be in multiple locations at the same time). There seem to be no a priori principles for predicting when subjects will use time as a factor in selecting a situation model or when they will not.
Across all the Radvansky experiments we see a pattern of postulating a situation-based organization whenever there is no fan effect and denying one whenever there is a fan effect. This strikes us as post-hoc: There is no formal theory for predicting in advance when situation-based organizations will be used and when they will not. We are left with intuition. Sometimes we find Radvansky's claims intuitive and sometimes not. We find it hard to find any consistent pattern in the explanations evoked over what is now a very large range of experiments. So the situation theory is not really an explanation, but just a way of redescribing whatever results are obtained. As we said in our original paper, there is no converging evidence for the situation models assumed for his various experiments. In response to this assertion, Radvansky cites studies of other researchers showing that participants sometimes use these kinds of situation models in other experiments. However, he has no converging evidence that participants in his experiments are using the situation models he ascribes to them.
If Radvansky's situational models do not offer an explanation, what is the explanation of the differential fan effects? While ACT-R has an attentional mechanism that can produce differential fan effects, it does not explain why participants give more attention to some concepts than others. Looking over his materials we noticed that many aspects of his materials were not well controlled. We noticed two features that varied across these experiments. First, it seemed that the items which showed larger fan effects were more concrete. As we noted in our original paper there is a long history of getting larger cueing effects for more concrete terms. However, as Radvansky notes in his paper, this will not explain all of his results. We have also just completed an experiment with the person-location materials and failed to find a concreteness effect over the range of concreteness values found in his materials. While we still suspect concreteness can have an effect, it does not seem to for his materials.
We were also struck by the fact that sometimes the items with larger fan effects had more words ("back room's tanning bed" versus "lawyer"). The obvious way to represent such material in ACT-R would be to make each content word in one of these phrases a separate cue. Even if each cue were weighted equally the total weight for these phrases would be greater. For instance we have done experiments where we manipulated the fan of location, subject, and verb and found approximately equal fan effects (Anderson, 1976, Table 8.4). However, if two of these were treated as a single term in the analysis we would have gotten larger fan effects for that term because it is really two concepts.
Radvansky argues that not all of his results have such material problems. The There is his unpublished doctoral dissertation. Another experiment he points to is Radvansky et al (1997) where the use of "buy" versus "own" seems to determine whether there is a person fan effect for the same persons. As we noted earlier, we fail to find his situational models for this experiment intuitive. Moreover, inspection of those data does not reveal such a strong pattern. With the verb "buy" (and the right type of objects—things that are found in drugstores) he claims there should be a fan effect only for objects (objects associated with multiple people) and not a fan effect for people (person associated with multiple objects). Over the two experiments that satisfy these conditions, the fan effect is 271 ms. for objects and 88 ms. for people. Over the four experiments that do not satisfy his conditions (either because the verb is "own" or the objects are not drugstore objects), the fan effect is 189 ms. for objects and 121 ms. for people. While the relative size of the effects is different between the two classes of experiments, we are more struck by their similarity. Everywhere it seems people concepts show less of a fan effect. It is also striking that the sum of the two fan effects is not smaller in the conditions where one of the fan effects is supposed to be eliminated (271+88 = 355 ms.) than in the conditions where neither is supposed to be eliminated (189+121 = 310 ms.). ACT-R's attentional theory basically allows a constant fan effect to be distributed among the concepts in a probe. Attending to one concept will increase its fan effect but decrease the fan effect of the other concept because of decreased attention to it.
The relative size of fan effects for different concepts strikes us as a capricious variable, changing in unsystematic ways from experiment to experiment. It seems just the sort of effect that would be due to participant strategy and which is appropriately modeled in ACT-R by an attention allocation policy at retrieval. However, we do not pretend to have a priori principles for predicting which way it turns out in each of Radvansky's experiments. We do not think Radvansky has either.
While the relative size of the fan effect is capricious, the existence of a fan effect is not. Every one of Radvansky's experiments has found a fan effect. ACT-R is committed to the prediction of a fan effect in all of these experiments. Moreover, it is committed to a relative constancy of the overall size of these effects which is reflected in the relative constancy of the F and S parameters. Radvansky's model is not committed to the prediction of a fan effect since a participant could in principle adopt different situational models to eliminate the fan for both concepts. Moreover, as we tried to document in our original paper and have elaborated in this paper, there are a host of other fan-effect phenomena predicted by ACT-R, including the new experiment that we report.
References
Anderson, J. R. (1974). Retrieval of propositional information from long-term memory. Paper presented at the Advanced Workshop on Formal Theories of Information Processing, June 24-28, 1974. Stanford University.
Anderson, J. R. (1976). Language, memory, and thought. Hillsdale, NJ: Erlbaum.
Anderson, J. R. (1995). Learning and Memory. New York: Wiley.
Anderson, J. R., & Reder, L.M. (1979). An elaborative processing explanation of depth of processing. In L.S. Cermak & F.I.M. Craik (Eds.), Levels of processing in human memory. Hillsdale, NJ: Erlbaum.
King, D.R.W. & Anderson, J. R. (1976). Long-term memory search: An intersecting activation process. Journal of Verbal Learning and Verbal Behavior, 15, 587-605.
Raaijmakers, J. G. W., & Shiffrin, R. M. (1981). Search of associative memory. Psychological Review, 88, 93–134.
Radvansky, G. A. (in press). The fan effect: A tale of two theories. Journal of Experimental Psychology: General.
Radvansky, G, A., Spieler, D. H., & Zacks, R. T. (1993). Mental model organization. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 95-114.
Radvansky, G. A., Wyer, R. S., Curiel, J. C., & Lutz, M. F. (1997). Situation models and abstract ownership relations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, 1233-1246.
Radvansky, G. A. & Zacks, R. T. (1991). Mental models and the fan effect. Journal of Experimental Psychology: Learning, Memory and Cognition, 17, 940-953.
Radvansky, G. A., Zwaan, R. A., Federico, T., & Franklin, N. (in press). Retrieval from temporally organization situation models. Journal of Experimental Psychology: Learning, Memory, and Cognition.
Rumelhart, D. E., & McClelland, J. L. (1986). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1). Cambridge, MA: MIT Press/Bradford Books.
Author Note
Preparation of this paper was supported by grant SBR-94-21332 from the National Science Foundation and by National Institute of Mental Health Grant 1R01 MH52808-01. We would like to thank Mike Ayers for his comments on the paper.