DonaldsonVollmerKrousDownsBerard2011-1-1.pdf
INFORMATIVEESSAYDRAFT-INSTR.docx
March 29, 2022Renaissance and Baroque Sculpture in Italy
March 29, 2022AN EVALUATION OF THE GOOD BEHAVIOR GAME INKINDERGARTEN CLASSROOMS
JEANNE M. DONALDSON AND TIMOTHY R. VOLLMER
UNIVERSITY OF FLORIDA
TANGALA KROUS AND SUSAN DOWNS
DAVENPORT, IOWA, SCHOOL DISTRICT
AND
KERRI P. BERARD
UNIVERSITY OF FLORIDA
The good behavior game (GBG) is a classwide group contingency that involves dividing the classinto two teams, creating simple rules, and arranging contingencies for breaking or followingthose rules. Five kindergarten teachers and classrooms participated in this evaluation of theGBG. Disruptive behavior markedly decreased in all five classrooms as a result of theintervention. This study extends the GBG literature by systematically replicating the effects ofthe GBG with the youngest group of students to date.
Key words: group contingencies, classroom management, disruptive behavior
_______________________________________________________________________________
Implementation of individualized behaviorplans in large general education classrooms canbe extremely difficult for teachers, creating aneed for classwide behavior-management strat-egies that are easy for teachers to implement andeffective for most students. One classwidebehavior-management strategy that has beenprimarily implemented and evaluated for firstthrough fifth grade children is the goodbehavior game (GBG). Because of its simplicityand evidence of long-term effects (Kellam et al.,2008; Kellam, Ling, Merisca, Brown, &Ialongo, 1994), the GBG has been termed a‘‘behavioral vaccine’’ (Embry, 2002). The GBGis even recommended by the Surgeon Generalas a Promising Program for prevention of youth
violence (U.S. Department of Health andHuman Services, 2001).
The GBG is an interdependent groupcontingency that involves dividing the classinto teams, creating simple rules, and arrangingcontingencies for breaking or following thoserules. Barrish, Saunders, and Wolf (1969)conducted the first empirical evaluation of theGBG in one fourth-grade classroom. Out-of-seat and talking-out responses were substantiallyreduced as a result of the intervention. Severalstudies have since evaluated the GBG andmodifications of the GBG (see Tingstrom,Sterling-Turner, & Wilczynski, 2006, for areview). Replication of the GBG with studentsyounger than first grade would provide impor-tant information on the generality of theprocedure because kindergarten represents theentry level of schooling for many children.Experience with the GBG may establishhistories of appropriate behavior and rulefollowing when entering school. Presumably,such effects could have longer term implica-tions, and some evidence exists to support that
Address correspondence to Timothy R. Vollmer,Department of Psychology, University of Florida, P.O.Box 112250, Gainesville, Florida 32611 (e-mail: [email protected]).
doi: 10.1901/jaba.2011.44-605
This study was funded by the Davenport CommunitySchool District in Davenport, Iowa. We would like tothank the principals and teachers at the three schools inwhich the study was conducted.
JOURNAL OF APPLIED BEHAVIOR ANALYSIS 2011, 44, 605–609 NUMBER 3 (FALL 2011)
605
notion (Embry, 2002). Thus, the purpose ofthis study was to evaluate the effectiveness of amodification of the GBG on the disruptivebehavior of kindergarten students.
METHOD
Participants and Settings
Five kindergarten teachers at three elementa-ry schools in an Iowa public school districtvolunteered to participate as implementers. Theclasses were general education classrooms with15 to 22 students each, totaling 98 students.Overall, the classrooms were 53% female and69% white, 12% black, 9% Hispanic, 8%biracial, 1% Asian, and 1% American Indian.All sessions occurred in the teachers’ classroomsduring group instruction. During group in-struction, students were expected to sit on acarpet in front of the teacher. Group instructionoccurred at least twice per day in each classroom(typically for reading and math) and varied induration from approximately 10 to 35 min.
Target Responses, Data Collection, andInterobserver Agreement
Target responses and response definitionswere developed by the experimenters in closecollaboration with the teachers. Students wereconsidered to be out of seat if they were notsitting with their legs crossed on their spot onthe carpet and facing forward. Students wereconsidered to be talking out of turn if they madeany vocalization without being called on by theteacher, unless the teacher indicated that allstudents could call out answers. Students wereconsidered to be touching another student if theirhands or feet made contact with anotherstudent.
During baseline and teacher implementationphases, an observer collected data on thefrequency of each of the three target responsesfor all individuals in the class (individualstudent data were not isolated) using acomputer program designed for data collectionin real time. During experimenter implementa-
tion (described below), the observer served asthe implementer and scored behavior by writinghatch marks on a dry-erase board that wasvisible to the students.
A second observer recorded data during 35%of sessions for Teacher 1, 15% for Teachers 2and 3, 20% for Teacher 4, and 11% forTeacher 5. Total agreement scores were calcu-lated by dividing the smaller total score by thelarger total score and multiplying by 100%.Total agreement was used (rather than interval-by-interval methods) because total scores werethe only data collected by one observer duringsessions in which an experimenter was imple-menting the GBG (and having a total of threeadditional adults in the room was viewed as tooobtrusive, too impractical, or both). Mean totalagreement was 84% (range, 60% to 94%), 92%(range, 82% to 97%), 80% (range, 56% to100%), 81% (range, 56% to 95%), and 86%(range, 67% to 98%) for Teachers 1, 2, 3, 4,and 5, respectively. The lower scores wereconsiderably lower than most scores and wereobtained during baseline when extremely highrates of disruptive behavior occurred.
Design and Procedure
A nonconcurrent multiple baseline designacross classrooms was used to evaluate theeffectiveness of the GBG.
Baseline. During baseline, the teacher in-structed the class as usual, and students wereallowed to sit in spots of their choosing. Thestudents were not told what the observer wasrecording and received no feedback from theobserver.
Good behavior game. Each class was dividedinto two teams by the teacher. Teachers wereasked to divide the teams in such a way thatboth teams were equally likely to win. That is,students whose behavior the teachers hadalready identified as problematic were evenlydivided between the two teams. Prior to startingthe game, the students were assigned spots onthe carpet, and an experimenter explained to theclass the rules of the game, how to win, and the
606 JEANNE M. DONALDSON et al.
reward for the winning teams. Immediatelybefore playing the game each session, thechildren were reminded of the rules and thereward for the winners. The rules of the GBGwere to sit with legs crossed, to speak only whencalled on or when the teacher indicated thateveryone could respond, and to keep hands andfeet to oneself. A team won the game by havingfewer points than the other team, or both teamswon if they both met a set criterion selected bythe teacher that was at least an 80% reductionfrom baseline (no more than 15 points forTeacher 1; 10 points for Teachers 2, 4, and 5;and 5 points for Teacher 3). Rewards wereselected by each teacher and included snacks(e.g., cheese crackers, yogurt snacks, fruitsnacks), stickers, small toys, extra recess, andextra free time.
Initially, an experimenter implemented theGBG while the teacher continued the lesson.Eventually, the teacher implemented the gamewhile teaching the lesson (recall that all baselinesessions were conducted by the teacher). Scoreswere posted on a dry-erase board next to theteacher in a location that was visible to allstudents. When a student broke a rule, theteacher stated the rule and which team was inviolation (e.g., ‘‘Team 1 needs to raise a hand totalk’’) and made a hatch mark on the dry-eraseboard. The GBG was played every time the classcame to the carpet for group instruction.Follow-up data were collected in Teacher 3’sclassroom 1 month after the experimenter leftthe classroom.
RESULTS AND DISCUSSION
Figure 1 shows the rate (responses perminute) of disruptive responses for all studentsin each class. During baseline, relatively highand stable levels of disruptive behavior wereobserved in all classrooms (Ms 5 13, 5, 4, 7,and 8 responses per minute for Teachers 1, 2, 3,4, and 5, respectively). Disruptive behaviordecreased in all classrooms following imple-mentation of the GBG (Ms 5 2, 1, 1, 2, and 1
responses per minute for Teachers 1, 2, 3, 4,and 5, respectively). A new student enteredTeacher 2’s classroom and initially refused toplay the GBG the day Teacher 2 beganimplementing the GBG herself. The newstudent gradually began to join the class forgroup instruction and eventually played theGBG successfully. Teacher implementation ofthe GBG was monitored during every session toensure that the rules and rewards were statedand rewards were provided to the winningteams contingent on meeting the criteria forearning the rewards. Treatment integrity datawere collected while the teachers implementedthe GBG and were calculated by comparing theteachers’ total number of hatch marks to thetotal instances of disruptive behavior recordedby an observer. Treatment integrity averaged60% across all five classrooms. Althoughteachers’ implementation integrity was lowerthan what might be hoped, it is important tonote that these levels were enough to maintainthe intervention effects. The students did have ahistory of playing the GBG with an experi-menter before the teachers began playing theGBG, which may have been necessary for theGBG to be so effective when treatment integritydeclined. One area for future research couldinvolve systematically evaluating the effects ofchanges in treatment integrity on the effective-ness of the GBG.
Teachers easily transitioned to playing theGBG in their classrooms while teaching withoutcompromising the effectiveness of the GBG.These results were similar to those producedwith older children (e.g., Barrish et al., 1969;Harris & Sherman, 1973) and provide furtherevidence that the GBG is a simple and effectiveclassroom-management technique. Also, be-cause some of the classrooms participated inthe study for several months, the longer termeffectiveness of the GBG was demonstrated. Infact, after several weeks of exposure to the GBG,Teachers 2, 3, 4, and 5 asked the students tovote on whether they would like to play the
GOOD BEHAVIOR GAME 607
Figure 1. Total rate of disruptive behavior, including out of seat, talking out of turn, and touching, across sessionsfor each classroom. Teacher implementation of the GBG began after the dashed vertical line. Unique features in the datafor Teachers 2 and 3 are indicated by arrows.
608 JEANNE M. DONALDSON et al.
GBG for the rest of the year. Of the students inclassrooms that participated in the socialvalidity assessment (students for Teachers 2, 3,4, and 5), 78% voted to continue playing theGBG for the rest of the year. Some studentseven played the GBG during free time; one ortwo students played as teachers and providedhatch marks for students who were breaking therules. Data collection continued in Teacher 1’sclassroom until the end of the year, so herclassroom was not asked if they wanted tocontinue to play. Teachers 2, 3, 4, and 5 alsoimplemented the GBG for the remainder of theschool year, independent of participation in thisstudy. All teachers continued to play the GBGthe following school year.
The GBG could be conceptualized as a typeof differential reinforcement of low rates ofresponding schedule in which reinforcers aredelivered contingent on the occurrence of fewerthan a particular number of responses within aspecified time period (Dietz & Repp, 1973).However, reinforcer assessments were notconducted to determine whether the rewardsprovided would actually function as reinforcersfor any specific behavior for any or all of thechildren in the classrooms. Also, the GBGincludes several components, making it difficultto determine which of the basic principlesunderlie its effectiveness. Rewards may havefunctioned as reinforcers for appropriate behav-ior, hatch marks may have functioned aspunishers for disruptive behavior, and socialpraise or scolding from teammates could alsohave functioned as reinforcers or punishers.
One limitation that should be addressed infuture research is that data on individuals’responses were not isolated. Data on the changein behavior of each individual student could beimportant, but because there were 15 to 22students in each classroom, collecting data oneach individual student was not feasible.Although the low rates of disruptive behaviorduring the GBG make it likely that all or moststudents who were engaging in disruptive
behavior during baseline responded to theintervention, the extent to which the GBGchanged the behavior of each individual studentis unknown. Another area for future research isto evaluate the effects of the GBG on academicperformance. Because the GBG is typicallyplayed during instructional time, a decrease indisruptive behavior during this time suggeststhat the students should have fewer distractionsfrom the lesson (e.g., the class is quieter so theteacher can be heard). Further support would beprovided for the use of the GBG if academicimprovements were demonstrated as a result.
REFERENCES
Barrish, H. H., Saunders, M. S., & Wolf, M. M. (1969).Good behavior game: Effects of individual contin-gencies for group consequences on disruptive behaviorin a classroom. Journal of Applied Behavior Analysis, 2,119–124.
Dietz, S. M., & Repp, A. C. (1973). Decreasing classroommisbehavior through the use of DRL schedules ofreinforcement. Journal of Applied Behavior Analysis, 6,457–463.
Embry, D. D. (2002). The good behavior game: A bestpractice candidate as a universal behavioral vaccine.Clinical Child and Family Psychology Review, 5,273–297.
Harris, V. W., & Sherman, J. A. (1973). Use and analysisof the ‘‘good behavior game’’ to reduce disruptiveclassroom behavior. Journal of Applied BehaviorAnalysis, 6, 405–417.
Kellam, S. G., Brown, C. H., Poduska, J. M., Ialongo, N.S., Wang, W., Toyinbo, P., et al. (2008). Effects of auniversal classroom behavior management program infirst and second grades on young adult behavioral,psychiatric, and social outcomes. Drug and AlcoholDependence, 95S, S5–S28.
Kellam, S. G., Ling, X., Merisca, R., Brown, C. H., &Ialongo, N. (1994). The effect of the level ofaggression in the first grade classroom on the courseand malleability of aggressive behavior in middleschool. Development and Psychopathology, 10,165–185.
Tingstrom, D. H., Sterling-Turner, H. E., & Wilczynski,S. M. (2006). The good behavior game: 1969–2002.Behavior Modification, 30, 225–253.
U.S. Department of Health and Human Services. (2001).Youth violence: A report of the Surgeon General.Rockville, MD: Author.
Received April 27, 2010Final acceptance September 27, 2010Action Editor, Michael Kelley
GOOD BEHAVIOR GAME 609
<< /ASCII85EncodePages false /AllowTransparency false /AutoPositionEPSFiles true /AutoRotatePages /None /Binding /Left /CalGrayProfile (Dot Gain 30%) /CalRGBProfile (None) /CalCMYKProfile (U.S. Sheetfed Coated v2) /sRGBProfile (sRGB IEC61966-2.1) /CannotEmbedFontPolicy /Error /CompatibilityLevel 1.4 /CompressObjects /Off /CompressPages true /ConvertImagesToIndexed false /PassThroughJPEGImages true /CreateJobTicket false /DefaultRenderingIntent /Default /DetectBlends true /DetectCurves 0.1000 /ColorConversionStrategy /LeaveColorUnchanged /DoThumbnails false /EmbedAllFonts true /EmbedOpenType false /ParseICCProfilesInComments true /EmbedJobOptions true /DSCReportingLevel 0 /EmitDSCWarnings false /EndPage -1 /ImageMemory 1048576 /LockDistillerParams false /MaxSubsetPct 100 /Optimize false /OPM 1 /ParseDSCComments false /ParseDSCCommentsForDocInfo true /PreserveCopyPage true /PreserveDICMYKValues true /PreserveEPSInfo true /PreserveFlatness true /PreserveHalftoneInfo false /PreserveOPIComments false /PreserveOverprintSettings true /StartPage 1 /SubsetFonts true /TransferFunctionInfo /Apply /UCRandBGInfo /Remove /UsePrologue false /ColorSettingsFile () /AlwaysEmbed [ true ] /NeverEmbed [ true ] /AntiAliasColorImages false /CropColorImages true /ColorImageMinResolution 150 /ColorImageMinResolutionPolicy /OK /DownsampleColorImages true /ColorImageDownsampleType /Bicubic /ColorImageResolution 600 /ColorImageDepth 8 /ColorImageMinDownsampleDepth 1 /ColorImageDownsampleThreshold 1.50000 /EncodeColorImages true /ColorImageFilter /FlateEncode /AutoFilterColorImages false /ColorImageAutoFilterStrategy /JPEG /ColorACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /ColorImageDict << /QFactor 0.40 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000ColorACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000ColorImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasGrayImages false /CropGrayImages true /GrayImageMinResolution 150 /GrayImageMinResolutionPolicy /OK /DownsampleGrayImages true /GrayImageDownsampleType /Bicubic /GrayImageResolution 600 /GrayImageDepth 8 /GrayImageMinDownsampleDepth 2 /GrayImageDownsampleThreshold 1.50000 /EncodeGrayImages true /GrayImageFilter /FlateEncode /AutoFilterGrayImages false /GrayImageAutoFilterStrategy /JPEG /GrayACSImageDict << /QFactor 0.15 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /GrayImageDict << /QFactor 0.40 /HSamples [1 1 1 1] /VSamples [1 1 1 1] >> /JPEG2000GrayACSImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /JPEG2000GrayImageDict << /TileWidth 256 /TileHeight 256 /Quality 30 >> /AntiAliasMonoImages false /CropMonoImages true /MonoImageMinResolution 1200 /MonoImageMinResolutionPolicy /OK /DownsampleMonoImages true /MonoImageDownsampleType /Bicubic /MonoImageResolution 1200 /MonoImageDepth -1 /MonoImageDownsampleThreshold 1.50000 /EncodeMonoImages true /MonoImageFilter /CCITTFaxEncode /MonoImageDict << /K -1 >> /AllowPSXObjects false /CheckCompliance [ /None ] /PDFX1aCheck false /PDFX3Check false /PDFXCompliantPDFOnly true /PDFXNoTrimBoxError false /PDFXTrimBoxToMediaBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXSetBleedBoxToMediaBox false /PDFXBleedBoxToTrimBoxOffset [ 0.00000 0.00000 0.00000 0.00000 ] /PDFXOutputIntentProfile (Euroscale Coated v2) /PDFXOutputConditionIdentifier (FOGRA1) /PDFXOutputCondition () /PDFXRegistryName (http://www.color.org) /PDFXTrapped /False /CreateJDFFile false /SyntheticBoldness 1.000000 /Description << /DEU <FEFF00560065007200770065006e00640065006e0020005300690065002000640069006500730065002000450069006e007300740065006c006c0075006e00670065006e002c00200075006d002000650069006e0065006e00200042006500720069006300680074002000fc00620065007200200064006900650020005000440046002f0058002d0033002d004b006f006d007000610074006900620069006c0069007400e4007400200065007200680061006c00740065006e00200075006e00640020005000440046002d0044006f006b0075006d0065006e007400650020006e00750072002000640061006e006e0020007a0075002000650072007300740065006c006c0065006e002c002000770065006e006e0020007300690065002000fc0062006500720020006400690065007300650020004b006f006d007000610074006900620069006c0069007400e400740020007600650072006600fc00670065006e002e0020005000440046002f00580020006900730074002000650069006e0065002000490053004f002d004e006f0072006d0020007a0075006d002000410075007300740061007500730063006800200076006f006e0020006400690067006900740061006c0065006e00200044007200750063006b0076006f0072006c006100670065006e002e0020005700650069007400650072006500200049006e0066006f0072006d006100740069006f006e0065006e0020007a0075006d002000450072007300740065006c006c0065006e00200076006f006e0020005000440046002f0058002d0033002d006b006f006d00700061007400690062006c0065006e0020005000440046002d0044006f006b0075006d0065006e00740065006e002000660069006e00640065006e002000530069006500200069006d0020004100630072006f006200610074002d00480061006e00640062007500630068002e00200044006900650020005000440046002d0044006f006b0075006d0065006e007400650020006b00f6006e006e0065006e0020006d006900740020004100630072006f0062006100740020006f0064006500720020006d00690074002000640065006d002000520065006100640065007200200034002e003000200075006e00640020006800f600680065007200200067006500f600660066006e00650074002000770065007200640065006e002e> /FRA <FEFF004f007000740069006f006e00730020007000650072006d0065007400740061006e007400200064002700e900760061006c0075006500720020006c006100200063006f006e0066006f0072006d0069007400e9002000e00020006c00610020006e006f0072006d00650020005000440046002f0058002d003300200065007400200064006500200063006f006e0064006900740069006f006e006e006500720020006c0061002000700072006f00640075006300740069006f006e00200064006500200064006f00630075006d0065006e007400730020005000440046002000e000200063006500740074006500200063006f006e0066006f0072006d0069007400e9002e0020005000440046002f0058002000650073007400200075006e00650020006e006f0072006d0065002000490053004f00200064002700e9006300680061006e0067006500200064006500200063006f006e00740065006e00750020006700720061007000680069007100750065002e00200050006f0075007200200065006e0020007300610076006f0069007200200070006c0075007300200073007500720020006c006100200063007200e9006100740069006f006e00200064006500200064006f00630075006d0065006e00740073002000500044004600200063006f006e0066006f0072006d00650073002000e00020005000440046002f0058002d0033002c00200063006f006e00730075006c00740065007a0020006c00650020004700750069006400650020006400650020006c0027007500740069006c0069007300610074006500750072002000640027004100630072006f006200610074002e00200049006c002000650073007400200070006f0073007300690062006c0065002000640027006f00750076007200690072002000630065007300200064006f00630075006d0065006e007400730020005000440046002000640061006e00730020004100630072006f0062006100740020006500740020005200650061006400650072002c002000760065007200730069006f006e00200034002e00300020006f007500200075006c007400e9007200690065007500720065002e> /JPN <FEFF005000440046002f0058002d00336e9662e0306e30ec30dd30fc30c87528304a30883073658766f84f5c62107528306b4f7f75283057307e30593002005000440046002f00580020306f30b030e930d530a330c330af30b3002030f330c630f330c4590963db306b304a3051308b002000490053004f00206a196e96306730593002005000440046002f0058002d003300206e9662e0306e658766f84f5c6210306b306430443066306f0020004100630072006f006200610074002030e630fc30b630ac30a430c9309253c2716730573066304f30603055304430024f5c62103057305f00200050004400460020306f0020004100630072006f0062006100740020304a30883073002000520065006100640065007200200034002e003000204ee5964d30678868793a3067304d307e30593002> /PTB <FEFF005500740069006c0069007a006500200065007300740061007300200063006f006e00660069006700750072006100e700f5006500730020007000610072006100200063007200690061007200200064006f00630075006d0065006e0074006f007300200050004400460020006500200065006d0069007400690072002000720065006c0061007400f300720069006f007300200073006f00620072006500200063006f006e0066006f0072006d0069006400610064006500200063006f006d0020006f0020005000440046002f0058002d0033002e0020005000440046002f0058002000e900200075006d0020007000610064007200e3006f002000640061002000490053004f00200070006100720061002000740072006f0063006100200064006500200063006f006e0074006500fa0064006f00200067007200e1006600690063006f002e002000500061007200610020006f00620074006500720020006d00610069007300200069006e0066006f0072006d006100e700f50065007300200073006f00620072006500200063006f006d006f00200063007200690061007200200064006f00630075006d0065006e0074006f0073002000500044004600200065006d00200063006f006e0066006f0072006d0069006400610064006500200063006f006d0020006f0020005000440046002f0058002d0033002c00200063006f006e00730075006c007400650020006f0020004700750069006100200064006f002000550073007500e100720069006f00200064006f0020004100630072006f006200610074002e0020004f007300200064006f00630075006d0065006e0074006f0073002000500044004600200070006f00640065006d0020007300650072002000610062006500720074006f007300200063006f006d0020006f0020004100630072006f006200610074002c002000520065006100640065007200200034002e00300020006500200070006f00730074006500720069006f0072002e> /DAN <FEFF004200720075006700200064006900730073006500200069006e0064007300740069006c006c0069006e006700650072002000740069006c00200061007400200072006100700070006f007200740065007200650020006f006d0020006f0076006500720068006f006c00640065006c007300650020006100660020005000440046002f0058002d00330020006f00670020006b0075006e002000700072006f0064007500630065007200650020005000440046002d0064006f006b0075006d0065006e007400650072002c002000680076006900730020006400650020006f0076006500720068006f006c0064006500720020007300740061006e00640061007200640065006e002e0020005000440046002f005800200065007200200065006e002000490053004f002d007300740061006e0064006100720064002000740069006c00200075006400760065006b0073006c0069006e0067002000610066002000670072006100660069006b0069006e00640068006f006c0064002e00200059006400650072006c006900670065007200650020006f0070006c00790073006e0069006e0067006500720020006f006d0020006f007000720065007400740065006c007300650020006100660020005000440046002d0064006f006b0075006d0065006e007400650072002c00200064006500720020006f0076006500720068006f006c0064006500720020005000440046002f0058002d0033002c002000660069006e00640065007200200064007500200069002000620072007500670065007200760065006a006c00650064006e0069006e00670065006e002000740069006c0020004100630072006f006200610074002e0020005000440046002d0064006f006b0075006d0065006e007400650072006e00650020006b0061006e002000e50062006e006500730020006d006500640020004100630072006f0062006100740020006f0067002000520065006100640065007200200034002e00300020006f00670020006e0079006500720065002e> /NLD <FEFF004700650062007200750069006b002000640065007a006500200069006e007300740065006c006c0069006e00670065006e0020006f006d00200064006500200063006f006d007000610074006900620069006c006900740065006900740020006d006500740020005000440046002f0058002d003300200074006500200063006f006e00740072006f006c006500720065006e00200065006e00200061006c006c00650065006e0020005000440046002d0064006f00630075006d0065006e00740065006e002000740065002000700072006f006400750063006500720065006e002000640069006500200063006f006d007000610074006900620065006c0020007a0069006a006e002e0020005000440046002f0058002000690073002000650065006e002000490053004f002d007300740061006e0064006100610072006400200076006f006f00720020006800650074002000750069007400770069007300730065006c0065006e002000760061006e002000670072006100660069007300630068006500200069006e0068006f00750064002e002000520061006100640070006c0065006500670020006400650020006700650062007200750069006b00650072007300680061006e0064006c0065006900640069006e0067002000760061006e0020004100630072006f00620061007400200076006f006f00720020006d00650065007200200069006e0066006f0072006d00610074006900650020006f00760065007200200068006500740020006d0061006b0065006e002000760061006e0020005000440046002d0064006f00630075006d0065006e00740065006e002000640069006500200063006f006d007000610074006900620065006c0020007a0069006a006e0020006d006500740020005000440046002f0058002d0033002e0020004400650020005000440046002d0064006f00630075006d0065006e00740065006e0020006b0075006e006e0065006e00200077006f007200640065006e002000670065006f00700065006e00640020006d006500740020004100630072006f00620061007400200065006e002000520065006100640065007200200034002e003000200065006e00200068006f006700650072002e> /ESP <FEFF0055007300650020006500730074006100730020006f007000630069006f006e00650073002000700061007200610020007200650061006c0069007a0061007200200075006e00200069006e0066006f0072006d006500200073006f0062007200650020006c006100200063006f006d007000610074006900620069006c006900640061006400200063006f006e0020005000440046002f0058002d003300200079002000670065006e006500720061007200200064006f00630075006d0065006e0074006f007300200050004400460020007300f3006c006f00200073006900200073006f006e00200063006f006d00700061007400690062006c00650073002e0020005000440046002f005800200065007300200075006e002000650073007400e1006e006400610072002000490053004f0020007000610072006100200065006c00200069006e00740065007200630061006d00620069006f00200064006500200063006f006e00740065006e00690064006f00200067007200e1006600690063006f002e002000500061007200610020006f006200740065006e006500720020006d00e1007300200069006e0066006f0072006d00610063006900f3006e00200061006300650072006300610020006400650020006300f3006d006f00200063007200650061007200200064006f00630075006d0065006e0074006f0073002000500044004600200063006f006d00700061007400690062006c0065007300200063006f006e0020005000440046002f0058002d0033002c00200063006f006e00730075006c007400650020006c006100200047007500ed0061002000640065006c0020007500730075006100720069006f0020006400650020004100630072006f006200610074002e0020004c006f007300200064006f00630075006d0065006e0074006f00730020005000440046002000730065002000700075006500640065006e00200061006200720069007200200063006f006e0020004100630072006f00620061007400200079002000520065006100640065007200200034002e003000200079002000760065007200730069006f006e0065007300200070006f00730074006500720069006f007200650073002e> /SUO <FEFF004e00e4006900640065006e002000610073006500740075007300740065006e0020006100760075006c006c006100200076006f006900740020006d00e400e4007200690074007400e400e40020005000440046002f0058002d0033002d00790068007400650065006e0073006f0070006900760075007500640065006e0020006a00610020006c0075006f00640061002000730065006e0020006d0075006b006100690073006900610020005000440046002d0061007300690061006b00690072006a006f006a0061002e0020005000440046002f00580020006f006e002000490053004f002d007300740061006e006400610072006400690073006f006900740075002000670072006100610066006900730065006e002000730069007300e4006c006c00f6006e0020006500730069007400790073006d0075006f0074006f002e0020004c0069007300e40074006900650074006f006a00610020005000440046002f0058002d0033002d00790068007400650065006e0073006f00700069007600690065006e0020005000440046002d0061007300690061006b00690072006a006f006a0065006e0020006c0075006f006e006e00690073007400610020006f006e002000410064006f006200650020004100630072006f0062006100740020002d006b00e400790074007400f6006f0070007000610061007300730061002e0020005000440046002d0061007300690061006b00690072006a0061007400200076006f0069006400610061006e0020006100760061007400610020004100630072006f006200610074002d0020006a0061002000520065006100640065007200200034002e00300020002d006f0068006a0065006c006d0061006c006c0061002000740061006900200075007500640065006d006d0061006c006c0061002000760065007200730069006f006c006c0061002e> /ITA <FEFF00550073006100720065002000710075006500730074006500200069006d0070006f007300740061007a0069006f006e00690020007000650072002000760065007200690066006900630061007200650020006c006100200063006f006e0066006f0072006d0069007400e0002000610020005000440046002f0058002d003300200065002000630072006500610072006500200064006f00630075006d0065006e00740069002000500044004600200073006f006c006f00200069006e0020006300610073006f00200064006900200063006f006e0066006f0072006d0069007400e0002e0020005000440046002f0058002d0033002000e800200075006e006f0020007300740061006e0064006100720064002000490053004f00200070006500720020006c006f0020007300630061006d00620069006f00200064006900200063006f006e00740065006e00750074006f0020006700720061006600690063006f002e002000500065007200200075006c0074006500720069006f0072006900200069006e0066006f0072006d0061007a0069006f006e0069002000730075006c006c006100200063007200650061007a0069006f006e006500200064006900200064006f00630075006d0065006e00740069002000500044004600200063006f006e0066006f0072006d0069002000610020005000440046002f0058002d0033002c00200063006f006e00730075006c00740061007200650020006c0061002000470075006900640061002000640065006c006c0027007500740065006e007400650020006400690020004100630072006f006200610074002e0020004900200064006f00630075006d0065006e00740069002000500044004600200070006f00730073006f006e006f0020006500730073006500720065002000610070006500720074006900200063006f006e0020004100630072006f00620061007400200065002000520065006100640065007200200034002e003000200065002000760065007200730069006f006e006900200073007500630063006500730073006900760065002e> /NOR <FEFF004200720075006b00200064006900730073006500200069006e006e007300740069006c006c0069006e00670065006e0065002000740069006c002000e500200072006100700070006f007200740065007200650020006f006d0020005000440046002f0058002d0033002d006b006f006d007000610074006900620069006c00690074006500740020006f00670020006c0061006700650020005000440046002d0064006f006b0075006d0065006e00740065007200200062006100720065002000680076006900730020006b006f006d007000610074006900620065006c002e0020005000440046002f005800200065007200200065006e002000490053004f002d007300740061006e006400610072006400200066006f00720020006700720061006600690073006b00200069006e006e0068006f006c006400730075007400760065006b0073006c0069006e0067002e00200048007600690073002000640075002000760069006c0020006800610020006d0065007200200069006e0066006f0072006d00610073006a006f006e0020006f006d002000680076006f007200640061006e0020006400750020006f007000700072006500740074006500720020005000440046002f0058002d0033002d006b006f006d00700061007400690062006c00650020005000440046002d0064006f006b0075006d0065006e007400650072002c0020006b0061006e002000640075002000730065002000690020006200720075006b00650072006800e5006e00640062006f006b0065006e00200066006f00720020004100630072006f006200610074002e0020005000440046002d0064006f006b0075006d0065006e0074006500720020006b0061006e002000e50070006e006500730020006d006500640020004100630072006f0062006100740020006f0067002000520065006100640065007200200034002e00300020006f0067002000730065006e006500720065002e> /SVE <FEFF0041006e007600e4006e006400200065006e00640061007300740020006400650020006800e4007200200069006e0073007400e4006c006c006e0069006e006700610072006e00610020006e00e40072002000640075002000760069006c006c00200072006100700070006f007200740065007200610020006f006d0020005000440046002f0058002d0033002d007300740061006e00640061007200640020006f0063006800200073006b0061007000610020005000440046002d0064006f006b0075006d0065006e007400200073006f006d0020006600f6006c006a00650072002000640065006e006e00610020007300740061006e0064006100720064002e0020005000440046002f0058002000e4007200200065006e002000490053004f002d007300740061006e00640061007200640020006600f6007200200075007400620079007400650020006100760020006700720061006600690073006b007400200069006e006e0065006800e5006c006c002e0020004d0065007200200069006e0066006f0072006d006100740069006f006e0020006f006d002000680075007200200064007500200073006b00610070006100720020005000440046002d0064006f006b0075006d0065006e007400200073006f006d0020006600f6006c006a006500720020005000440046002f0058002d003300200068006900740074006100720020006400750020006900200061006e007600e4006e00640061007200680061006e00640062006f006b0065006e0020006600f600720020004100630072006f006200610074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e0020006b0061006e002000f600700070006e006100730020006d006500640020004100630072006f0062006100740020006f00630068002000520065006100640065007200200034002e003000200065006c006c00650072002000730065006e006100720065002e> /ENU (Settings for the Rampage workflow.) >>>> setdistillerparams<< /HWResolution [2400 2400] /PageSize [612.000 792.000]>> setpagedevice
