European Heart Journal Advance Access published online on September 27, 2008
European Heart Journal, doi:10.1093/eurheartj/ehn432
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Open-heart surgery at school age does not affect neurocognitive functioning
1 Department of Medical Psychology, Radboud University Nijmegen Medical Centre, PO Box 9101, 6500 HB Nijmegen, The Netherlands
2 Department of Cardiothoracic Surgery, Radboud University Nijmegen Medical Centre, PO Box 9101, 6500 HB Nijmegen, The Netherlands
3 Children's Heart Centre, Radboud University Nijmegen Medical Centre, PO Box 9101, 6500 HB Nijmegen, The Netherlands
Received 30 November 2007; revised 3 July 2008; accepted 12 September 2008.
* Corresponding author. Tel: +31 24 3613947, Fax: +31 24 3613425, Email: r.vanderrijken{at}cukz.umcn.nl
| Abstract |
|---|
|
|
|---|
Aims: Although neurocognitive problems after open-heart surgery for congenital heart disease are frequent, due to a shortage of prospective studies assessing neurocognitive functioning both before and after the procedure, the exact nature of the deficits usually remains unknown. The present study aims at assessing the neurocognitive effects of, in particular, cardiopulmonary bypass at school age. In addition, surgery-related risk factors for reduced neurocognitive outcome are explored.
Methods and results: Participants were aged between 6 and 16 years. Forty-three children indicated for open-heart surgery and a comparison group of 19 children scheduled for interventional cardiac catheterization completed a neurocognitive assessment battery before and 1 year after their procedures. Forty healthy matched controls did so at a 1 year interval. The baseline-to-follow-up outcomes were similar in all three groups. The observed improvements most likely resulted from increased age and the repeated neurocognitive assessment. No risk factors for postsurgical neurocognitive deficits were identified.
Conclusion: The present study demonstrates that at school age cardiac surgery using full-flow cardiopulmonary bypass does not affect neurocognitive functioning.
Key Words: Congenital heart disease Open-heart surgery Cardiopulmonary bypass Neurocognitive functioning School age Risk factors
| Introduction |
|---|
|
|
|---|
Neurocognitive problems after open-heart surgery for congenital heart disease are common, with deficiencies in attention and speed of information processing, perceptual-organizational abilities, and motor functions being the most prevalent.1–3 Deficits have also been reported in verbal functions3–5 and, to a lesser extent, in general intelligence.3,4,6
In attempting to explain the neurocognitive difficulties after open-heart surgery, researchers have mainly focused on the role of cardiopulmonary bypass and related surgical risk factors. Results showed that cardiopulmonary bypass may indeed be associated with neurocognitive problems.2,4,5 Moreover, cardiopulmonary bypass may cause embolic complications, hypoperfusion, ischaemic reperfusion injury, or inflammatory reactions, and, consequently, injury to the central nervous system.7,8 Other surgical risk factors for neurocognitive or neurological outcome that have been identified include prolonged duration of aortic cross-clamping, lowered pH, decreased haematocrit levels, and elevated blood lactate levels.2,9–11
Despite the established associations between surgical risk factors and neurocognitive outcome, the exact nature of the neurocognitive difficulties in children following surgical intervention for congenital heart disease remains unclear. As the majority of these children need cardiac surgery shortly after birth, a pre-operative assessment of their neurocognitive functioning is unfeasible, leaving the question whether the post-operative neurocognitive problems might already have been present prior to surgery unanswered. Studies that did include a pre-operative assessment of (neuro)cognitive functioning indeed demonstrated pre-surgical deficits12–15 and showed that neurocognitive functioning is not necessarily associated with surgical risk factors.16,17 It has been suggested that not only surgery-related but also disease-related processes (e.g. cyanosis, haemodynamic instability) might be associated with neurocognitive deficits.12,15
The few prospective studies that evaluated neurocognitive functioning both before and after open-heart surgery mostly comprised neonates and pre-school children or only used general intelligence measures to identify the effects of the intervention. However, any neurocognitive problems will particularly become apparent at school age and involve specific neurocognitive domains.18,19 The principal aim of the present study therefore was to determine the effects of cardiopulmonary bypass in a cohort of school-age children by assessing their neurocognitive functioning shortly before and 1 year after the intervention. To our knowledge, ours is the first study to do so. In addition, we explored the surgery-related risk factors for reduced neurocognitive outcome.
| Methods |
|---|
|
|
|---|
Sample selection and procedure
Eligible were all cardiac patients aged between 6 and 16 years who were awaiting open-heart surgery at the Radboud University Nijmegen Medical Centre between June 2002 and June 2006. To ensure that all neurocognitive findings resulted from no other factors than the congenital heart disease and associated surgery, candidates with physical and mental comorbidities [e.g. syndromes, visual/hearing/speech/motor or cognitive impairments (full-scale IQ below 70), or severe learning difficulties] were excluded, as were children with an insufficient command of the Dutch language and those with serious family problems (i.e. major parental illness).
To identify the specific effects of cardiopulmonary bypass as opposed to the general procedural effects of cardiac surgery, we also enrolled patients awaiting interventional cardiac catheterization using the same inclusion and exclusion criteria. Finally, to control for age and effects of repeated testing on the post-operative neurocognitive changes, we recruited healthy volunteers from regional mainstream primary and secondary schools. The control group was matched for age, sex, educational level, general intelligence, and parental educational level with both patient groups.
Following inclusion into the hospital's waiting lists for open-heart surgery and catheterization or after enrolment (controls), written consent was obtained from the parents and from all children aged over 12 years. The patients were subsequently scheduled for individual neurocognitive assessment at the medical centre. Assessment took place in the period prior to surgery or catheter intervention and again 1 year afterwards. The healthy controls also took all assessments twice with a 1 year interval. The study was approved by the Regional Committee on Research Involving Human Subjects.
Neurocognitive assessment battery
The test battery consisted of standardized tests suitable for our age group and covered the neurocognitive domains known to be at risk in children having undergone open-heart surgery. As behavioural and emotional aspects may affect neurocognitive functioning, these factors were also evaluated.
General intelligence was assessed by means of the Dutch version of the Wechsler Intelligence Scale for Children-Third Edition (WISC-III).20,21 Three measures were derived: verbal intelligence, performance intelligence, and full-scale intelligence.
Attention and processing speed were evaluated using four tasks: the Letter Detection subtest of the Amsterdam Neuropsychological Test Battery (ANT), the Complex Reaction Time Task (CRT), a computerized drawing task, and the Bourdon-Vos test for sustained attention.22–25 For the first three tasks, the mean reaction times were derived; for the last task, the mean row completion time was analysed.
Construction, i.e. the ability to assemble the separate parts of a picture and to copy it as a coherent whole, was reflected by the organization score of the Rey–Osterrieth Complex Figure and the standard score of the Developmental Test of Visual-Motor Integration (VMI).26,27
Motor speed was measured using a basic finger-tapping task with the mean number of taps being calculated for both hands. We also calculated CRT mean movement times and mean drawing speed on the computerized drawing task.23,24
Motor planning and fluency measures were obtained from the computerized drawing task:24 motor planning was expressed by the mean duration of pauses and movement fluency by the mean number of velocity peaks.
Behavioural and emotional functioning were evaluated using three versions of the Child Behaviour Checklist (CBCL): the Dutch CBCL, the Dutch Teacher Report Form (TRF), and the Dutch Youth Self-Report (YSR).28–31 Scores indicating internalizing, externalizing, and total problems were computed.
Surgery-related risk factors for reduced neurocognitive outcome
All the children undergoing open-heart surgery had similar conduction of the extracorporeal circulation procedures, using full-flow cardiopulmonary bypass (2.4–3.0 l/min/m2 body surface area) at moderate hypothermia (25°C nasopharyngeal temperature) during which alpha-stat blood gas management was used and haematocrit levels were kept at 20–25%. Myocardial protection was achieved by intermittent administration of cold crystalline cardioplegic solution into the aortic root. When long cross-clamp times were anticipated, cold blood cardioplegia was administered.
The patients' medical records were checked for anatomic diagnosis, duration of cardiopulmonary bypass, duration of aortic cross-clamping, minimum pH, minimum haematocrit level, and maximum lactate level. Additionally, for all patients the complexity level of cardiac surgery was classified into one of four groups according to the AristotleTM classification.32 The AristotleTM classification of surgery is determined by the potential for hospital mortality, the potential for postoperative morbidity, and the technical difficulty of the procedure.32
Statistical analysis
To guarantee adequate matching of the three groups, univariate analyses of variance (ANOVAs) and
2 tests were applied. Binomial tests were used to confirm that the patients behavioural and emotional function scores were comparable to population norms. As no between-group differences were expected, a two-tailed P-value of <0.15 was chosen to indicate statistical significance.
The neurocognitive baseline performance scores of the three groups were compared to identify existing (pre-intervention) between-group differences. For those variables that were not normally distributed (ANT: reaction time, CRT: reaction time and movement time, computerized drawing task: reaction time, Bourdon-Vos: row completion time), reciprocal transformations were performed and used for analyses. Group differences were analysed for each of the neurocognitive domains by means of multivariate analyses of variance (MANOVAs). Statistical significance was set at P < 0.05 (two-tailed).
Repeated measures MANOVAs were conducted to calculate the baseline-to-follow-up change for each of the neurocognitive domains. The effects on the general intelligence measures and the specific neurocognitive domains were investigated separately, again using a two-tailed P-value of <0.05. Besides the statistical significance of the groups' baseline-to-follow-up neurocognitive change, the clinical significance of the change was calculated for patients having undergone open-heart surgery. Clinically significant change was determined according to the following steps (see Lewis et al.,33 p. 438). First, for each task and each patient, the pre-operative score was subtracted from the post-operative score. From this, the mean change for the healthy controls (calculated by deducting the baseline from the follow-up scores) was subtracted, and the outcome was then divided by the standard deviation of this change in the control group. This yielded z-scores of relative change per patient per task. Second, z-combined scores were calculated by summing across tasks within neurocognitive domains, divided by the standard deviation of summed z-scores in the healthy controls. Clinically significant change was defined as a z-combined score of |1.65| and higher on at least one neurocognitive domain or intelligence scale.
For the surgical group, correlations were explored between z-combined scores for neurocognitive change and surgical risk factors. Spearman's rank correlations were computed for the risk factors that were not normally distributed (duration of cardiopulmonary bypass and aortic cross-clamping, maximum lactate levels, and AristotleTM classification). For normally distributed variables (minimum pH and minimum haematocrit levels), Pearson's product-moment correlations were applied. Because of the explorative nature of the analyses, statistical significance was set at a two-tailed P-value of <0.10. All statistical analyses were carried out using the Statistical Package for the Social Sciences (SPSS 12.0).
| Results |
|---|
|
|
|---|
Baseline characteristics
Of the 89 patients scheduled for open-heart surgery, a total of 27 were excluded due to physical or mental comorbidity (n = 23), insufficient command of the Dutch language (n = 3), or family problems (n = 1). Of the 62 eligible patients, 45 (patient and/or parent) consented to participate. Two were unable to complete the follow-up assessment: one patient died within the 1 year interval and another patient declined because of the recent loss of his father. The final surgical group accordingly consisted of 43 patients (69%).
Of the 38 patients awaiting interventional cardiac catheterization, a total of 13 were excluded due to physical or mental comorbidity (n = 11) and insufficient command of the Dutch language (n = 2). Of the 25 eligible patients 19 consented to participate (76%), all of whom completed the follow-up assessment.
Of the 41 healthy peers that were initially enrolled and assessed, one proved untraceable for the second assessment due to a change of address. Analyses thus comprised 40 controls.
Table 1 lists the baseline characteristics of all participants and Table 2 the medical details of the two patient groups. Groups were adequately matched as no significant differences emerged regarding the demographic characteristics and general baseline intelligence scores (Tables 1 and 3; ANOVAs and
2 tests, P > 0.15). In addition, the CBCL, TRF, and YSR showed the patients behavioural and emotional scores to be comparable to the Dutch norm scores (data not shown; binomial tests, P > 0.15).
|
|
|
Neurocognitive effects of cardiac surgery using cardiopulmonary bypass
Table 3 lists the baseline and follow-up results for the three groups. At baseline, none of the neurocognitive domains showed significant group differences (MANOVAs, P > 0.05).
Changes between baseline and follow-up scores were analysed to establish the effect of the open-heart procedure on the children's general intelligence and neurocognitive functioning. Table 4 shows the results of the repeated measures MANOVAs. Both main effects for group and time of assessment and the interaction effects between group and time of assessment are shown. No significant main effects were found for group, reflecting that general intelligence and neurocognitive functioning did not differ between the three groups. Significant main effects were found for time of assessment, implying that general intelligence and neurocognitive functioning had changed significantly from baseline to follow-up. Further inspection of the results revealed enhanced performance on all tasks, except for verbal intelligence and the VMI. No significant interaction effects were found, indicating similar baseline-to-follow-up changes for all three groups of participants.
|
In addition to group effects, neurocognitive change after open-heart surgery was investigated for all patients individually. More than one-third (35%) of the children who had undergone open-heart surgery showed clinically significant improvement on at least one neurocognitive domain or intelligence measure, whereas 12% showed post-operative decline.
Surgery-related risk factors for reduced neurocognitive outcome
Correlations were computed (Table 5) to establish whether neurocognitive changes after open-heart surgery were associated with specified surgical risk factors but none were found (Spearman's correlations and Pearson's correlations, P > 0.10).
|
| Discussion |
|---|
|
|
|---|
The present study sought to investigate the neurocognitive effects of open-heart surgery with full-flow cardiopulmonary bypass at school age using a prospective design with assessments both before and 1 year after the procedure. The use of a comparison group, i.e. children scheduled for interventional cardiac catheterization, as well as a matched healthy control group allowed differentiation between the explicit effects of cardiopulmonary bypass and any general effects of hospitalization, anaesthesia, increased age, and repeated neurocognitive testing.
We did not find any negative effects of the open-heart procedure, neither on the general intelligence measures, nor on any of the neurocognitive domains assessed. The reverse was true in that the children had augmented pre- to post-operative performance scores on most of the measures. In 35% of the children, the enhanced performance after open-heart surgery reflected a true improvement of functioning on at least one neurocognitive domain or intelligence measure. As post-operative decline only occurred in 12% of the children, the progress in neurocognitive functioning after 1 year was not only statistically but also clinically relevant.
As the improvements found in the surgical group were similar to the advances obtained in the catheterization group and in the healthy controls, evidently neither the use of cardiopulmonary bypass nor general characteristics of the medical intervention (e.g. anaesthesia and hospitalization) had negatively affected neurocognitive functioning. Accordingly, the specific surgical risk factors (duration of cardiopulmonary bypass, duration of aortic cross-clamping, minimum pH, minimum haematocrit level, and maximum lactate level) and the overall complexity of the surgical procedure (AristotleTM classification) were not associated with neurocognitive change. Therefore, the improved baseline-to-follow-up performances were most likely attributable to factors associated with neurocognitive testing in general. If they resulted from increased age, one would expect improvements on all tasks, except for those that use age-corrected standard scores (e.g. intelligence measures and the VMI). Since this was the case (with verbal intelligence and VMI being the exceptions), the results indeed seem to reflect an effect of age. However, increased age alone could not account for all improvements obtained seeing that the age-corrected scores for performance intelligence and full-scale intelligence both showed significant augmentation (not only in the patients, but also in the controls). As performance intelligence is known to be sensitive to test-retest effects,20 our assessment paradigm may account for these latter improvements.
The presented findings are in contrast with what would be expected from earlier research that did demonstrate neurocognitive problems after open-heart surgery.1–5 The incongruity may be explained by procedural differences. First, with today's rapid advances in surgical and anaesthetic techniques, the outcomes of surgery that took place several years ago may perhaps no longer compare to the outcomes that can be achieved with the current methods. Secondly, surgical techniques varied between studies. Whereas we made use of full-flow cardiopulmonary bypass at moderate hypothermia, many earlier studies applied deep hypothermic circulatory arrest, the neurocognitive risks of which are known to be higher than those associated with cardiopulmonary bypass.4,34 Studies that like ours investigated pre- and post-operative neurocognitive functioning involving cardiopulmonary bypass without deep hypothermia and circulatory arrest likewise failed to detect any negative effects.16,17 Thirdly, many of the earlier studies focused on neonates or infants rather than school-age children. Research has shown that central nervous system injury (for instance periventricular leukomalacia) after open-heart surgery is more common in neonates than it is in older infants.35 Therefore, heart surgery at a very young age might have a greater impact on the immature brain and further development, and might therefore be associated with higher risks of neurocognitive problems. Finally, since most previous studies lacked a pre-operative assessment, they could not preclude that (part of) the neurocognitive problems might have been present prior to surgery. An earlier comparative study of ours confirmed this supposition. Relative to healthy peers, our cardiac patients showed specific neurocognitive difficulties in motor planning and visual memory prior to their open-heart procedure (Van der Rijken et al., submitted for publication). Other prospective studies also identified pre-surgical neurocognitive problems.12,14,15 Thus, irrespective of open-heart surgery, children with congenital heart disease might already present with (mild) neurocognitive deficits.
Limitations
To ensure that the outcomes would stem from the children's heart conditions and ultimately from the associated open-heart surgery rather than from diminished physical or mental capacity of any kind, we applied strict exclusion criteria. We are aware that this yielded a cohort of relatively well-functioning children. The selection criteria applied limit the generalization of our results to all cardiac patients indicated for open-heart surgery and complicate comparisons with previous research. It is likely that we would have found more performance deficits if we had adopted less stringent criteria. However, as it was our primary goal to investigate the effects of open-heart surgery, we were less interested in pre-surgical deficits that might be unrelated to the heart condition and thus its repair. Although the exclusion of children with any physical or mental comorbidity probably has reduced the number and severity of neurocognitive problems, it did allow a clear interpretation of the results.
Because most neurocognitive problems following open-heart procedures will not become manifest until the child has reached school age, we chose to test children scheduled for surgery at age 6 to 16 years, which by definition is a comparatively small pool. The resultant relatively small sample size might have reduced the chances of finding significant group differences. Nevertheless, as all our findings, both the between-group and the individual results, pointed in the same direction, the results seem robust.
The diagnoses of the two cardiac groups varied somewhat since in our selection procedure we had made no allowance for cardiac diagnoses. However, our study focused on the effects of surgery rather than the effects of cardiac diagnosis. As we investigated neurocognitive functioning both before and after cardiac treatment, cardiac diagnosis was controlled for and had not influenced the outcomes.
| Conclusions |
|---|
|
|
|---|
When performed at school age, open-heart surgery using full-flow cardiopulmonary bypass at moderate hypothermia does not negatively affect the children's neurocognitive functioning. One year after the procedure, all showed improved functioning on the general intelligence measures and on the neurocognitive domains of attention and processing speed, construction, motor speed, and motor planning and fluency. As the improvements in the post-surgery group resembled those found in the catheterized group and in the healthy peer group, they most likely resulted from increased age and repeated neurocognitive testing. Although meriting replication, the present findings suggest that current surgical and interventional techniques for congenital cardiac disorders do not put school-age children at risk of developing neurocognitive problems.
Conflict of interest: none declared.
| References |
|---|
|
|
|---|
- Bellinger DC, Bernstein JH, Kirkwood MW, Rappaport LA, Newburger JW. Visual-spatial skills in children after open-heart surgery. J Dev Behav Pediatr (2003) 24:169–179.[Web of Science][Medline]
- Hövels-Gürich HH, Konrad K, Skorzenski D, Herpertz-Dahlmann B, Messmer BJ, Seghaye MC. Attentional dysfunction in children after corrective cardiac surgery in infancy. Ann Thorac Surg (2007) 83:1425–1430.
[Abstract/Free Full Text] - Miatton M, De Wolf D, François K, Thiery E, Vingerhoets G. Intellectual, neuropsychological, and behavioral functioning in children with tetralogy of Fallot. J Thorac Cardiovasc Surg (2007) 133:449–455.
[Abstract/Free Full Text] - Bellinger DC, Wypij D, duPlessis AJ, Rappaport LA, Jonas RA, Wernovsky G, Newburger JW. Neurodevelopmental status at eight years in children with dextro-transposition of the great arteries: The Boston Circulatory Arrest Trial. J Thorac Cardiovasc Surg (2003) 126:1385–1396.
[Abstract/Free Full Text] - Hövels-Gürich HH, Seghaye MC, Schnitker R, Wiesner M, Huber W, Minkenberg R, Kotlarek F, Messmer BJ, Von Bernuth G. Long-term neurodevelopmental outcomes in school-aged children after neonatal arterial switch operation. J Thorac Cardiovasc Surg (2002) 124:448–458.
[Abstract/Free Full Text] - Wernovsky G, Stiles KM, Gauvreau K, Gentles TL, duPlessis AJ, Bellinger DC, Walsh AZ, Burnett J, Jonas RA, Mayer JE, Newburger JW. Cognitive development after the Fontan operation. Circulation (2000) 102:883–889.
[Abstract/Free Full Text] - Mahle WT. Neurologic and cognitive outcomes in children with congenital heart disease. Curr Opin Pediatr (2001) 13:482–486.[CrossRef][Web of Science][Medline]
- Majnemer A, Limperopoulos C. Developmental progress of children with congenital heart defects requiring open heart surgery. Semin Pediatr Neurol (1999) 6:12–19.[CrossRef][Medline]
- Trittenwein G, Nardi A, Pansi H, Golej J, Burda G, Hermon M, Boigner H, Wollenek G. Early postoperative prediction of cerebral damage after pediatric cardiac surgery. Ann Thorac Surg (2003) 76:576–580.
[Abstract/Free Full Text] - Jonas RA, Wypij D, Roth SJ, Bellinger DC, Visconti KJ, duPlessis AJ, Goodkin H, Laussen PC, Farrell DM, Bartlett J, McGrath E, Rappaport LJ, Bacha EA, Forbess JM, del Nido PJ, Mayer JE, Newburger JW. The influence of hemodilution on outcome after hypothermic cardiopulmonary bypass: results of a randomized trial in infants. J Thorac Cardiovasc Surg (2003) 126:1765–1774.
[Abstract/Free Full Text] - Charpie JR, Dekeon MK, Goldberg CS, Mosca RS, Bove EL, Kulik TJ. Serial blood lactate measurements predict early outcome after neonatal repair or palliation for complex congenital heart disease. J Thorac Cardiovasc Surg (2000) 120:73–80.
[Abstract/Free Full Text] - Limperopoulos C, Majnemer A, Shevell MI, Rosenblatt B, Rohlicek C, Tchervenkov C. Neurodevelopmental status of newborns and infants with congenital heart defects before and after open heart surgery. J Pediatr (2000) 137:638–645.[CrossRef][Web of Science][Medline]
- Majnemer A, Limperopoulos C, Shevell M, Rosenblatt B, Rohlicek C, Tchervenkov C. Long-term neuromotor outcome at school entry of infants with congenital heart defects requiring open-heart surgery. J Pediatr (2006) 148:72–77.[CrossRef][Web of Science][Medline]
- Wray J, Sensky T. Controlled study of preschool development after surgery for congenital heart disease. Arch Dis Child (1999) 80:511–516.
[Abstract/Free Full Text] - Wray J, Sensky T. Congenital heart disease and cardiac surgery in childhood: effects on cognitive function and academic ability. Heart (2001) 85:687–691.
[Abstract/Free Full Text] - Mahle WT, Lundine K, Kanter KR, Forbess JM, Kirshbom P, Tosone SR, Vincent RN. The short term effects of cardiopulmonary bypass on neurologic function in children and young adults. Eur J Cardiothorac Surg (2004) 26:920–925.
[Abstract/Free Full Text] - Stavinoha PL, Fixler DE, Mahony L. Cardiopulmonary bypass to repair an atrial septal defect does not affect cognitive function in children. Circulation (2003) 107:2722–2725.
[Abstract/Free Full Text] - Van der Rijken REA, Maassen BAM, Walk TLM, Daniëls O, Hulstijn-Dirkmaat GM. Outcome after surgical repair of congenital cardiac malformations at school age. Cardiol Young (2007) 17:64–71.[CrossRef][Web of Science][Medline]
- Van Rijen EHM, Utens EMWJ, Roos-Hesselink JW, Meijboom FJ, Van Domburg RT, Roelandt JRTC, Bogers AJJC, Verhulst FC. Psychosocial functioning of the adult with congenital heart disease: a 20–33 years follow-up. Eur Heart J (2003) 24:673–683.
[Abstract/Free Full Text] - Kort W, Schittekatte M, Compaan EL, Bosmans M, Bleichrodt N, Vermeir G, Resing WCM, Verhaeghe P. Wechsler Intelligence Scale for Children Derde Editie NL (2002) 3rd ed. London: The Psychological Corporation.
- Wechsler D. Wechsler Intelligence Scale for Children (1991) 3rd ed. San Antonio: Psychological Corporation.
- De Sonneville LMJ. Amsterdamse Neuropsychologische Taken, Handleiding [Amsterdam Neuropsychological Tasks, Manual] (2000) Amstelveen, The Netherlands: Sonar.
- Vercoulen J, Bazelmans E, Swanink C, Galama J, Fennis J, Van der Meer J, Bleijenberg G. Evaluating neuropsychological impairment in chronic fatigue syndrome. J Clin Exp Neuropsychol (1998) 20:144–156.[Web of Science][Medline]
- Schoemaker MM, Schellekens JMH, Kalverboer AF, Kooistra L. Pattern drawing by clumsy children: a problem of movement control? In: Contemporary Issues in the Forensic, Developmental and Neurological Aspects of Handwriting—Simner ML, Hulstijn W, Girouard PL, eds. (1994) Toronto: AFDE. p45–64.
- Vos PG. Bourdon Vos test, Handleiding [Bourdon Vos test, Manual] (1998) Lisse, The Netherlands: Swets & Zeitlinger.
- Bernstein JH, Waber DP. Developmental Scoring System for the Rey Osterrieth Complex Figure (1996) Odessa: Psychological assessment resources.
- Beery KE. The Beery-Buktenica VMI Developmental Test of Visual-Motor Integration: Administration, Scoring, and Teaching Manual (1997) 4th ed. New Jersey: Modern: curriculum press.
- Achenbach TM. Manual for the Child Behavior Checklist/4–18 and 1991 Profile (1991) Burlington: University of Vermont, Department of Psychiatry.
- Verhulst FC, Van der Ende J, Koot HM. Handleiding voor de CBCL/4–18 [Manual for the CBCL/4–18] (1996) Rotterdam, The Netherlands: Afdeling kinder-en jeugdpsychiatrie, Sophia Kinderziekenhuis/Academisch ziekenhuis Rotterdam/Erasmus universiteit Rotterdam.
- Verhulst FC, Van der Ende J, Koot HM. Handleiding voor de Teacher's Report Form (TRF) [Manual for the Teacher's Report Form (TRF)] (1997) Rotterdam, The Netherlands: Afdeling kinder-en jeugdpsychiatrie, Sophia Kinderziekenhuis/Academisch ziekenhuis Rotterdam/Erasmus universiteit Rotterdam.
- Verhulst FC, Van der Ende J, Koot HM. Handleiding voor de Youth Self-Report (YSR) [Manual for the Youth Self-Report (YSR)] (1997) Rotterdam, The Netherlands: Afdeling kinder-en jeugdpsychiatrie, Sophia Kinderziekenhuis/Academisch ziekenhuis Rotterdam/Erasmus universiteit Rotterdam.
- Lacour-Gayet F. Risk stratification theme for congenital heart surgery. Semin Thorac Cardiovasc Surg Pediatr Card Surg Annu (2002) 5:148–152.[CrossRef][Medline]
- Lewis M, Maruff P, Silbert B. Statistical and conceptual issues in defining post-operative cognitive dysfunction. Neurosci Biobehav Rev (2004) 28:433–440.[CrossRef][Web of Science][Medline]
- Bellinger DC, Jonas RA, Rappaport LA, Wypij D, Wernovsky G, Kuban KCK, Barnes PD, Holmes GL, Hickey PR, Strand RD, Walsh AZ, Helmers SL, Constantinou JE, Carrazana EJ, Mayer JE, Hanley FL, Castaneda AR, Ware JH, Newburger JW. Developmental and neurologic status of children after heart surgery with hypothermic circulatory arrest or low-flow cardiopulmonary bypass. N Engl J Med (1995) 332:549–555.
[Abstract/Free Full Text] - Galli KK, Zimmerman RA, Jarvik GP, Wernovsky G, Kuypers MK, Clancy RR, Montenegro LM, Mahle WT, Newman MF, Saunders AM, Nicolson SC, Spray TL, Gaynor JW. Periventricular leukomalacia is common after neonatal cardiac surgery. J Thorac Cardiovasc Surg (2004) 127:692–704.
[Abstract/Free Full Text]
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||