Changes

Line 64: Line 64:  
=== Definitions ===
 
=== Definitions ===
   −
Verification. Verification is a confirmation, through provision of objective evidence, that specified requirements have been fulfilled. This is a one-time process completed to determine or confirm test performance characteristics before the test system is used for patient testing. Verification is a quality assurance process to determine that instruments, software, and associated data are accurate per the manufacturer’s description and specifications, i.e., does the system (hardware, software, probes) function as described by the vendor/manufacturer?
+
'''Verification.''' Verification is a confirmation, through provision of objective evidence, that specified requirements have been fulfilled. This is a one-time process completed to determine or confirm test performance characteristics before the test system is used for patient testing. Verification is a quality assurance process to determine that instruments, software, and associated data are accurate per the manufacturer’s description and specifications, i.e., does the system (hardware, software, probes) function as described by the vendor/manufacturer?
   −
Validation. Validation is a confirmation through the provision of objective evidence that requirements for a specific intended use or application have been fulfilled. Validation is a QC process to determine that the data from test samples are accurate for the intended use when compared with a validated method, i.e., does the system (processes) provide the correct (accurate, reproducible) result(s) when test samples or test data are analyzed?
+
'''Validation.''' Validation is a confirmation through the provision of objective evidence that requirements for a specific intended use or application have been fulfilled. Validation is a QC process to determine that the data from test samples are accurate for the intended use when compared with a validated method, i.e., does the system (processes) provide the correct (accurate, reproducible) result(s) when test samples or test data are analyzed?
Platform
+
 
 +
'''Platform'''
    
Initiation of microarray technologies requires the laboratory verify that the instrumentation, software, and probes perform as specified by the vendor. All platforms intended for clinical testing must be verified and validated. The method and scope of the verification and validation must be documented. A new platform is defined as any new methodology or microarray type introduced into the laboratory. A single microarray vendor may produce multiple similar platforms, but each must be assessed independently. A new version is defined as a minor modification to probe coverage, either through manufacturing of the microarray or by in silico probe filtering.
 
Initiation of microarray technologies requires the laboratory verify that the instrumentation, software, and probes perform as specified by the vendor. All platforms intended for clinical testing must be verified and validated. The method and scope of the verification and validation must be documented. A new platform is defined as any new methodology or microarray type introduced into the laboratory. A single microarray vendor may produce multiple similar platforms, but each must be assessed independently. A new version is defined as a minor modification to probe coverage, either through manufacturing of the microarray or by in silico probe filtering.
Laboratory with little or no experience with microarray technologies
+
 
 +
'''Laboratory with little or no experience with microarray technologies'''
    
The laboratory with little or no experience with microarray technology should become familiar with all aspects of the new technology through the verification process, consultation with vendor support, and if possible, other laboratories with demonstrated proficiency using the same platform before beginning the validation process. Familiarization includes understanding the processes, features, and capabilities of the technology selected. The laboratory should gain experience with the instrumentation, platform design, software, reagents, methodologies, technological limitations, workflows, and DNA quality parameters by experimental sample runs. Similarly, the laboratory should become familiar with the features of each sample type the laboratory will process.
 
The laboratory with little or no experience with microarray technology should become familiar with all aspects of the new technology through the verification process, consultation with vendor support, and if possible, other laboratories with demonstrated proficiency using the same platform before beginning the validation process. Familiarization includes understanding the processes, features, and capabilities of the technology selected. The laboratory should gain experience with the instrumentation, platform design, software, reagents, methodologies, technological limitations, workflows, and DNA quality parameters by experimental sample runs. Similarly, the laboratory should become familiar with the features of each sample type the laboratory will process.
Line 79: Line 81:     
The laboratory should demonstrate expertise in technical aspects of the processing of sample types to be used for clinical testing, technical performance of the microarray, reproducibility of results, and data analysis and interpretation. Expertise should be documented for each microarray platform used for clinical testing, regardless of whether the laboratory has prior experience with a different platform.
 
The laboratory should demonstrate expertise in technical aspects of the processing of sample types to be used for clinical testing, technical performance of the microarray, reproducibility of results, and data analysis and interpretation. Expertise should be documented for each microarray platform used for clinical testing, regardless of whether the laboratory has prior experience with a different platform.
New platform
+
 
 +
'''New platform'''
    
A minimum of 30 samples should be processed and interpreted by the laboratory to verify and validate any new platform. This includes changing to a platform of the same type from a different manufacturer or a different platform type, e.g., array comparative genomic hybridization to SNP. Samples with known abnormalities should be used to gain expertise with the new methodology and assess performance.
 
A minimum of 30 samples should be processed and interpreted by the laboratory to verify and validate any new platform. This includes changing to a platform of the same type from a different manufacturer or a different platform type, e.g., array comparative genomic hybridization to SNP. Samples with known abnormalities should be used to gain expertise with the new methodology and assess performance.
New/different version of an established platform
+
 
 +
'''New/different version of an established platform'''
    
Analysis of a minimum of five known abnormal samples should be run on a new platform version. Data from a new version should be compared with data from the established version to determine if the platform and software perform as expected to detect known CNVs. New probe additions for enhanced coverage or improved performance should be investigated with samples known to have variation in the region of new content (when possible).
 
Analysis of a minimum of five known abnormal samples should be run on a new platform version. Data from a new version should be compared with data from the established version to determine if the platform and software perform as expected to detect known CNVs. New probe additions for enhanced coverage or improved performance should be investigated with samples known to have variation in the region of new content (when possible).
    
New versions of established platforms will vary with the manufacturer and platform type. A manufacturer may define minor upgrades as new versions. There are no definitive criteria for a new version; however, a different version should be limited to minimal probe changes, e.g., removal and/or replacement of probes to improve performance and/or coverage over a limited number of genomic regions. These types of changes to an established platform are likely to be rare, with most changes of platforms requiring a full validation.
 
New versions of established platforms will vary with the manufacturer and platform type. A manufacturer may define minor upgrades as new versions. There are no definitive criteria for a new version; however, a different version should be limited to minimal probe changes, e.g., removal and/or replacement of probes to improve performance and/or coverage over a limited number of genomic regions. These types of changes to an established platform are likely to be rare, with most changes of platforms requiring a full validation.
Validation of a new clinical test or assay
+
 
 +
'''Validation of a new clinical test or assay'''
    
Any assay intended for clinical diagnosis must be verified and validated before offering as a clinical test. Proficiency in test performance, analysis, and interpretation must be demonstrated.
 
Any assay intended for clinical diagnosis must be verified and validated before offering as a clinical test. Proficiency in test performance, analysis, and interpretation must be demonstrated.
Line 100: Line 105:     
Exchanging samples with another laboratory conducting similar assays in a blind, split-sample comparison using both normal and abnormal samples and comparing results at the appropriate detection levels declared by the laboratories can provide valuable feedback during the validation process. After the validation period, sample sharing can be used for external proficiency testing (PT). All validation data for each disease and sample type, including discordant results and limitations, should be documented.
 
Exchanging samples with another laboratory conducting similar assays in a blind, split-sample comparison using both normal and abnormal samples and comparing results at the appropriate detection levels declared by the laboratories can provide valuable feedback during the validation process. After the validation period, sample sharing can be used for external proficiency testing (PT). All validation data for each disease and sample type, including discordant results and limitations, should be documented.
Clonality detection and limits
+
 
 +
'''Clonality detection and limits'''
    
Samples from neoplastic disorders can be expected to have varying amounts of nonneoplastic cells admixed with neoplastic cells. The proportion of clonal and nonclonal cells may or may not be clinically relevant but will affect assay sensitivity. Detectable clonality can be influenced by several factors including microarray platform used, sample source, DNA quality, size and copy-number state of the abnormality, and probe coverage. Noise from poor-quality DNA may mask clonality. Each laboratory will need to challenge their microarray with mosaic, aneuploid, and clonally diverse samples to gain experience in their detection. The various factors should be considered with data analysis.
 
Samples from neoplastic disorders can be expected to have varying amounts of nonneoplastic cells admixed with neoplastic cells. The proportion of clonal and nonclonal cells may or may not be clinically relevant but will affect assay sensitivity. Detectable clonality can be influenced by several factors including microarray platform used, sample source, DNA quality, size and copy-number state of the abnormality, and probe coverage. Noise from poor-quality DNA may mask clonality. Each laboratory will need to challenge their microarray with mosaic, aneuploid, and clonally diverse samples to gain experience in their detection. The various factors should be considered with data analysis.
    
Visual inspection and manual review of the data should be employed to detect clonality and gain experience with data interpretation. The software may not flag low-level clonality. A call made by visual/manual inspection, when the call was not made by the software, should be verified by another method, e.g., interphase FISH, qPCR.
 
Visual inspection and manual review of the data should be employed to detect clonality and gain experience with data interpretation. The software may not flag low-level clonality. A call made by visual/manual inspection, when the call was not made by the software, should be verified by another method, e.g., interphase FISH, qPCR.
Determination of levels of detectable clonality
+
 
 +
'''Determination of levels of detectable clonality'''
    
Methods to evaluate levels of detectable clonality will differ with sample type, e.g., fresh, fixed, or FFPE. Dilution studies are one method that may be used to create different levels of clonality for test purposes.<ref name=Nowak>Nowak NJ, Miecznikowski J, Moore SR, et al. Challenges in array CGH for the analysis of cancer samples. Genet Med 2007;9(9):585–595.</ref> Flow cytometric analysis and interphase FISH analysis of fresh (uncultured) samples provide reliable methods for confirmation of clonality level(s). Conventional cytogenetic analysis of metaphase cells provides information about clonal populations but does not reliably reflect levels of clonality.
 
Methods to evaluate levels of detectable clonality will differ with sample type, e.g., fresh, fixed, or FFPE. Dilution studies are one method that may be used to create different levels of clonality for test purposes.<ref name=Nowak>Nowak NJ, Miecznikowski J, Moore SR, et al. Challenges in array CGH for the analysis of cancer samples. Genet Med 2007;9(9):585–595.</ref> Flow cytometric analysis and interphase FISH analysis of fresh (uncultured) samples provide reliable methods for confirmation of clonality level(s). Conventional cytogenetic analysis of metaphase cells provides information about clonal populations but does not reliably reflect levels of clonality.
Line 112: Line 119:     
Assessment of levels of neoplastic to nonneoplastic cells or sizes of different clonal populations in fresh or fixed (FFPE) tissue samples is more difficult. Dissection of fresh tumor with an inverted microscope can reduce the amount of nonneoplastic tissues. Microdissection of FFPE tumors can enrich the DNA sample for tumor. Estimation of clonality in tumor tissue samples can be useful when analyzing data from these tumor types.<ref name=Slovak></ref><ref name=Nowak></ref>
 
Assessment of levels of neoplastic to nonneoplastic cells or sizes of different clonal populations in fresh or fixed (FFPE) tissue samples is more difficult. Dissection of fresh tumor with an inverted microscope can reduce the amount of nonneoplastic tissues. Microdissection of FFPE tumors can enrich the DNA sample for tumor. Estimation of clonality in tumor tissue samples can be useful when analyzing data from these tumor types.<ref name=Slovak></ref><ref name=Nowak></ref>
Determination of ploidy
+
 
 +
'''Determination of ploidy'''
    
Polyploidy may be detected by microarray analysis but may be difficult to appreciate. The allelic states of SNP probes can assist in determining ploidy levels. The validation process should include samples with varying levels of ploidy to gain experience in analysis and recognition of different ploidies. The manufacturer should provide the method used for normalization. The laboratory must understand the effect that normalization may have on polyploidy detection and subsequent interpretation of gains and losses in the context of polyploidy.
 
Polyploidy may be detected by microarray analysis but may be difficult to appreciate. The allelic states of SNP probes can assist in determining ploidy levels. The validation process should include samples with varying levels of ploidy to gain experience in analysis and recognition of different ploidies. The manufacturer should provide the method used for normalization. The laboratory must understand the effect that normalization may have on polyploidy detection and subsequent interpretation of gains and losses in the context of polyploidy.
Clonal diversity
+
 
 +
'''Clonal diversity'''
    
Clonal diversity, common to neoplastic disorders, should be visible by microarray when the cell populations of different clones reach the threshold for detection. However, determination of the composition of clones or the sequence of progression of clonal evolution will not be possible. Correlation with conventional cytogenetic analysis may facilitate interpretation of the microarray results.
 
Clonal diversity, common to neoplastic disorders, should be visible by microarray when the cell populations of different clones reach the threshold for detection. However, determination of the composition of clones or the sequence of progression of clonal evolution will not be possible. Correlation with conventional cytogenetic analysis may facilitate interpretation of the microarray results.
Software experience and evaluation
+
 
 +
'''Software experience and evaluation'''
    
Software may not be specifically designed for analysis of cancer specimens. Laboratories may choose to design their own software programs or modify parameters of the platform’s standard software program. The laboratory should recognize software limitations and the need for manual and visual inspection of the data for aberration and clonality detection.
 
Software may not be specifically designed for analysis of cancer specimens. Laboratories may choose to design their own software programs or modify parameters of the platform’s standard software program. The laboratory should recognize software limitations and the need for manual and visual inspection of the data for aberration and clonality detection.