2.8.1. Reproductive and Genetic Toxicity
ADMET Predictor provides a model for general reproductive toxicity (Repro_Tox) as well as two different kinds of genotoxicity endpoints: generation of chromosomal aberrations (Chrom_Aberr) in cultured mammalian cells and mutagenicity against five bacterial mutations assayed with (MUT_mxxx) and without (MUT_xxx) rat liver S9 fraction activation. The models for endocrine disruption described in the Human Toxicity section of the manual may also be relevant.
Reproductive Toxicity
Reproductive and developmental toxicity are synonymous terms. They relate to anything that disturbs the reproductive process of organisms, including adverse effects to sexual organs, behavior, ease of conception, teratogenicity and developmental toxicity to offspring before or after birth. Under the European Union’s REACH (Registration, Evaluation and Authorization of Chemicals) legislation, screening tests for reproductive and developmental toxicity (OECD TGs 421 or 422) are required for substances produced or imported in quantities between 10 and 100 tons per year. Other tests are usually required for substances produced or imported in quantities greater than or equal to 100 tons per year.
Data for our Repro_Tox model was taken from the FDA/TERIS database (Ghanooni 1997) and augmented with data obtained from the literature (Arena 2004). The database was constructed by researchers for the Department of Environmental and Occupational Health at the University of Pittsburg (Sussman 2003) and it combines subsets of information from the Teratogen Information System (TERIS) (Briggs 1990) guidelines set forth by the Food and Drug Administration (FDA) (Shepard 1992). Structures were available for 292 of the 293 compounds of which 114 were considered to be toxic. The model achieves an overall concordance of 82%.
|
Model |
Set |
Negatives |
Positives |
Total |
Correct |
Concordance |
Sensitivity |
Specificity |
|---|---|---|---|---|---|---|---|---|
|
Repro_Tox |
Training |
148 |
100 |
248 |
205 |
82.7% |
82.0% |
83.1% |
|
Test |
30 |
14 |
44 |
36 |
81.8% |
85.7% |
80.0% |
Chromosomal aberrations
Another aspect of genotoxicity is the potential for producing chromosomal aberrations, and testing for such an effect is also used for the assessment of the genotoxic potential of chemicals and drugs that "pass" the Ames test. Just as for the Ames test, compounds are examined with and without a mammalian metabolic activation system containing liver microsomes to see if they induce structural chromosome aberrations in cultured cells. Anticipating the outcome of the chromosomal aberration test from chemical structure may save considerable time and money during drug discovery and development.
ADMET Predictor's Chrom_Aberr ANNE model predicts whether chemicals or drugs will cause chromosome aberration from their 2D structures. Test results for 1,388 compounds were collected from the literature, yielding roughly the same number of positive ("Toxic") and negative ("Nontoxic") examples. We used 1,159 compounds for the training pool and 229 compounds for external testing. Overall, the model’s prediction accuracy is about 80%.
|
Model |
Set |
Negatives |
Positives |
Total |
Correct |
Concordance |
Sensitivity |
Specificity |
|---|---|---|---|---|---|---|---|---|
|
Chrom_Aberr |
Training |
540 |
619 |
1159 |
951 |
82.1% |
82.6% |
81.5% |
|
Test |
104 |
125 |
229 |
186 |
81.2% |
82.4% |
79.8% |
Bacterial mutagenicity
The bacterial mutagenicity panel features a series of MUT_*** models that predict mutagenicity with or without metabolic activation of the test compound. The endpoints they model assess the ability of compounds to promote reversion in a panel of bacterial strains mutated in particular amino acid synthesis pathways (Ames 1975). The original "Ames test" relied only on Salmonella typhimurium mutants, but it has since been expanded by the addition of Escherichia coli repair-deficient strains that bear the same mutations. Such tests are now the primary screen for genotoxicity, having replaced chronic testing in rodents that took longer and cost more.
The Division of Genetics and Mutagenesis, National Institute of Health Sciences of Japan (DGM/NIHS) recently established a unique proprietary Ames database consisting of 13,729 new chemical substances that have not been previously used for developing QSAR models. These chemicals have been classified into three classes: Strongly Positive (Class A), Positive (Class B) and Negative (Class C). (Honma 2019)
The DGM/NIHS made this Ames data available to Simulations Plus and some other software companies for the purpose of building predictive QSAR models. We chose to merge Class A and Class B into a single positive class. The curated data set included 13,141 compounds. It is very imbalanced, with over 11,000 negatives and about 1,800 positives. This model exhibited 76% accuracy in prediction with a test set sensitivity of 78.0% and a test set specificity around 76%.
Dataset provided by DGM/NIHS included around 1500 compounds with experimental mutagenicity against ten different strains. These compounds were appended to our in-house collection of individual strains datasets. All the ten individual strain models were rebuilt. The models present in AMES mutagenicity models in ADMET Predictor 10.4 incorporate this newer data with larger chemical space.
The eleven in silico Ames ANNE models in ADMET Predictor classify compounds as "Positive" (mutagenic) or "Negative" (nonmutagenic). Most model tests are carried out in S. typhimurium strains designated TA98, TA100, etc. The "TA" has been omitted from the model names for brevity. Assay results on strains TA1537 and TA97 are considered interchangeable, as are results for TA102 and repair-deficient E. coli strains WP2. The former are indicated by "97+1537" in the model name and the latter by "102+wp2." A prefix of "m" indicates that the assay included metabolic activation by microsomal (S9) fractions.
Test set sensitivities for the ten models based on older data sets range from 71 to 80%, with an average of 74%. Test set specificities range from 79 to 89%, with an average of 83% (for remaining ten models).
|
Model |
Dataset |
Positives |
Negatives |
Total |
Correct |
Concordance |
Sensitivity |
Specificity |
|---|---|---|---|---|---|---|---|---|
|
98 |
Training |
995 |
2945 |
3940 |
3271 |
83.0% |
72.4% |
86.6% |
|
Test |
250 |
736 |
986 |
817 |
82.9% |
70.8% |
87.0% |
|
|
M98 |
Training |
1143 |
2541 |
3684 |
2992 |
81.2% |
73.8% |
84.5% |
|
Test |
286 |
636 |
922 |
732 |
79.4% |
74.5% |
81.6% |
|
|
100 |
Training |
1224 |
2836 |
4060 |
3295 |
81.2% |
74.3% |
84.1% |
|
Test |
306 |
710 |
1016 |
799 |
78.6% |
71.9% |
81.5% |
|
|
M100 |
Training |
1392 |
2338 |
3730 |
2965 |
79.5% |
76.1% |
81.5% |
|
Test |
348 |
584 |
932 |
733 |
78.6% |
74.7% |
81.0% |
|
|
97+1537 |
Training |
456 |
2493 |
2949 |
2503 |
84.9% |
74.1% |
86.8% |
|
Test |
114 |
624 |
738 |
630 |
85.4% |
71.9% |
87.8% |
|
|
M97+1537 |
Training |
434 |
2396 |
2830 |
2321 |
82.0% |
79.5% |
82.5% |
|
Test |
108 |
600 |
708 |
581 |
82.1% |
77.8% |
82.8% |
|
|
1535 |
Training |
512 |
2288 |
2800 |
2343 |
83.7% |
78.1% |
84.9% |
|
Test |
129 |
572 |
701 |
574 |
81.9% |
78.3% |
82.7% |
|
|
M1535 |
Training |
572 |
2103 |
2675 |
2221 |
83.0% |
73.8% |
85.5% |
|
Test |
143 |
526 |
669 |
546 |
81.6% |
72.7% |
84.0% |
|
|
102+wp2 |
Training |
444 |
1380 |
1824 |
1514 |
83.0% |
73.9% |
85.9% |
|
Test |
111 |
345 |
456 |
370 |
81.1% |
73.9% |
83.5% |
|
|
M102+wp2 |
Training |
419 |
1279 |
1698 |
1336 |
78.7% |
71.6% |
81.0% |
|
Test |
105 |
320 |
425 |
337 |
79.3% |
71.4% |
81.9% |
|
|
NIHS |
Training |
1443 |
9069 |
10512 |
8125 |
77.5% |
73.0% |
78.2% |
|
Test |
361 |
2268 |
2629 |
2039 |
77.7% |
73.1% |
78.4% |
In a regulatory context, a compound "fails" the Ames test if a positive result is obtained for any strain, and the overall reproducibility of the test is 85% or less (Hansen 2009). The models and their errors are not mutually independent, however, so classifying a compound as "Ames positive" because it returns a positive for one of the mutagenicity models is not necessarily the best way to combine their predictions.
Instead, we provide a MUT_Risk model that yields a qualitative estimate of overall mutagenicity by combining individual positive predictions. By default, each individual “Mutagenic” prediction contributes 0.6 “vote” to the score, with the exception of TA98 and TA100. Results for this pair of tests overlap mechanistically (Mortelmans 2000), and so each rule for those strains gets vote of 0.3.
S_97: MUT_97+1537 = Positive
m_97: MUT_m97+1537 = Positive AND NOT MUT_97+1537 = Positive
S_98: MUT_98 = Positive
m_98: MUT_m98 = Positive AND NOT MUT_98 = Positive
S100: MUT_100 = Positive
m100: MUT_m100 = Positive AND NOT MUT_100 = Positive
S102: MUT_102+wp2 = Positive
m102: MUT_m102+wp2 = Positive AND TOX_MUT_102+wp2 = Positive
S535: MUT_1535 = Positive
m535: MUT_m1535 = Positive AND NOT MUT_1535 = Positive
NIHS: MUT_NIHS = Positive
About 18% of the commercial drugs in the focused subset of the WDI have a MUT_Risk score greater than 1, which is the MUT rule threshold in the default TOX_Risk and ADMET_Risk models. Increasing that threshold to 1.2 would reduce the number of compounds in the WDI subset that violate it to 12%.
MUTx_RISK
Proceedings of an International Workshop on Genotypic Testing were recently published at which one working group assessed the sensitivity and selectivity of the bacterial strains specified in the Organization for Economic Cooperation and Development (OECD) Test Guideline TG471 and recommended several possible modifications to that guideline (Williams 2019). The important outcomes from this discussion were:
-
Of all the mutagens detected by the full TG471 strain panel, 93% were mutagenic in either TA98 or TA100
-
TA100 is derived from TA1535 and it detects more mutagens than TA1535. Testing against TA100 alone would suffice
-
TA97, TA102, and WP2uvrA could be removed from OECD TG471 with little, if any, loss of sensitivity
Based on these findings and other recent literature, we have refined our MUT_RISK model by incorporating interaction rules for the MUT_98, MUT_100 and MUT_1535 models that reflect reported correlations between the TA98, TA100 and TA1535 assay results as well as reducing the contributions made by the models based on data from TA97, TA102+wp2 and TA1537 assays. To do this, we created 19 orthogonal rules by modifying 6 of the 11 existing rules and adding 8 more. The MUTx_Risk rules that resulted can be summarized as follows:
-
The S_97+1537, S102 and NIHS rules remain the same: they are triggered whenever the prediction from the corresponding model (MUT_97+1537, MUT_102+wp2 and MUT_NIHS, respectively) is Positive.
-
The m_97+1537, and m102 rules are also unchanged. They are triggered whenever the corresponding model prediction for the respective strain including S9 activation is Positive but the prediction for the assay run on the same strain but without S9 activation is Negative.
-
The S_98, S100 and S535 Risk Codes are now triggered only when exactly one of the corresponding model predictions is Positive.
-
The m_98 rule is triggered when MUT_m98 is Positive and MUT_98, MUT_m100 and MUT_m1535 are all Negative; the m100 and m535 rules follow the same pattern, which prevents ever counting the same activity twice when it is predicted to be mutagenic with and without S9 activation.
-
The combination rule Sx01 is triggered when both MUT_98 and MUT_100 are Positive but MUT_1535 is Negative; Sx02 is triggered when MUT_98 and MUT_1535 are Positive but MUT_100 is Negative; and Sx03 is triggered when MUT_100 and MUT_1535 are Positive but MUT_98 is Negative.
-
Rule Sx04 is triggered when MUT_98, MUT_100 and MUT_1535 are all Positive.
-
The combination rules mx01, mx02, mx03 and mx04 are constructed analogously to m_98, though the logic involved is rather complex. Please see the MUTx_Risk.ro5 file in the Applications Directory for the details if you are interested.
The MUTx_RISK rule weights were set based on multilinear regression (MLR) analysis of the Ames mutagenicity data set compiled by Hansen et al. (Hansen 2009). The coefficients obtained were re-scaled so as to sum to 4, which yielded a Risk model with better sensitivity and specificity statistics for this data set than those shown by MUT_Risk when a decision threshold of 1.0 was used.
MUTx_Risk also out-performed MUT_Risk on our in-house hand-curated subset of the World Drug Index. Only 12% of the commercial drugs in the focused subset of the WDI have a MUTx_Risk score greater than 1.0, versus the 18% seen with the previous MUT_RISK score. The current MUT rule threshold is 1.0 in the default TOX_Risk and ADMET_Risk models. Increasing that threshold to 1.2 would reduce the number of compounds in the WDI subset that violate it to 8%.