Abstract
After intercourse/insemination, large numbers of sperm are deposited in the female reproductive tract (FRT), triggering a massive recruitment of neutrophils (PMNs) into the FRT, possibly to eliminate excessive sperm via phagocytosis. Some bovine oviductal fluid components (BOFCs) have been shown to regulate in vitro sperm phagocytosis (spermophagy) by PMNs. The modeling approach-based logistic regression (LR) and autoregressive logistic regression (ALR) can be used to predict the behavior of complex biological systems. We, first, compared the LR and ALR models using in vitro data to find which of them provides a better prediction of in vitro spermophagy in bovine. Then, the best model was used to identify and classify the reciprocal effects of BOFCs in regulating spermophagy. The ALR model was calibrated using an iterative procedure with a dynamical search direction. The superoxide production data were used to illustrate the accuracy in validating logit model-based ALR and LR. The ALR model was more accurate than the LR model. Based on in vitro data, the ALR predicted that the regulation of spermophagy by PMNs in bovine oviduct is more sensitive to alpha-1 acid glycoprotein (AGP), PGE2, bovine serum albumin (BSA), and to the combination of AGP or BSA with other BOFCs.
Similar content being viewed by others
Introduction
In addition to sperm transportation and distribution, the extension of sperm elimination and sperm biology within the female reproductive tract (FRT) play a critical role in fertility or sub-fertility and eventually in reproductive success in mammals i.e. bovines1, 2. Indeed, after intercourse or insemination, millions or billions of sperm are deposited either in the anterior vagina (primates, ruminants), the cervix (most mammalian species) or in the uterus (pig, horse)3,4,5. However, a limited number (hundreds to thousands) reaches the bovine oviduct as the fertilisation site6, 7. Actually, it has been shown that polymorphonuclear neutrophils (PMNs) exist in the bovine oviductal flushes8 and massive recruitment of PMNs into the FRT occurs after insemination9,10,11. Since spermatozoa are able to activate neutrophils12, it seems that sperm can be eliminated from the FRT through phagocytosis by PMNs. It has been shown that in humans13, cats14, and mice15 the remained/post-fertilization sperm cells in the oviduct are phagocytosed by isthmic epithelial cells and leukocytes15, 16. Indeed, post-capacitated sperm cells which lost their fertilizability have been shown to induce migration of leukocytes into the FRT, undergo phagocytosis and, thereby, are eliminated from the FRT16. This implies that phagocytosis of sperm by epithelial cells or PMNs, as a part of normal physiology of the female body, acts not to intervene in the fecundity. This also suggests that there may be some cross talks between fertilizing sperm and phagocytosing cells such that the dead sperm or remained sperm after fertilization may be losing these cross-talks. For example, in comparison with live sperm cells, dead or abnormal sperm cells failed to induce prostaglandin (PG) system including PGES and COX-2 expression and PGE2 secretion by BOECs17. However, little is done to reveal what factors in the FRT contribute in establishing such cross-talks. Our group has tried to reveal the possible role of physiological factors i.e. sperm or hormones, in establishing such cross-talks between bovine oviductal fluid components (BOFCs), sperm, and phagocytosing cells. Of importance, we have reported that binding of live sperm to bovine oviductal epithelial cells induces PGE2 secretion which, in turn, reduces bovine spermophagy by PMN8, 17 and also skews the local innate immunity toward an anti-inflammatory microenvironment18. In addition, spermophagy has been also shown to be regulated by bovine oviduct epithelial culture medium and by individual BOFCs like endothelin-1 (EDN-1), PGE2, angiotensin II (ANGII), and alpha 1-acid glycoprotein (AGP)8, 19,20,21.
It is of importance to accurately identify and classify the key and most influencing BOFCs involving in spermophagy by PMNs using the present experimental data. Moreover, the prediction of interactions among BOFCs can be used not only to predict and design future experiments without doing the additional expensive tests but also to gain further understanding and prediction of possible interaction between factors involving in reproductive physiology of bovine oviduct. No previous studies have applied computational modeling to confirm or classify the present in vitro data or to predict the reciprocal effects of BOFCs in regulating spermophagy by PMNs. Various models and methods, such as logistic regression22,23,24,25, support vector machine (SVM)25, and tree model26 can be used to detect complex patterns within data sets. Dose-response models include a range of statistical models such as nonlinear regression, generalized (non) linear regression, and parametric survival analysis27. Also, the experiments are showing the dose-dependent regulation of spermophagy by BOFCs8, 19,20,21; thus, the logistic function can be used to predict spermophagy on the basis of dose-response data27. Therefore, we hypothesized that an autoregressive logistic regression (ALR) model may prove to be a more powerful method for identifying and classifying the BOFCs, alone or in combination with each other, in regulating spermophagy by PMNs in cattle. A multi- study analysis was designed to construct an effective predictive model for spermophagy with high sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).
In this study, the predictive performance of the parametric model (LR) was compared with that of a model constructed using the ALR model. We, therefore, examined which model, the LR model or the ALR model, predicts in vitro spermophagy more efficiently and also tried to identify and classify that which of BOFCs, alone or in combination together, shows greater impact on in vitro spermophagy by PMNs in bovines.
Results
This section consists of three applications as: 1) comparison of the logit regression (LR) and autoregressive logit regression (ALR) using several comparative error statistics to establish the better model for an accurate prediction and classification; 2) confirmation and classification of the effect of each of BOFCs on reducing spermophagy using the best logit model observed in application 1; and 3) analysis of the reciprocal effects of BOFCs in regulating spermophagy by PMNs in bovines using ALR model.
Comparative prediction of the LR and ALR models for in vitro spermophagy by PMNs in cattle
As shown in Table 1, the value of the penalty coefficient set to 1.75 results in the reduction of errors and Akaike Information criteria, AIC, and the best EF level in the ALR model. Thus, the best logistic function among the various logit models are obtained based on the penalty factor λ = 1.75. The ALR model transformation relation is given as:
Based on the LR model, the logistic map function is computed as:
where, BS: BSA-1 (µg/ml), LH (ng/ml), BO: BOEC (0 or 1), AN: ANGII (ng/ml), P2: PGE2 (ng/ml), AG: AGP (ng/ml), and ED: EDN-1 (ng/ml). Also, the comparative statistics are obtained for LR model as RMSE = 0.0926, MAE = 0.0719, EF = 0.532, AIC = −122.032, and d = 0.7479.
The scatter plots of the predictions-based LR (in equation 2) or ALR (in equation 1) and experiments are shown in Fig. 1, (for 58 training data points from Table 2, since the entering values were unavailable, we input end-experimental values for making scatter plots). Regarding Fig. 1, and equation (1), the ALR model estimates fit the spermophagy data remarkably well. Scatter plots show the linear correlations for the LR model as R2 = 0.62 and the ALR model as R2 = 0.83, thus better predictions can be given the actual spermophagy data based on ALR model (around 33% improvement in correlation). This means that the ALR model has evaluated appropriate coefficients, based on the best penalty term (see Table 1), for the input variables (equation 1).
Scatterplots of the observed versus predicted data of spermophagy using the LR model (a) or the ALR model (b) for training data set. The training data consisted of 71.8% of the data, 58 data. Since the entering values were unavailable, we input end-experimental values for making scatter plots. Indeed, each end point data was the mean of individual experiment repeated for 3–8 times. SP, spermophagy.
Equations 1 and 2 indicate that, respectively, BSA, AGP, PGE2, BOEC, LH, and EDN-1 show higher effects in the ALR model compared with the LR model. In addition, the negative effect of ANGII on reduction of spermophagy is highlighted better in the ALR model compare with the LR model. This might imply that the ALR model may overestimate these coefficients. But, regarding the lower relative error (Table 1) and the better prediction of scatterpoints (Fig. 1) obtained by the ALR model compared with the LR model, the estimate of these coefficients should be more accurate using the ALR model.
To validate our used models, the accuracy of the predicted spermophagy, using the logit models -based LR and ALR, was compared with the actual data (superoxide production data) (Table 3). The ALR model showed lower under-/over-prediction compared with the LR model (11.6 vs 18.9%; 10.2 vs 12.3%, respectively). These findings indicate that, on the basis of super oxide production data, the ALR model predicted spermophagy more efficiently than the LR model. The statistical errors for validation data based on the prediction of the logistic functions using the ALR and LR model are listed in Table 4. In comparison to the LR model, the ALR decreased the RMSE and AIC about 36% and 89%, repeatedly while improved the EF and Willmott’s index of agreement (d) about 30% and 19%, respectively. The relative mean error of the ALR model is obtained about 2 times less than the LR model. Thus, it can be concluded that the ALR improves the accuracy of the prediction of the logistic function and may be used to predict bovine oviductal spermophagy by PMNs in vitro.
Based on Eq. (14), The AICs 28 for two models with and without END-1 are computed using autoregressive logistic regression as −130.457 and −129.792, respectively (Table 1). It can be obtained ΔAIC = 0.97 which is less than chi-square statistics with k = 1 and P = 0.05 i.e. 1.84, thus hypothesis β 8 = 0 is accepted29. Thus, using Akaike indicator, END-1 has been shown a non-significant affect on spermophagy compared with the other input variables. Thus, this input variable can be removed from the logit model in the next investigations.
Calculation of marginal effects to reveal effects of BOFCs on in vitro spermophagy by PMNs in cattle
To see how change in spermophagy is related to changes in the input variables, marginal effects are computed (Fig. 2). Indeed, in the dose-dependent experiments, which were selected in the present study, the concentration of variables had been increased at the 10-fold intervals. So, the marginal effects were computed to reveal the instantaneous rate of change in smaller intervals (one tenth-fold intervals, 2 is considered as the maximum concentration of each variable that was used in the actual experiments). The results confirmed the dose-dependent reduction of spermophagy by BOFCs (except BSA) based on the predictions of the ALR model. Also, the marginal effects showed that BOFCs seem to be effective in reducing spermophagy at levels above concentrations used in actual in vitro experiments. However, when we computed slopes and marginal effects of BOFCs, as shown in Fig. 2, the marginal effect for BSA showed that BSA reduces spermophagy stronger. But, its slope line graph is not as similar as other factors and shows slightly a curved shape rather than a straight shape. This means that all BOFCs except BSA show a dose-dependently effect on spermophagy (0.1 to 0.5) while BSA from a given point (1.5 to 2.5) fails to reduce spermophagy. These findings confirmed the data from actual experiment in which PGE2, EDN-1, and AGP had dose-dependently reduced and ANGII had dose-dependently increased spermophagy by PMNs8, 19,20,21.
Prediction of the reciprocal effects of BOFCs on in vitro spermophagy by PMNs in cattle
As mentioned above, among BOFCs, ANGII enhances spermophagy. Therefore, we tried to use the ALR model to predict the reciprocal effects of the BOFCs on the reduction of spermophagy and to reveal that to what extend the BOFCs are able to abrogate ANGII-induced spermophagy. Figure 3 shows both individual and reciprocal effects of BOFCs on percentage of reduction (negative values) or increase (positive values) of sperm phagocytosis compared to the control group. The combination of AGP or BSA with other BOFCs produced an average reduction of 52.5 and 48.5% in spermophagy, respectively, named here as class-1 factors. As class 2, the model predicted that the combination of PGE2 with other factors shows an average reduction of 36.6% in spermophagy. As class 3, the combination of LH or EDN-1 with other factors reproduces an average reduction of 26.8 and 26.6% in spermophagy. Finally, the ALR model used to determine the strongest BOFCs that abrogate the increasing effect of ANGII on spermophagy by PMNs. The ALR model demonstrates that BSA, AGP, PGE2, or LH, respectively, abrogates ANGII-increased spermophagy by PMNs.
Discussion
Many factors may affect fertility in mammals. Indeed, the likelihood of full-term pregnancies in inseminated cows is only 50%30, implying potential large economic losses. Spermatozoa are able to activate neutrophils12, which are able to trigger the phagocytosis of these male gametes and hinder their motility9, 12. Alternatively, many of mammalian sperm are attacked and phagocytosed by leukocytes and epithelial cells in the FRT14,15,16. Isthmic epithelial cells and leukocytes are believed to involve in phagocytosis of surplus/post-capacitated sperm that entered the oviduct and did not contribute in fertilization15, implying a physiological role for spermophagy process in regulating possible sever inflammation that may be resulted from dead/remained post-capacitated sperm15, 16. These suggest that spermophagy can be considered as a positive and even essential event for a normal fertilisation and early embryonic development in oviduct16. On the other hand, it has been shown that freshly capacitated sperm cells dose-dependently (being significant at levels more than 105 sperm/ml), but not dead or abnormal ones, induce PGE2 secretion by bovine oviductal epithelial cells17. Also, PGE2 has been shown to dose-dependently reduce phagocytosis of freshly capacitated sperm by PMNs in bovines8, indicating a cross-talk between number of capacitated sperm cells and oviductal epithelial cells to regulate spermophagy. Alghamdi et al.31 reported that incubation of equine sperm with either seminal plasma or isolated proteins from seminal plasma reduced sperm binding to PMNs and improved fertility. Very recently, Zambrano et al.32 showed that human sperm cells act as a sufficient stimulus to induce the neutrophil extracellular traps (NETs) formation that may result in reduced motility and fertility. However, further studies are still necessary to determine signals produced by post-capacitated/remained post-fertilization or freshly capacitated sperm toward PMNs. The possible responses to these questions might help endangered or threatened species, economic animals and humans32, 33.
Recently, other oviductal fluid components such as EDN-1, ANGII, AGP, and BSA, have been shown to regulate in vitro spermophagy by PMNs in cattle. Importantly, these factors may raise interactions when they release together and influence their own individual responses. Unfortunately, there are still a few studies addressing this issue, more investigations are needed to determine the proportion of each factor or their combinations in regulating bovine spermophagy. Indeed, revealing such issues may help to design next experiments more efficiently, at first. Moreover, knowing the contribution level of each factor in reducing or enhancing spermophagy as well as their combination may, at least in part, help a better understanding of physiological events and the prediction of spermophagy by PMNs, based on in vitro experiments.
Recently, computer-based systems have been used to clinical use for medical diagnosis, decisions, outcome prediction, and even patient care34,35,36. Most experiments in this field are done dose-dependently to reveal responses and such dose-response models include a range of statistical models such as nonlinear regression. We, therefore, investigated the ALR and LR models to determine which of them fits better to the actual dose-dependent data and provide more accurate predictions of individual responses and reciprocal interactions. The autoregressive logistic regression used in the present study allows the analysis and interactions to be performed and modeled easily and quickly on any standard desktop computer in addition to this fact that its statistical theory is very well characterized37. However, as an important disadvantage, this model needs a very large sample size to accurately estimate the parameters when there are many independent variables37. But, our results suggest that the ALR may improve correlation and resultant predictions without using a lot of data; this phenomenon can be explained by the fact that, in this study, the interaction effects are relatively greater than the main effects38.
By comparison, the ALR model showed the highest correlation and lowest errors RMSE and AIC compared to LR for prediction of reducing spermophagy. This means that the ALR model outperforms the LR model in prediction accuracy. Only a few in vitro data were used to predict the spermophagy level under the effect of the oviductal fluid components. However, the results indicated that the ALR model is a suitable model to predict and classify these influencing spermophagy components applied dose dependently in the actual in vitro experiments. With regard to the ALR model, we identified and ranked the oviductal fluid factors associated with spermophagy such that AGP, PGE2, LH, and EDN-1 reduce spermophagy by neutrophils (42, 39, 16, and 6%, respectively) and ANGII increases (23%) as observed in the actual experiments. The calculation of Akaike indicator, AIC, showed that the role of EDN-1 is not significant in the ALR model and subsequently in spermophagy and can be removed from the model. But, EDN-1 is still illustrated in Fig. 3, since we would like to show and classify the role of all bovine oviductal fluid components on spermophagy as much as possible.
Recently, Liu et al.19 showed that AGP concentration was numerically decreased in bovine oviductal flushes during the estrous cycle with the highest level at the pre-ovulatory stage. As mentioned, the ALR model predicted that AGP, individually or in combination with other factors, has the highest impact on spermophagy. They also reported that AGP dose-dependently reduced spermophagy. It seems that the highest AGP concentration at the pre-ovulatory stage might result in a reduced phagocytosis of upcoming sperms. Possibly, reduction of AGP concentration after ovulation may lead to enhance spermophagy at this stage. This, in turn, may support the elimination of surplus/remained post-fertilization sperm in bovine oviduct. The other factors like PGE2 dose-dependently reduced spermophagy8. Importantly, PGE2 showed its highest level under LH stimulation, LH surge during the pre-ovulatory stage8, 39. This might imply that high concentrations of AGP, EDN-1 and PGE2 observed during pre-ovulatory stage may involve in reducing phagocytosis of upcoming sperm. On the other hand, when their concentrations are reduced at the post-ovulatory stage, the reducing effect of these factors on spermophagy would be alleviated. This may support the hypothesis of the elimination of remained sperm in providing a timely controlled environment for the early embryo development in cattle.
To examine how changes in the input variables i.e. different doses of BOFCs affect changes in spermophagy, marginal effects were computed which reveal the instantaneous rate of changes in smaller intervals (one tenth-fold intervals compared with10-fold intervals that had been used in in vitro experiments). Based on the ALR model, marginal effects were computed and showed that all BOFCs except BSA showed a dose-dependent effect on spermophagy as their slope lines are straight. In case of BSA, the marginal showed that BSA reduces spermophagy stronger, but its slope line graph is not as similar as other factors and trends a curved shape rather than a straight shape. This means that BSA from a given dose fails to reduce spermophagy and show not a dose-dependent effect. These marginal effects confirmed the in vitro data of actual experiments in which PGE2, EDN-1, and AGP had dose-dependently reduced and ANGII had dose-dependently increased spermophagy by PMNs8, 19,20,21.
The ALR model additionally enables us to classify these factors as well. The ALR model also predicted the reciprocal effect of oviductal fluid components on in vitro spermophagy by PMNs in bovines. It might be proposed that a computer-based predictive model, in this case the ALR model, might be used to facilitate the early identification of cases at a high risk of spermophagy after insemination or intercourse, and to design next experiments more efficiently. Of course, this hypothesis shows a strong limitation that the correlation between serum and oviductal concentrations of selected factors in this study has not been yet addressed. This issue makes the prediction of spermophagy on the basis of serum markers much harder. Also, because of complexity of in vivo models with a lot of interactions, the establishment of in vivo relevant in vitro system is difficult. However, in vitro models have substantially encouraged the understanding of biological mechanisms. Therefore, further in vivo/in vitro studies are required to specify the interactions between spermophagy/survival and oviductal fluid components in bovine or other species and also to evaluate the correlation between in vitro and in vivo models.
Methodology
Data set
The data were obtained from 5 in vitro studies that were conducted in Japan2, 8, 19,20,21. These studies had evaluated the effect of BOFCs on in vitro spermophagy by PMNs.
Two studies used a single dose of bovine serum albumin, BSA, (0.4%, w/v) or luteinizing hormone (LH, 10 ng/ml) and 4 dose-dependent studies used PGE2 (0–352 ng/ml; 97.68 ± 170.28 ng/ml; mean ± standard deviation(SD)), AGP (0–100 ng/ml; 32.2 ± 43.06 ng/ml; mean ± SD), ANGII (0–10 ng/ml; 2.22 ± 4.37 ng/ml; mean ± SD), or EDN-1(0–24.9 ng/ml; 5.53 ± 10.87 mean ± SD). A summary of the ranges of different BOFCs used in above studies is given in Table 2. The concentrations of PGE2, EDN-1, ANGII, and AGP had been measured directly in the bovine oviduct flush and in the BOEC-conditioned media using double-antibody enzyme immunoassays (EIA), as previously described. Generally, EIA was done in the 96 wells ELISA plate (Corning, New York, NY, USA) which coated with 50 µg second antibody (anti rabbit IgG, Seikagaku Co. Tokyo, Japan). For EIA determination, first, 30 µl of standards or samples were incubated with 100 µl of their corresponding polyclonal antibody (1:250,000) at 4 °C for 24 h. Then, samples were decanted and incubated with 100 µl of PGE2-HRP (1:30,000)40 for further 2 h at 4 °C. The values of coefficients of variance within and between assays for PGE2 were 7.3 and 11.4% respectively.
To determine EDN-1and ANGII concentrations in both oviductal flush (17 oviducts from different phases of the estrous cycle, pre-ovulatory, post-ovulatory, and mid luteal phases) and BOEC culture supernatants (12 experiments), freshly isolated oviducts were gently flushed with PBS−/− (0.2 ml/oviduct), and the resultant fluid was collected in a sterile tube. For EDN-1 determination20, a commercial EIA kit (Cayman, Ann Arbor, MI, USA) was conducted according to the manufacture’s protocol. The intra- and inter-assay coefficients of variation for EDN-1 were 7.8% and 10.7%, respectively.
ANG II concentrations were measured using an antibody enzyme immunoassay as reported before41. The intra- and inter- assay coefficients of variation for ANG II were 3.9% and 8.4%, respectively.
AGP concentrations were determined using an ELISA kit (Uscn Life Science, Wuhan, China) according to the manufacturer’s manual. The optical density (OD) was measured at 450 nm using an ELISA reader (Multiskan MS plate reader, Thermo Labsystems, Vantaa, Finland). The values of coefficients of variance within assay and between assays for AGP were 10 and 12% respectively.
The ED50 values of the assays were 260 pg/ml for PGE2, 115 pg/ml for EDN-1, and 150 pg/ml for ANGII. The standard curves ranged from 20–20000 pg/ml for PGE2, 3.9 to 250 pmol/ml for EDN-1, 2.4 to 5000 pg/ml for ANGII, and 15.5 to1000 ng/ml for AGP. The concentration of LH was based on its pre-ovulatory peak in circulation40, 42.
Four out 5 selected studies8, 19,20,21 were carried out at the Field Center of Animal Science and Agriculture of Obihiro University, and blood collection and experiments were done in compliance with the Guidelines for the Care and Use of Agricultural Animals at Obihiro University. Across all mentioned studies, PMNs were isolated from the blood of multiparous Holstein cows during the luteal stage. Collected blood was mixed with PBS−/− and layered with Ficoll-Paque solution (Lymphoprep, Axis Shield, Oslo, Norway), and centrifuged at 1000 g for 30 min at 10 °C. after mixing PMN layer with ammonium chloride lysis buffer (NH4Cl, 155 mM; KHCO3, 3.4 mM; and EDTA, 96.7 mM) for 10 s, the mixture was centrifuged at 500 g for 10 min at 10 °C to isolate PMNs from red blood cells. The 4-h pre-incubated neutrophils (with each of BOFCs) mixed with TL-HEPES and incubated with freshly capacitated sperm and serum in a 96-well untreated polystyrene microtest plate (Thermo Scientific, Roskilde, Denmark) for 60 min with gentle swirling on a test-plate shaker. The final concentrations of PMNs, sperm, and fresh serum were 8 × 106, 4 × 106 cells/ml, and 12% (v/v) respectively. After incubation, to dissociate PMNs agglutination, heparin (40 mg/ml in TL-HEPES) was used to the suspension of PMNs and sperm. Then, by adding 25 µl of 2% (v/v) glutaraldehyde to 75 µl of samples, samples were fixed and then mounted on the glass slides and examined for the percentage of PMNs with phagocytosed sperm (at least, 400 PMNs were counted across different parts of the specimen) that was recorded as phagocytosis rate. In parallel with PMNs preparation, the sperm capacitation was carried out using modified Tyrod’s albumin, lactate, and pyruvate medium (Sp-TALP)43 in a 96-well untreated polystyrene microplate. Briefly, 1-h swim-up sperm was suspended in Sp-TALP supplemented with 10 mg/ml heparin (50 × 106 sperm/ml) and incubated for 4 h. To confirm capacitation, lysophosphatidylcholine (100 mg/ml for 15 min) was used to induce acrosome reaction which, in turn, was determined by a dual staining procedure with Trypan Blue supravital stain and Giemsa44. Frozen semen straws from a single ejaculate were obtained from the highly fertile Holstein bulls of Genetics Hokkaido Association (Hokkaido, Japan). Importantly, it should be mentioned that heparin that is commonly used to induce sperm capacitation has been shown to reduce phagocytotic and chemotactic activities of PMNs against sperm2. Li and Funahashi2 reported that 100 µg/ml heparin is enough to reduce spermophagy. In the present study, other in vitro studies, except Li and Funahashi study, that had been selected, did not exclude this effect of heparin in their experiments8, 19,20,21. However, in these studies8, 19,20,21, only 10 µg/ml of heparin was used for sperm capacitation.
Finally, the authors of mentioned studies repeated in vitro experiments three to eight times, analyzed the data using Stat-View 5.0 (SAS Institute, Inc., Cary, NC, USA), one-way ANOVA followed by multiple comparison tests (Fisher’s test for three groups, and Bonferroni’s test for more than three groups), and reported results as mean ± SEM. Since the original data were not available, we had to use mean values of each experiment, end-experimental data, instead of entering values.
Logistic regression (LR) model
The logit modeling is commonly implemented to calibrate an event in which the logistic function i.e. pi is used to predict by the following its expected outcome formula45, 46:
where, β is the vector of the unknown coefficients, X is the input variables vector, yi is the observed spermophagy and exp is the exponential function. The mean effort in the logistic regression (LR) is to determine the unknown coefficients based on the effect of BOFCs on spermophagy by PMNs. The logistic transformation is used to simple calibration in logit model as follows:
where, ln is logarithmic function, p the probability distribution of logistic function, and β 0 − β 8 are the regressed coefficients of logit model, where these coefficients are determined based on the training data form Table 2 using the MATLAB software (Version 7.10.0; The MathWorks Inc., Natick, Massachusetts, USA, 2010)47.
Autoregressive logistic regression (ALR) model
The accurate predictions of the mathematical models-based LR or ALR are more important issues to analyze and classify factors regulating spermophagy. The LR is simpler than the ALR model but it may provide inaccurate predictions. The LR model provides error terms with the mean of zero and each input variable is also considered with a same influence in the modeling approach-based logistic function in equation (3). Consequently, the LR model may produce an inappropriate estimation of spermophagy. Since, the effects of each input variables such as ANGII, EDN-1, PGE2, LH, and BSA are considered with a same weight. This means that each data and variables have a similar importance in regression process. Therefore, the heterogeneity in the input variables is effectively increased in the logit model-based LR. On the other hand, the ALR model is calibrated based on a nonlinear regression procedure that may produce an accurate prediction in order to use an autoregressive term in the logit model to consider the effective input variables for predicting the regulating spermophagy. Thus, an iterative formula is proposed for calibration of the ALR model based on a dynamic search direction to achieve the stabilization of the calibrated coefficients of the model. So, the ALR model seems to be an effective modeling to predict spermophagy based on the different capacity of BOFCs (input variable) in regulating spermophagy by PMNs.
The maximum likelihood estimator is defined to approximate the unknown coefficients using the ALR as follows46:
In which, n is the number of data point, pi is the logistic function at i th input data points (X i) and coefficient vector β. \(\lambda {\Vert {\boldsymbol{\beta }}\Vert }^{2}\) is a penalty term, which is added to obtain a better generalization. A flexible model using ALR in equation (5) can be provided based on the influence of each input variable by the penalty term in terms of each unknown coefficient (in the LR model, λ is zero). Indeed, penalty term should be minimized that this, in turn, maximizes the likelihood of prediction, based on the minimum length of the vector in the equation (5) that should be maximized.
Considering that BOFCs have various effects on the phagocytic activity of PMNs, some reduce phagocytosis to a greater extent and some reduce that to a lesser extent, and the modeling approach using the LR model is very simple giving same size to all input variables, a model is needed to overcome this problem. As shown in equation (5), the calibration data using the ALR model are to develop and iterative procedure to estimate the unknown coefficients of logit model in equation (4) i.e. f(βX). Indeed, ALR model considers various input variables with different degrees of effect. Thus, to minimize the penalty term, the ALR model gives a greater or smaller coefficient to variables regarding their higher or lower impacts on spermophagy, respectively.
The iterative method using steepest descent search direction can be used to determine the unknown coefficients of the ALR model as follows:
where, β k+1 and β k are the new and pervious coefficient vector, α k is the step size at each iteration. ∇M(β k ) is the gradient vector of the maximum likelihood function at the coefficient vector β k , which is determined based on the equation (5) as follows:
Based on the coefficient β k , we can be obtained a real value for the gradient vector in terms of each coefficient. The above iterative formula depends on the step size, which is dynamically adjusted as follows:
In which, α 0 = α 1 = 1 and δ k is the adaptive coefficient, which dynamically adjusts the step size at each iteration, as follows:
It can be concluded from the equation (8) that α k+1 ≤ α k thus in k → ∞, α k ≈ 0. This means that a stable result is obtained using the proposed iterative formula to determine unknown coefficients, thus it captured a fixed coefficient for this logit model-based ALR in equation (5) i.e. β k+1 ≈ β k when k → ∞ because α k ≈ 0. The proposed search direction with the dynamic step size in equation (8) is simply formulated and we can be coded based on the below steps in a computer program.
Step1: Set k = 0, α 0 = α 1 = 1, stopping criterion of ε = 10−5, and initial coefficient of β 0 = 1
Step 2: Compute the gradient vector of the maximum likelihood estimator at coefficient β k i.e. ∇M(β k ) based on equation (7)
Step 3: Determine the new coefficients in terms of equation (6)
Step 4: For k > 1, determine the adaptive coefficient using equation (9)
Step 5: For k > 1, compute the new step size based on the equation (8)
Step 6: Check the convergence as \(\Vert {{\boldsymbol{\beta }}}_{k+1}-{{\boldsymbol{\beta }}}_{k}\Vert < \varepsilon \), if satisfies, then given β k+1 and stop, else, Set k = k + 1 and go to Step 2.
The iterative formula to determine the unknown coefficients is used for calibrating the logistic function using ALR to predict spermophagy using input variables.
Comparative criteria
The spermophagy-related data are transformed as \(R{P}_{i}=0.2+\frac{1.4-SPi}{2}\) in which RP i is mapping spermophagy and SPi is reducing spermophagy for i th data. This mapping can show the positive effects of BOFCs on the reduction of phagocytosis using a new data interval 0 to 1. The logit models-based NLR for different penalty factor λ are regressed using the proposed iterative formula to calibrate the unknown coefficients. Then, their predictions of spermophagy are compared by the following comparative error statistics48:
In which, RMSE is the root mean square errors, MAE is mean absolute errors, NSE is the Nash-Sutcliffe efficiency, d is the Willmott’s index of agreement, and AIC is Akaike Information criteria (AIC)28. RMSE and MAE show the average difference between predicted ( pi ) and observed spermophagy ( yi ).The lower values for RMSE, MAE and ACI indicate a better fitness. \(\bar{y}\) and \(\bar{p}\) are the mean (average) of the observed and predicted data, respectively. Both NSE and d show the correlation between the predicted and observed data. The larger value for the agreement index indicates a better agreement for prediction so that d=0 indicates null agreement (no correlation) and d=1 indicates total agreement (perfect fit).
AIC is an alternative criterion to select proper input variables, considering the importance of variable instead of influence effects on the models. The AIC was computed for logit model based on the maximum likelihood value at the coefficient vector β * = {β 1, β 2, …, β i ,…, β m } in which, m is number of the coefficients (eight coefficients in this study). The null hypothesis of a variable (x i ) as β i = 0 with the maximum likelihood value at the coefficient vector \({\hat{{\boldsymbol{\beta }}}}^{\ast }=\{{\beta }_{1},{\beta }_{2},\mathrm{...},{\beta }_{m}\}\) can be tested using P-values and AIC by Murtaugh’s relation as follows29:
where, P is the P-value for null hypothesis β i = 0 which indicates to remove variable x i (e.g. END-1) from the logit model and k is the number of coefficient for the variable x i in logit model that it is 1 and \({\chi }_{k}^{2}\) is chi-square distribution function with k degrees of freedom which is obtained 1.84 for k = 1 and P = 0.0529. ΔAIC is explained as the changes in Akaike’s information criterion based on the all input variables and null variable x i . If ΔAIC is less than the chi-square statistics (e.g. 1.84 for k = 1 and P = 0.05) then the variable x i can be removed from the modeling input data set.
References
Kölle, S. Transport, distribution and elimination of mammalian sperm following natural mating and insemination. Reprod. Dom. Anim. 50, 2–6 (2015).
Li, J. C. & Funahashi, H. Effect of blood serum, caffeine and heparin on in vitro phagocytosis of frozen-thawed bull sperm by neutrophils derived from the peripheral blood of cows. Theriogenology 74, 691–698 (2010).
Lopez-Gatius, F. Site of semen deposition in cattle: a review. Theriogenology 53, 1407–1414 (2000).
Suarez, S. S. Interactions of spermatozoa with the female reproductive tract: inspiration for assisted reproduction. Reprod. Fertil. Dev. 19, 103–110 (2007).
Vishwanath, R. Artificial insemination: the state of the art. Theriogenology 59, 571–584 (2003).
Mitchell, J. R., Senger, P. L. & Rosenberger, J. L. Distribution and retention of spermatozoa with acrosomal and nuclear abnormalities in the cow genital tract. J. Anim. Sci. 61, 956–967 (1985).
Sostaric, E. et al. Sperm binding properties and secretory activity of the bovine oviduct immediately before and after ovulation. Mol. Reprod. Dev. 75, 60–74 (2008).
Marey, M. A. et al. Bovine oviduct epithelial cells downregulate phagocytosis of sperm by neutrophils: prostaglandin E2 as a major physiological regulator. Reproduction 147, 211–219 (2014).
Alghamdi, A. S. et al. Species-specific interaction of seminal plasma on sperm–neutrophil binding. Anim. Reprod. Sci. 114, 331–344 (2009).
Mattner, P. E. The distribution of spermatozoa and leucocytes in the female genital tract in goats and cattle. J. Reprod. Fertil. 17, 253–261 (1968).
Strzemienski, P. J. Effect of bovine seminal plasma on neutrophil phagocytosis of bull spermatozoa. J. Reprod. Fertil. 87, 519–528 (1989).
Alghamdi, A. S. & Foster, D. N. Seminal DNase frees spermatozoa entangled in neutrophil extracellular traps. Biol. Reprod. 73, 1174–1181 (2005).
Haney, A. F., Misukonis, M. A. & Weinberg, J. B. Macrophages and infertility: oviductal macrophages as potential mediators of infertility. Fertil. Steril. 39, 310–315 (1983).
Murakami, M., Nishida, T., Shiromoto, M. & Iwanaga, S. Phagocytosis of spermatozoa and latex beads by epithelial cell of the cat oviduct: combined SEM and TEM study. Arch. Histol. Jpn. 48, 519–526 (1985).
Chakraborty, J. & Nelson, L. Fate of surplus sperm in the fallopian tube of the white mouse. Biol. Reprod. 12, 455–463 (1975).
Eisenbach, M. Why are sperm cells phagocytosed by leukocytes in the female genital tract? Med. Hypotheses 60, 590–592 (2003).
Kodithuwakku, S. P., Miyamoto, A. & Wijayagunawardane, M. P. B. Spermatozoa stimulate prostaglandin synthesis and secretion in bovine oviductal epithelial cells. Reproduction 133, 1087–1094 (2007).
Yousef, M. S. et al. Sperm binding to oviduct epithelial cells enhances TGFB1 and IL10 expressions in epithelial cells as well as neutrophils in vitro: prostaglandin E2 as a main regulator of anti- inflammatory response in the bovine oviduct. PloS one 11(9), e0162309 (2016).
Liu, J. et al. An acute-phase protein as a regulator of sperm survival in the bovine oviduct: alpha 1-acid-glycoprotein impairs neutrophil phagocytosis of sperm in vitro. J. Reprod. Dev. 60, 342–348 (2014).
Marey, M. A. et al. Endothelin-1 downregulates spermophagy by neutrophils in vitro: a physiological implication in bovine oviduct immunity. J. Reprod. Dev. 62, 151–157 (2016a).
Marey, M. A. et al. Angiotensin II increases spermophagy by neutrophils in vitro: a possible physiological role in the bovine oviduct. Mol. Reprod. Dev. 83, 630–639 (2016b).
Haghighi, M. et al. A comparison of rule-based analysis with regression methods in understanding the risk factors for study withdrawal in a pediatric study. Sci. Rep. 6, 30828 (2016).
Loley., C. et al. No association of coronary artery disease with X-chromosomal variants in comprehensive international meta-analysis. Sci. Rep. 6, 35278 (2016).
Sun, H. & Wang, S. Penalized logistic regression for high-dimensional DNA methylation data with case-control studies. Bioinformatics 28, 1368–13375 (2012).
Wu, H. Y. et al. Predicting postoperative vomiting among orthopedic patients receiving patient-controlled epidural analgesia using SVM and LR. Sci. Rep. 6, 27041 (2016).
Zhang, Q. et al. Selection of models for the analysis of risk-factor trees: leveraging biological knowledge to mine large sets of risk factors with application to microbiome data. Bioinformatics 31, 1607–1613 (2015).
Ritz, C., Baty, F., Streibig, J. C. & Gerhard, D. Dose-response analysis using R. PloS one 10, e0146021 (2015).
Akaike, H. Information measures and model selection. International Statistical Institute 44, 277–291 (1983).
Lavine, M. Comment on murtaugh. Ecology 95, 642–645 (2014).
Peddinti, D. et al. Comprehensive proteomic analysis of bovine spermatozoa of varying fertility rates and identification of biomarkers associated with fertility. BMC Sys. Biol. 2, 19 (2008).
Alghamdi, A. S., Foster, D. N. & Troedsson, M. H. T. Equine seminal plasma reduces sperm binding to polymorphonuclear neutrophils (PMNs) and improves the fertility of fresh semen inseminated into inflamed uteri. Reproduction 127, 593–600 (2004).
Zambrano, F. et al. Leukocytes co-incubated with human sperm trigger classic neutrophil extracellular traps formation, reducing sperm motility. Fertil. Steril. doi:10.1016/j.fertnstert.2016.06.005 (2016).
Henry, F. et al. Seminal fluid promotes in vitro sperm–oviduct binding in the domestic cat (Felis catus). Theriogenology 83, 1373–1380 (2015).
Hu, Y. J. et al. Decision tree-based learning to predict patient controlled analgesia consumption and readjustment. BMC Med. Inform. Decis. Mak. 12, 131 (2012).
Johnston, M. E., Langton, K. B., Haynes, R. B. & Mathieu, A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann. Intern. Med. 120, 135–42 (1994).
Lee, S. Y., Hung, C. J., Chen, C. C. & Wu, C. C. Survival analysis of postoperative nausea and vomiting in patients receiving patient controlled epidural analgesia. J. Chin. Med. Assoc 77, 589–93 (2014).
Gilbert-Diamond, D. & Moore, J. H. Analysis of gene-gene interactions. Curr. Protoc. Hum. Genet. 14, doi:10.1002/0471142905.hg0114s70 (2011).
Marchini, J., Donnelly, P. & Cardon, L. R. Genome-wide strategies for detecting multiple loci that influence complex diseases. Nat. Genet. 37, 413–417 (2005).
Wijayagunawardane, M. P. B., Miyamoto, A. & Sato, K. Prostaglandin E2, prostaglandin F2α and endothelin-1 production by cow oviductal epithelial cell monolayers: effect of progesterone, estradiol 17β, oxytocin and luteinizing hormone. Theriogenology 52, 791–801 (1999).
Wijayagunawardane, M. P. B. et al. Local distributions of oviductal estradiol, progesterone, prostaglandins, oxytocin and endothelin-1 in the cyclic cow. Theriogenology 49, 607–618 (1998).
Wijayagunawardane, M. P. B., Kodithuwakku, S. P., Dé Silva, N. T. & Miyamoto, A. Angiotensin II secretion by the bovine oviduct is stimulated by luteinizing hormone and ovarian steroids. J. Reprod. Dev. 55, 570–575 (2009).
Wijayagunawardane, M. P. B., Kodithuwakku, S. P., Yamamoto, D. & Miyamoto, A. Vascular endothelial growth factor system in the cow oviduct: a possible involvement in the regulation of oviductal motility and embryo transport. Mol. Reprod. Dev. 72, 511–520 (2005).
Parrish, J. J., Susko-Panish, J. L., Winer, M. A. & First, N. L. Capacitation of bovine sperm by heparin. Biol. Reprod. 38, 1171–1180 (1988).
Kovacs, A. & Foote, R. H. Viability and acrosome staining of bull, boar and rabbit sperm. Biotech. Histochem. 67, 119–124 (1992).
Bianco, A. M. & Martinez, E. Robust testing in the logistic regression model. Comput. Stat. Data Anal. 53, 4095–4105 (2009).
Maalouf, M. & Trafalis, T. B. Robust weighted kernel logistic regression in imbalanced and rare events data. Comput. Stat. Data Anal. 55, 168–183 (2011).
MATLAB, version 7.10.0. The MathWorks Inc., Natick, Massachusetts (2010).
Keshtegar, B., Allawi, M. F., Afan, H. A. & El-Shafie, A. Optimized river stream-flow forecasting model utilizing high-order response surface method. Water Resour. Manag. 30, 3899–3914 (2016).
Acknowledgements
This study was supported by Isfahan University of Technology and a Grant-in-Aid for Scientific Research (No. 16H05013) of the Japan Society for the Promotion of Science (JSPS). We acknowledge the contributing authors, and the associated funding organizations for providing access to the datasets used in this study.
Author information
Authors and Affiliations
Contributions
R.K. and B.K. conceived the statistical methodology, B.K. analyzed the data. R.K. and B.K. wrote the paper. All authors reviewed the manuscript.
Corresponding authors
Ethics declarations
Competing Interests
The authors declare that they have no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kowsar, R., Keshtegar, B., Marey, M.A. et al. An autoregressive logistic model to predict the reciprocal effects of oviductal fluid components on in vitro spermophagy by neutrophils in cattle. Sci Rep 7, 4482 (2017). https://doi.org/10.1038/s41598-017-04841-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-017-04841-z
This article is cited by
-
Nonlinear modeling for bar bond stress using dynamical self-adjusted harmony search optimization
Engineering with Computers (2021)
-
Nonlinear models based on enhanced Kriging interpolation for prediction of rock joint shear strength
Neural Computing and Applications (2021)
-
Understanding the hidden relations between pro- and anti-inflammatory cytokine genes in bovine oviduct epithelium using a multilayer response surface method
Scientific Reports (2019)
-
Potential roles of neutrophils in maintaining the health and productivity of dairy cows during various physiological and physiopathological conditions: a review
Immunologic Research (2019)
-
Modeling spatial distribution of plant species using autoregressive logistic regression method-based conjugate search direction
Plant Ecology (2019)





