Resumen
Although the variable selection and regularization procedures have been extensively considered in the literature for the quantile regression (????)
(
Q
R
)
scenario via penalization, many such procedures fail to deal with data aberrations in the design space, namely, high leverage points (X-space outliers) and collinearity challenges simultaneously. Some high leverage points referred to as collinearity influential observations tend to adversely alter the eigenstructure of the design matrix by inducing or masking collinearity. Therefore, in the literature, it is recommended that the problems of collinearity and high leverage points should be dealt with simultaneously. In this article, we suggest adaptive ??????????
L
A
S
S
O
and adaptive E-??????
N
E
T
penalized ????
Q
R
(????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
) procedures where the weights are based on a ????
Q
R
estimator as remedies. We extend this methodology to their penalized weighted ????
Q
R
versions of ??????
W
Q
R
-??????????
L
A
S
S
O
, ??????
W
Q
R
-E-??????
N
E
T
procedures we had suggested earlier. In the literature, adaptive weights are based on the RIDGE regression (????
R
R
) parameter estimator. Although the use of this estimator may be plausible at the l1
l
1
estimator (????
Q
R
at ??=0.5
t
=
0.5
) for the symmetrical distribution, it may not be so at extreme quantile levels. Therefore, we use a ????
Q
R
-based estimator to derive adaptive weights. We carried out a comparative study of ????
Q
R
-??????????
L
A
S
S
O
, ????
Q
R
-E-??????
N
E
T
, and the ones we suggest here, ??????.
v
i
z
.
, ????
Q
R
-????????????
A
L
A
S
S
O
, ????
Q
R
-????
A
E
-??????
N
E
T
, weighted ????
Q
R
????????????
A
L
A
S
S
O
penalized and weighted ????
Q
R
adaptive ????
A
E
-??????
N
E
T
penalized (??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
) procedures. The simulation study results show that ????
Q
R
-????????????
A
L
A
S
S
O
, ????
Q
R
-????
A
E
-??????
N
E
T
, ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
generally outperform their nonadaptive counterparts. At predictor matrices with collinearity inducing points under normality, the ????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
, respectively, outperform the non-adaptive procedures in the unweighted scenarios, as follows: in all 16 cases (100%) with respect to correctly selected (shrunk) zero coefficients; in 88% with respect to correctly fitted models; and in 81% with respect to prediction. In the weighted penalized ??????
W
Q
R
scenarios, ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
outperform their non-adaptive versions as follows: in 75% of the time with respect to both correctly fitted models and correctly shrunk zero coefficients and in 63% with respect to prediction. At predictor matrices with collinearity masking points under normality, the ????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
, respectively, outperform the non-adaptive procedures in the unweighted scenarios as follows: in prediction, in 100%
100
%
and 88%
88
%
of the time; with respect to correctly fitted models in 100%
100
%
and 50%
50
%
(while in 50%
50
%
equally); and with respect to correctly shrunk zero coefficients in 100%
100
%
of the time. In the weighted scenario, ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
outperform their respective non-adaptive versions as follows; with respect to prediction, both in 63%
63
%
of the time; with respect to correctly fitted models, in 88%
88
%
of the time while with respect to correctly shrunk zero coefficients in 100%
100
%
of the time. At predictor matrices with collinearity inducing points under the t-distribution, the ????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
procedures outperform their respective non-adaptive procedures in the unweighted scenarios as follows: in prediction, in 100%
100
%
and 75%
75
%
of the time; with respect to correctly fitted models 88%
88
%
of the time each; and with respect to correctly shrunk zero 88%
88
%
and in 100%
100
%
of the time. Additionally, the procedures ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
and their unweighted versions result in the former outperforming the latter in all respective cases with respect to prediction whilst there is no clear "winner" with respect to the other two measures. Overall, the ??????
W
Q
R
-????????????
A
L
A
S
S
O
generally outperforms all other models with respect to all measures. At the predictor matrix with collinearity-masking points under the t-distribution, all adaptive versions outperformed their respective non-adaptive versions with respect to all metrics. In the unweighted scenarios, the ????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
dominate their non-adaptive versions as follows: in prediction, in 63%
63
%
and 75%
75
%
of the time; with respect to correctly fitted models, in 100%
100
%
and 38%
38
%
(while in 62%
62
%
equally); in 100%
100
%
of the time with respect to correctly shrunk zero coefficients. In the weighted scenarios, all adaptive versions outperformed their non-adaptive versions as follows: 62%
62
%
of the time in both respective cases with respect to prediction while it is vice-versa with respect to correctly fitted models and with respect to correctly shrunk zero coefficients. In the weighted scenarios, ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
dominate their respective non-adaptive versions as follows; with respect to correctly fitted models, in 62%
62
%
of the time while with respect to correctly shrunk zero coefficients in 100%
100
%
of the time in both cases. At the design matrix with both collinearity and high leverage points under the heavy-tailed distributions (t-distributions with ???(1;6)
d
?
(
1
;
6
)
degrees of freedom) scenarios, the dominance of the adaptive procedures over the non-adaptive ones is again evident. In the unweighted scenarios, the procedures ????
Q
R
-????????????
A
L
A
S
S
O
and ????
Q
R
-????
A
E
-??????
N
E
T
outperform their non-adaptive versions as follows; in prediction, in 75%
75
%
and 62%
62
%
of the time; with respect to correctly fitted models, they perform better in 100%
100
%
and 88%
88
%
of the time, while with respect to correctly shrunk zero coefficients, they outperform their non-adaptive ones 100%
100
%
of the time in both cases. In the weighted scenarios, ??????
W
Q
R
-????????????
A
L
A
S
S
O
and ??????
W
Q
R
-????
A
E
-??????
N
E
T
dominate their non-adaptive versions as follows; with respect to prediction, in 100%
100
%
of the time in both cases; and with respect to both correctly fitted models and correctly shrunk zero coefficients, they both do 88%
88
%
of the time. Results from applications of the suggested procedures to real life data sets are more or less in line with the simulation studies results.