• 成功解决TypeError: only size-1 arrays can be converted to Python scalars

    成功解决TypeError: only size-1 arrays can be converted to Python scalars

    目录

    解决问题

    解决思路

    解决方法

    1、分析问题

    2、测试bug

    3、寻找函数参数正确定义

    4、最终解决办法

    解决问题

    TypeError: only size-1 arrays can be converted to Python scalars

    解决思路

    类型错误：只有size-1的数组可以转换为 Python 标量

    解决方法

    1、分析问题

    在执行shap.summary_plot(shap_i_values, X_data, max_display=7)函数的时候，遇到了TypeError: only size-1 arrays can be converted to Python scalars问题，

    1. explainer = shap.TreeExplainer(model_C)  # 初始化解释器
    2. shap_i_values = explainer.shap_interaction_values(X_data)   # 返回 估计一组样本的 SHAP交互值
    3. print(model_name,type(shap_i_values),shap_i_values.shape,'\n',shap_i_values)
    4. shap.summary_plot(shap_i_values, X_data, max_display=7)

    2、测试bug

    经过测试，发现model_C带来的shap_i_values存在问题，输出shap_i_values

    1. model_C： RandomForestClassifier()
    2. RFC 'list'> 2 
    3.  [array([[[ 1.00892288e-01, -1.68401619e-02, -5.94680958e-03, ...,
    4.          -1.32470081e-02,  3.55464100e-02,  5.80109769e-03],
    5.         [-1.68401619e-02, -5.12440004e-02, -3.74259978e-02, ...,
    6.          -2.28063353e-02,  4.59434195e-02, -3.04559773e-03],
    7.         [-5.94680958e-03, -3.74259978e-02, -1.85461859e-02, ...,
    8.          -6.63725042e-03,  1.92107791e-02, -2.68634910e-03],
    9.         ...,
    10.         [-1.32470081e-02, -2.28063353e-02, -6.63725042e-03, ...,
    11.          -1.38762590e-02,  4.56568837e-02, -7.74597253e-03],
    12.         [ 3.55464100e-02,  4.59434195e-02,  1.92107791e-02, ...,
    13.           4.56568837e-02, -3.10902626e-01,  1.16618553e-02],
    14.         [ 5.80109769e-03, -3.04559773e-03, -2.68634910e-03, ...,
    15.          -7.74597253e-03,  1.16618553e-02,  2.75534972e-02]],
    16.  
    17.        [[ 8.19124603e-02,  1.07770267e-02, -2.73940856e-03, ...,
    18.          -5.42286117e-03, -1.43148441e-02, -9.38927405e-03],
    19.         [ 1.07770267e-02,  1.34434798e-02,  8.07094323e-03, ...,
    20.           4.91124351e-03,  5.50744405e-03,  6.47903095e-03],
    21.         [-2.73940856e-03,  8.07094323e-03, -1.43633784e-02, ...,
    22.           3.11791569e-03,  3.20759035e-03,  3.83808653e-03],
    23.         ...,
    24.         [-5.42286117e-03,  4.91124351e-03,  3.11791569e-03, ...,
    25.           7.87596527e-02,  1.74101730e-02, -1.64075188e-02],
    26.         [-1.43148441e-02,  5.50744405e-03,  3.20759035e-03, ...,
    27.           1.74101730e-02,  1.33626522e-01,  2.42559627e-02],
    28.         [-9.38927405e-03,  6.47903095e-03,  3.83808653e-03, ...,
    29.          -1.64075188e-02,  2.42559627e-02, -5.97394271e-02]],
    30.  
    31.        [[-1.38735034e-01, -2.42364407e-02,  1.14693608e-02, ...,
    32.          -6.99696322e-03,  1.72904490e-02, -7.51722121e-03],
    33.         [-2.42364407e-02,  2.39629923e-02, -6.97181439e-03, ...,
    34.          -2.22822148e-02, -1.36613812e-02, -3.50808091e-02],
    35.         [ 1.14693608e-02, -6.97181439e-03, -3.59474202e-03, ...,
    36.          -6.09146988e-03,  5.59217986e-04, -3.53721479e-03],
    37.         ...,
    38.         [-6.99696322e-03, -2.22822148e-02, -6.09146988e-03, ...,
    39.          -1.87555406e-02, -5.20973244e-03,  8.26104068e-03],
    40.         [ 1.72904490e-02, -1.36613812e-02,  5.59217986e-04, ...,
    41.          -5.20973244e-03,  1.75241348e-01, -3.04973301e-03],
    42.         [-7.51722121e-03, -3.50808091e-02, -3.53721479e-03, ...,
    43.           8.26104068e-03, -3.04973301e-03, -1.46418256e-02]],
    44.  
    45.        ...,
    46.  
    47.        [[-3.56423927e-02,  5.54317507e-02,  3.91146242e-03, ...,
    48.          -1.75050321e-02,  1.85085775e-02, -7.70937834e-03],
    49.         [ 5.54317507e-02, -1.39482944e-02,  6.70113175e-03, ...,
    50.           6.15454045e-02, -9.39428826e-03,  1.47123014e-02],
    51.         [ 3.91146242e-03,  6.70113175e-03, -1.26818812e-02, ...,
    52.           5.26829692e-03, -2.15772294e-03, -2.47514340e-04],
    53.         ...,
    54.         [-1.75050321e-02,  6.15454045e-02,  5.26829692e-03, ...,
    55.           5.55692076e-04, -2.84333320e-02, -3.75207918e-03],
    56.         [ 1.85085775e-02, -9.39428826e-03, -2.15772294e-03, ...,
    57.          -2.84333320e-02,  1.87019548e-01, -8.06957153e-03],
    58.         [-7.70937834e-03,  1.47123014e-02, -2.47514340e-04, ...,
    59.          -3.75207918e-03, -8.06957153e-03,  2.07337395e-02]],
    60.  
    61.        [[ 8.84126066e-02,  1.82736920e-02, -5.65054043e-03, ...,
    62.           2.64967036e-02,  4.50916773e-02, -2.10122413e-02],
    63.         [ 1.82736920e-02,  7.86941550e-02,  2.28788104e-03, ...,
    64.          -2.58770389e-03,  4.72064392e-03, -1.03766811e-02],
    65.         [-5.65054043e-03,  2.28788104e-03, -1.35146704e-02, ...,
    66.          -4.56388283e-03, -8.82118001e-04,  7.42603680e-03],
    67.         ...,
    68.         [ 2.64967036e-02, -2.58770389e-03, -4.56388283e-03, ...,
    69.          -2.79773016e-02,  3.87947909e-03, -9.58019047e-03],
    70.         [ 4.50916773e-02,  4.72064392e-03, -8.82118001e-04, ...,
    71.           3.87947909e-03, -2.77131303e-01, -1.79673439e-03],
    72.         [-2.10122413e-02, -1.03766811e-02,  7.42603680e-03, ...,
    73.          -9.58019047e-03, -1.79673439e-03, -2.83423819e-02]],
    74.  
    75.        [[-1.28237432e-01, -4.30365174e-02, -2.66452665e-02, ...,
    76.           2.37250928e-02,  1.16385374e-02,  2.30255891e-03],
    77.         [-4.30365174e-02, -7.58918083e-03,  1.13716355e-02, ...,
    78.          -1.11100667e-02, -1.67378386e-02, -1.29576697e-02],
    79.         [-2.66452665e-02,  1.13716355e-02,  5.76768628e-03, ...,
    80.          -1.05677681e-02, -6.82289674e-03, -8.07668275e-03],
    81.         ...,
    82.         [ 2.37250928e-02, -1.11100667e-02, -1.05677681e-02, ...,
    83.          -1.14539347e-01, -7.11114704e-03, -2.89130556e-02],
    84.         [ 1.16385374e-02, -1.67378386e-02, -6.82289674e-03, ...,
    85.          -7.11114704e-03,  1.88275364e-01, -1.17071760e-02],
    86.         [ 2.30255891e-03, -1.29576697e-02, -8.07668275e-03, ...,
    87.          -2.89130556e-02, -1.17071760e-02, -1.77655951e-02]]]), array([[[-1.00892288e-01,  1.68401619e-02,  5.94680958e-03, ...,
    88.           1.32470081e-02, -3.55464100e-02, -5.80109769e-03],
    89.         [ 1.68401619e-02,  5.12440004e-02,  3.74259978e-02, ...,
    90.           2.28063353e-02, -4.59434195e-02,  3.04559773e-03],
    91.         [ 5.94680958e-03,  3.74259978e-02,  1.85461859e-02, ...,
    92.           6.63725042e-03, -1.92107791e-02,  2.68634910e-03],
    93.         ...,
    94.         [ 1.32470081e-02,  2.28063353e-02,  6.63725042e-03, ...,
    95.           1.38762590e-02, -4.56568837e-02,  7.74597253e-03],
    96.         [-3.55464100e-02, -4.59434195e-02, -1.92107791e-02, ...,
    97.          -4.56568837e-02,  3.10902626e-01, -1.16618553e-02],
    98.         [-5.80109769e-03,  3.04559773e-03,  2.68634910e-03, ...,
    99.           7.74597253e-03, -1.16618553e-02, -2.75534972e-02]],
    100.  
    101.        [[-8.19124603e-02, -1.07770267e-02,  2.73940856e-03, ...,
    102.           5.42286117e-03,  1.43148441e-02,  9.38927405e-03],
    103.         [-1.07770267e-02, -1.34434798e-02, -8.07094323e-03, ...,
    104.          -4.91124351e-03, -5.50744405e-03, -6.47903095e-03],
    105.         [ 2.73940856e-03, -8.07094323e-03,  1.43633784e-02, ...,
    106.          -3.11791569e-03, -3.20759035e-03, -3.83808653e-03],
    107.         ...,
    108.         [ 5.42286117e-03, -4.91124351e-03, -3.11791569e-03, ...,
    109.          -7.87596527e-02, -1.74101730e-02,  1.64075188e-02],
    110.         [ 1.43148441e-02, -5.50744405e-03, -3.20759035e-03, ...,
    111.          -1.74101730e-02, -1.33626522e-01, -2.42559627e-02],
    112.         [ 9.38927405e-03, -6.47903095e-03, -3.83808653e-03, ...,
    113.           1.64075188e-02, -2.42559627e-02,  5.97394271e-02]],
    114.  
    115.        [[ 1.38735034e-01,  2.42364407e-02, -1.14693608e-02, ...,
    116.           6.99696322e-03, -1.72904490e-02,  7.51722121e-03],
    117.         [ 2.42364407e-02, -2.39629923e-02,  6.97181439e-03, ...,
    118.           2.22822148e-02,  1.36613812e-02,  3.50808091e-02],
    119.         [-1.14693608e-02,  6.97181439e-03,  3.59474202e-03, ...,
    120.           6.09146988e-03, -5.59217986e-04,  3.53721479e-03],
    121.         ...,
    122.         [ 6.99696322e-03,  2.22822148e-02,  6.09146988e-03, ...,
    123.           1.87555406e-02,  5.20973244e-03, -8.26104068e-03],
    124.         [-1.72904490e-02,  1.36613812e-02, -5.59217986e-04, ...,
    125.           5.20973244e-03, -1.75241348e-01,  3.04973301e-03],
    126.         [ 7.51722121e-03,  3.50808091e-02,  3.53721479e-03, ...,
    127.          -8.26104068e-03,  3.04973301e-03,  1.46418256e-02]],
    128.  
    129.        ...,
    130.  
    131.        [[ 3.56423927e-02, -5.54317507e-02, -3.91146242e-03, ...,
    132.           1.75050321e-02, -1.85085775e-02,  7.70937834e-03],
    133.         [-5.54317507e-02,  1.39482944e-02, -6.70113175e-03, ...,
    134.          -6.15454045e-02,  9.39428826e-03, -1.47123014e-02],
    135.         [-3.91146242e-03, -6.70113175e-03,  1.26818812e-02, ...,
    136.          -5.26829692e-03,  2.15772294e-03,  2.47514340e-04],
    137.         ...,
    138.         [ 1.75050321e-02, -6.15454045e-02, -5.26829692e-03, ...,
    139.          -5.55692076e-04,  2.84333320e-02,  3.75207918e-03],
    140.         [-1.85085775e-02,  9.39428826e-03,  2.15772294e-03, ...,
    141.           2.84333320e-02, -1.87019548e-01,  8.06957153e-03],
    142.         [ 7.70937834e-03, -1.47123014e-02,  2.47514340e-04, ...,
    143.           3.75207918e-03,  8.06957153e-03, -2.07337395e-02]],
    144.  
    145.        [[-8.84126066e-02, -1.82736920e-02,  5.65054043e-03, ...,
    146.          -2.64967036e-02, -4.50916773e-02,  2.10122413e-02],
    147.         [-1.82736920e-02, -7.86941550e-02, -2.28788104e-03, ...,
    148.           2.58770389e-03, -4.72064392e-03,  1.03766811e-02],
    149.         [ 5.65054043e-03, -2.28788104e-03,  1.35146704e-02, ...,
    150.           4.56388283e-03,  8.82118001e-04, -7.42603680e-03],
    151.         ...,
    152.         [-2.64967036e-02,  2.58770389e-03,  4.56388283e-03, ...,
    153.           2.79773016e-02, -3.87947909e-03,  9.58019047e-03],
    154.         [-4.50916773e-02, -4.72064392e-03,  8.82118001e-04, ...,
    155.          -3.87947909e-03,  2.77131303e-01,  1.79673439e-03],
    156.         [ 2.10122413e-02,  1.03766811e-02, -7.42603680e-03, ...,
    157.           9.58019047e-03,  1.79673439e-03,  2.83423819e-02]],
    158.  
    159.        [[ 1.28237432e-01,  4.30365174e-02,  2.66452665e-02, ...,
    160.          -2.37250928e-02, -1.16385374e-02, -2.30255891e-03],
    161.         [ 4.30365174e-02,  7.58918083e-03, -1.13716355e-02, ...,
    162.           1.11100667e-02,  1.67378386e-02,  1.29576697e-02],
    163.         [ 2.66452665e-02, -1.13716355e-02, -5.76768628e-03, ...,
    164.           1.05677681e-02,  6.82289674e-03,  8.07668275e-03],
    165.         ...,
    166.         [-2.37250928e-02,  1.11100667e-02,  1.05677681e-02, ...,
    167.           1.14539347e-01,  7.11114704e-03,  2.89130556e-02],
    168.         [-1.16385374e-02,  1.67378386e-02,  6.82289674e-03, ...,
    169.           7.11114704e-03, -1.88275364e-01,  1.17071760e-02],
    170.         [-2.30255891e-03,  1.29576697e-02,  8.07668275e-03, ...,
    171.           2.89130556e-02,  1.17071760e-02,  1.77655951e-02]]])]

    3、寻找函数参数正确定义

    因为shap_values: numpy.array
    对于单个输出解释，这是一个SHAP值的矩阵(# samples x # features)。
    对于多输出解释，这是一个SHAP值矩阵的列表。

     可知，当前list数据并非size-1的数组，所以，无法转为scalars类型的数据

    4、最终解决办法

    RandomForestClassifier()改为，经过测试，输出以下，运行成功！

    1. model_C： 0x00000269F30A5860>
    2. LGBMC 'numpy.ndarray'> (295, 7, 7) 
    3.  [[[-2.03212277e-01  8.38473368e-02  9.27494035e-03 ...  3.76043663e-02
    4.    -1.12195878e-01 -7.51591770e-03]
    5.   [ 8.38473368e-02  8.67422668e-04  2.27826062e-02 ...  1.51550190e-02
    6.    -1.28015053e-01  1.73530157e-04]
    7.   [ 9.27494035e-03  2.27826062e-02  9.83802075e-02 ...  0.00000000e+00
    8.    -1.22171674e-01  0.00000000e+00]
    9.   ...
    10.   [ 3.76043663e-02  1.51550190e-02  0.00000000e+00 ... -7.48850883e-02
    11.    -6.75088971e-04 -7.39881971e-04]
    12.   [-1.12195878e-01 -1.28015053e-01 -1.22171674e-01 ... -6.75088971e-04
    13.     8.18119865e-01 -7.07531214e-03]
    14.   [-7.51591770e-03  1.73530157e-04  0.00000000e+00 ... -7.39881971e-04
    15.    -7.07531214e-03 -5.30181847e-03]]
    16.  
    17.  [[-2.03905009e-01  1.76970856e-02  3.60372896e-03 ...  6.59590565e-02
    18.     3.25192369e-02  2.85055286e-03]
    19.   [ 1.76970856e-02  7.42271902e-03  9.11656209e-03 ... -2.63576934e-02
    20.    -1.41990904e-02 -4.81719902e-03]
    21.   [ 3.60372896e-03  9.11656209e-03  4.88673814e-02 ...  0.00000000e+00
    22.     6.82874328e-03  0.00000000e+00]
    23.   ...
    24.   [ 6.59590565e-02 -2.63576934e-02  0.00000000e+00 ... -8.03527385e-02
    25.    -2.39716159e-02 -1.06731256e-03]
    26.   [ 3.25192369e-02 -1.41990904e-02  6.82874328e-03 ... -2.39716159e-02
    27.    -3.32003213e-01 -8.00174419e-03]
    28.   [ 2.85055286e-03 -4.81719902e-03  0.00000000e+00 ... -1.06731256e-03
    29.    -8.00174419e-03  2.47351615e-02]]
    30.  
    31.  [[ 3.65524524e-01  1.23282110e-01 -6.94995088e-03 ...  1.08536810e-01
    32.    -1.80451184e-02 -5.55932748e-03]
    33.   [ 1.23282110e-01 -5.94745798e-02 -6.94995088e-03 ...  3.15618035e-02
    34.     3.78288199e-02 -1.76019586e-03]
    35.   [-6.94995088e-03 -6.94995088e-03  2.85466167e-02 ...  0.00000000e+00
    36.     2.48014752e-03  0.00000000e+00]
    37.   ...
    38.   [ 1.08536810e-01  3.15618035e-02  0.00000000e+00 ... -1.29775694e-01
    39.     4.39073931e-02  1.56505599e-03]
    40.   [-1.80451184e-02  3.78288199e-02  2.48014752e-03 ...  4.39073931e-02
    41.    -3.65634236e-01 -7.31780875e-04]
    42.   [-5.55932748e-03 -1.76019586e-03  0.00000000e+00 ...  1.56505599e-03
    43.    -7.31780875e-04  2.39037391e-02]]
    44.  
    45.  ...
    46.  
    47.  [[ 4.63957818e-02 -1.58713899e-02  1.81106212e-03 ...  2.55113122e-02
    48.    -5.77921525e-02  3.08940168e-04]
    49.   [-1.58713899e-02 -1.35632524e-02 -1.18515307e-02 ... -3.50505266e-02
    50.     1.52571779e-02 -3.73236510e-04]
    51.   [ 1.81106212e-03 -1.18515307e-02  3.32397672e-02 ...  0.00000000e+00
    52.     3.52229420e-03  0.00000000e+00]
    53.   ...
    54.   [ 2.55113122e-02 -3.50505266e-02  0.00000000e+00 ... -9.64323297e-02
    55.     3.35029039e-02  1.61635537e-03]
    56.   [-5.77921525e-02  1.52571779e-02  3.52229420e-03 ...  3.35029039e-02
    57.    -3.98187413e-01 -3.02662989e-04]
    58.   [ 3.08940168e-04 -3.73236510e-04  0.00000000e+00 ...  1.61635537e-03
    59.    -3.02662989e-04 -9.08739780e-03]]
    60.  
    61.  [[-1.71996993e-01 -1.47872120e-02  3.85899956e-03 ... -1.50209005e-01
    62.    -2.18026430e-01  1.39766423e-02]
    63.   [-1.47872120e-02 -3.28965975e-01 -2.96173881e-02 ...  1.32839906e-01
    64.     7.62613499e-02  1.98508032e-02]
    65.   [ 3.85899956e-03 -2.96173881e-02  5.05960370e-02 ...  0.00000000e+00
    66.    -2.96173881e-02  0.00000000e+00]
    67.   ...
    68.   [-1.50209005e-01  1.32839906e-01  0.00000000e+00 ... -1.54809945e-01
    69.    -1.33767766e-01  1.49019359e-02]
    70.   [-2.18026430e-01  7.62613499e-02 -2.96173881e-02 ... -1.33767766e-01
    71.     6.61193249e-01 -3.50387426e-02]
    72.   [ 1.39766423e-02  1.98508032e-02  0.00000000e+00 ...  1.49019359e-02
    73.    -3.50387426e-02  3.15684010e-02]]
    74.  
    75.  [[ 3.71525973e-01  1.15451908e-01 -6.94995088e-03 ...  9.02379792e-02
    76.    -2.25047248e-02 -5.55932748e-03]
    77.   [ 1.15451908e-01 -5.05320365e-02 -6.94995088e-03 ...  1.02980057e-02
    78.     3.28772676e-02 -1.76019586e-03]
    79.   [-6.94995088e-03 -6.94995088e-03  2.85466167e-02 ...  0.00000000e+00
    80.     2.48014752e-03  0.00000000e+00]
    81.   ...
    82.   [ 9.02379792e-02  1.02980057e-02  0.00000000e+00 ... -1.94072290e-01
    83.     1.63458574e-02  1.56505599e-03]
    84.   [-2.25047248e-02  3.28772676e-02  2.48014752e-03 ...  1.63458574e-02
    85.    -3.58855532e-01 -7.31780875e-04]
    86.   [-5.55932748e-03 -1.76019586e-03  0.00000000e+00 ...  1.56505599e-03
    87.    -7.31780875e-04  2.39037391e-02]]]

  • 相关阅读:
    Android Binder通信机制学习（二）
    基于微信小程序的学生购电系统设计与实现-计算机毕业设计源码+LW文档
    OS操作系统——文件管理（测试习题）
    如何理解P2P网络？
    CVE-2023-36845：Juniper Networks Junos OS EX远程命令执行漏洞
    单机运行多个独立浏览器
    合约广告平台架构演进实践
    大数据必学Java基础（六十）：集合补充
    Flutter中的多线程如何使用
    ES6知识点总结——学习网站及环境搭建
  • 原文地址：https://blog.csdn.net/qq_41185868/article/details/126106520