2026-08-07 10:39:54,809 file: tool_utils.py func: tool_utils line No: 77 log will be stored in /workspace/smart_car_2026/model/hb_mapper_makertbin.log 2026-08-07 10:39:54,810 file: hb_mapper.py func: hb_mapper line No: 132 Start hb_mapper.... 2026-08-07 10:39:54,810 file: hb_mapper.py func: hb_mapper line No: 133 hbdk version 3.49.15 2026-08-07 10:39:54,811 file: hb_mapper.py func: hb_mapper line No: 134 horizon_nn version 1.1.0 2026-08-07 10:39:54,811 file: hb_mapper.py func: hb_mapper line No: 135 hb_mapper version 1.24.3 2026-08-07 10:39:54,811 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 530 Start Model Convert.... 2026-08-07 10:39:54,816 file: mapper_conf_parser.py func: mapper_conf_parser line No: 105 validating model_parameters... 2026-08-07 10:39:54,816 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1347 Using abs path /workspace/smart_car_2026/model/x5_quantization/best_bpu.onnx 2026-08-07 10:39:54,816 file: mapper_conf_parser.py func: mapper_conf_parser line No: 260 Using onnx model file: /workspace/smart_car_2026/model/x5_quantization/best_bpu.onnx 2026-08-07 10:39:54,830 file: onnx_parser.py func: onnx_parser line No: 39 Model input names: ['images'] 2026-08-07 10:39:54,831 file: mapper_conf_parser.py func: mapper_conf_parser line No: 264 Model has 1 inputs according to model file 2026-08-07 10:39:54,831 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1347 Using abs path /workspace/smart_car_2026/model/x5_quantization/mapper_output_bpu 2026-08-07 10:39:54,831 file: mapper_conf_parser.py func: mapper_conf_parser line No: 287 working_dir does not exist. Creating working_dir: /workspace/smart_car_2026/model/x5_quantization/mapper_output_bpu 2026-08-07 10:39:54,832 file: mapper_conf_parser.py func: mapper_conf_parser line No: 438 node_dict: {self.node_dict} 2026-08-07 10:39:54,832 file: mapper_conf_parser.py func: mapper_conf_parser line No: 119 validating model_parameters finished 2026-08-07 10:39:54,832 file: mapper_conf_parser.py func: mapper_conf_parser line No: 123 validating input_parameters... 2026-08-07 10:39:54,832 file: mapper_conf_parser.py func: mapper_conf_parser line No: 536 Model input shape not given in yaml_file, using shape from model file: [[1, 3, 640, 640]] 2026-08-07 10:39:54,832 file: mapper_conf_parser.py func: mapper_conf_parser line No: 639 nv12 input type rt received. 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 135 validating input_parameters finished 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 139 validating calibration_parameters... 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1347 Using abs path /workspace/smart_car_2026/model/x5_quantization/calibration_data 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1007 The calibration dir name suffix is not the same as the value float32 of the parameter cal_data_type, the parameter setting will prevail 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 155 validating calibration_parameters finished 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 159 validating custom_op... 2026-08-07 10:39:54,833 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1076 custom_op does not exist, skipped 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 165 validating custom_op finished 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 168 validating compiler_parameters... 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 1157 Input node images's input_source not set, it will be set to pyramid by default 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 183 validating compiler_parameters finished 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 187 validating deprecated parameters... 2026-08-07 10:39:54,834 file: mapper_conf_parser.py func: mapper_conf_parser line No: 193 validating deprecated parameters finished 2026-08-07 10:39:54,835 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 54 Dump config: 2026-08-07 10:39:54,835 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 55 calibration_parameters: cal_data_dir: ./calibration_data cal_data_type: float32 calibration_type: default optimization: set_Softmax_input_int8,set_Softmax_output_int8 compiler_parameters: compile_mode: latency debug: true jobs: 8 optimize_level: O3 input_parameters: input_layout_train: NCHW input_name: images input_type_rt: nv12 input_type_train: rgb norm_type: data_scale scale_value: '0.003921568627451' model_parameters: layer_out_dump: false march: bayes-e onnx_model: ./best_bpu.onnx output_model_file_prefix: best_bpu_bayese_640x640_nv12 working_dir: mapper_output_bpu 2026-08-07 10:39:54,837 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 60 input 'images' : original model shape: [1, 3, 640, 640] 2026-08-07 10:39:54,838 file: loader.py func: loader line No: 204 ******************************************* 2026-08-07 10:39:54,838 file: loader.py func: loader line No: 205 First calibration picture name: 00000.rgbchw 2026-08-07 10:39:54,839 file: loader.py func: loader line No: 207 First calibration picture md5: 2026-08-07 10:39:54,898 file: loader.py func: loader line No: 211 ******************************************* 2026-08-07 10:39:54,899 file: loader.py func: loader line No: 282 created RawImageDirLoader of shape:[1, 3, 640, 640] 2026-08-07 10:39:54,899 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00000.rgbchw 2026-08-07 10:39:54,970 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00001.rgbchw 2026-08-07 10:39:55,038 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00002.rgbchw 2026-08-07 10:39:55,106 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00003.rgbchw 2026-08-07 10:39:55,173 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00004.rgbchw 2026-08-07 10:39:55,240 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00005.rgbchw 2026-08-07 10:39:55,310 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00006.rgbchw 2026-08-07 10:39:55,378 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00007.rgbchw 2026-08-07 10:39:55,447 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00008.rgbchw 2026-08-07 10:39:55,515 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00009.rgbchw 2026-08-07 10:39:55,584 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00010.rgbchw 2026-08-07 10:39:55,653 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00011.rgbchw 2026-08-07 10:39:55,721 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00012.rgbchw 2026-08-07 10:39:55,789 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00013.rgbchw 2026-08-07 10:39:55,855 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00014.rgbchw 2026-08-07 10:39:55,923 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00015.rgbchw 2026-08-07 10:39:55,991 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00016.rgbchw 2026-08-07 10:39:56,060 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00017.rgbchw 2026-08-07 10:39:56,127 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00018.rgbchw 2026-08-07 10:39:56,194 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00019.rgbchw 2026-08-07 10:39:56,261 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00020.rgbchw 2026-08-07 10:39:56,328 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00021.rgbchw 2026-08-07 10:39:56,395 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00022.rgbchw 2026-08-07 10:39:56,463 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00023.rgbchw 2026-08-07 10:39:56,531 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00024.rgbchw 2026-08-07 10:39:56,600 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00025.rgbchw 2026-08-07 10:39:56,669 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00026.rgbchw 2026-08-07 10:39:56,741 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00027.rgbchw 2026-08-07 10:39:56,811 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00028.rgbchw 2026-08-07 10:39:56,884 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00029.rgbchw 2026-08-07 10:39:56,956 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00030.rgbchw 2026-08-07 10:39:57,027 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00031.rgbchw 2026-08-07 10:39:57,101 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00032.rgbchw 2026-08-07 10:39:57,175 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00033.rgbchw 2026-08-07 10:39:57,244 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00034.rgbchw 2026-08-07 10:39:57,314 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00035.rgbchw 2026-08-07 10:39:57,387 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00036.rgbchw 2026-08-07 10:39:57,474 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00037.rgbchw 2026-08-07 10:39:57,549 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00038.rgbchw 2026-08-07 10:39:57,621 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00039.rgbchw 2026-08-07 10:39:57,700 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00040.rgbchw 2026-08-07 10:39:57,772 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00041.rgbchw 2026-08-07 10:39:57,844 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00042.rgbchw 2026-08-07 10:39:57,917 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00043.rgbchw 2026-08-07 10:39:58,002 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00044.rgbchw 2026-08-07 10:39:58,076 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00045.rgbchw 2026-08-07 10:39:58,150 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00046.rgbchw 2026-08-07 10:39:58,228 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00047.rgbchw 2026-08-07 10:39:58,301 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00048.rgbchw 2026-08-07 10:39:58,372 file: loader.py func: loader line No: 287 Read raw file: /workspace/smart_car_2026/model/x5_quantization/calibration_data/00049.rgbchw 2026-08-07 10:39:58,446 file: tool_utils.py func: tool_utils line No: 368 num of calibration data: 50 2026-08-07 10:39:58,446 file: tool_utils.py func: tool_utils line No: 369 calibration data shape: (1, 3, 640, 640) 2026-08-07 10:39:58,473 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 519 call build params: {'march': 'bayes-e', 'save_model': True, 'name_prefix': 'best_bpu_bayese_640x640_nv12', 'input_dict': {'images': {'input_shape': [1, 3, 640, 640], 'expected_input_type': 'YUV444_128', 'original_input_type': 'RGB', 'original_input_layout': 'NCHW', 'scales': array([0.00392157], dtype=float32)}}, 'cali_dict': {'calibration_type': 'default', 'calibration_data': {'images': [array([[[[ -30., -30., -29., ..., -18., -18., -18.], [ -29., -29., -28., ..., -17., -17., -18.], [ -28., -28., -27., ..., -17., -17., -18.], ..., [ -12., -14., -14., ..., -114., -114., -114.], [ -14., -15., -14., ..., -114., -114., -114.], [ -15., -16., -15., ..., -115., -115., -115.]], [[ -10., -10., -10., ..., -4., -5., -5.], [ -10., -10., -10., ..., -4., -5., -5.], [ -10., -10., -10., ..., -5., -5., -5.], ..., [ -20., -20., -20., ..., -3., -3., -3.], [ -21., -21., -20., ..., -3., -3., -3.], [ -21., -21., -20., ..., -3., -3., -3.]], [[ 2., 2., 2., ..., -3., -4., -4.], [ 2., 2., 2., ..., -3., -4., -4.], [ -1., -1., -1., ..., -4., -4., -4.], ..., [ 8., 8., 8., ..., -3., -3., -3.], [ 8., 8., 8., ..., -3., -3., -3.], [ 8., 8., 8., ..., -3., -3., -3.]]]], dtype=float32), array([[[[ 7., -1., -9., ..., -128., -128., -128.], [ 6., -1., -8., ..., -128., -128., -128.], [ 5., 0., -5., ..., -128., -128., -128.], ..., [ -24., -23., -22., ..., -61., -62., -63.], [ -24., -23., -22., ..., -71., -72., -73.], [ -24., -23., -22., ..., -79., -80., -80.]], [[ -14., -14., -14., ..., -1., -1., -1.], [ -14., -14., -14., ..., -1., -1., -1.], [ -14., -14., -14., ..., -1., -1., -1.], ..., [ -2., -2., -2., ..., 1., 1., 1.], [ -2., -2., -2., ..., 2., 2., 2.], [ -2., -2., -2., ..., 2., 2., 2.]], [[ 4., 4., 4., ..., 0., 0., 0.], [ 4., 4., 4., ..., 0., 0., 0.], [ 4., 4., 4., ..., 0., 0., 0.], ..., [ -6., -6., -6., ..., -6., -6., -6.], [ -6., -6., -6., ..., -6., -6., -6.], [ -6., -6., -6., ..., -6., -6., -6.]]]], dtype=float32), array([[[[-115., -114., -114., ..., 10., 18., 14.], [-112., -111., -111., ..., -2., 6., 6.], [-108., -107., -106., ..., -7., -3., -2.], ..., [ -29., -29., -28., ..., -114., -114., -114.], [ -28., -28., -28., ..., -114., -114., -114.], [ -27., -28., -27., ..., -114., -114., -114.]], [[ -8., -8., -9., ..., -8., -6., -6.], [ -8., -8., -9., ..., -8., -6., -6.], [ -10., -10., -11., ..., -8., -7., -7.], ..., [ 3., 3., 3., ..., -8., -8., -8.], [ 3., 3., 3., ..., -6., -6., -6.], [ 3., 3., 3., ..., -6., -6., -6.]], [[ -8., -8., -8., ..., 0., -1., -1.], [ -8., -8., -8., ..., 0., -1., -1.], [ -7., -7., -8., ..., 0., -2., -2.], ..., [ -11., -11., -12., ..., -6., -6., -6.], [ -11., -11., -12., ..., -6., -6., -6.], [ -11., -11., -12., ..., -6., -6., -6.]]]], dtype=float32), array([[[[-113., -114., -114., ..., -29., -30., -31.], [-113., -113., -114., ..., -29., -30., -31.], [-113., -113., -114., ..., -29., -29., -30.], ..., [ -14., -14., -14., ..., -113., -113., -114.], [ -13., -13., -14., ..., -114., -114., -115.], [ -12., -13., -14., ..., -114., -115., -115.]], [[ -9., -9., -8., ..., -7., -7., -7.], [ -9., -9., -8., ..., -7., -7., -7.], [ -9., -9., -8., ..., -7., -7., -7.], ..., [ 1., 1., 2., ..., 5., 5., 5.], [ 1., 1., 2., ..., 1., 1., 1.], [ 1., 1., 2., ..., 1., 1., 1.]], [[ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., -1., -1., -1.], ..., [ -5., -5., -6., ..., -10., -10., -10.], [ -5., -5., -6., ..., -6., -6., -6.], [ -5., -5., -6., ..., -6., -6., -6.]]]], dtype=float32), array([[[[ -18., -18., -18., ..., -41., -41., -41.], [ -18., -18., -18., ..., -40., -40., -40.], [ -18., -18., -18., ..., -40., -40., -40.], ..., [ -42., -41., -39., ..., -120., -121., -121.], [ -42., -41., -39., ..., -120., -121., -121.], [ -42., -41., -39., ..., -120., -121., -121.]], [[ -14., -14., -14., ..., -20., -20., -20.], [ -14., -14., -14., ..., -20., -20., -20.], [ -14., -14., -14., ..., -20., -20., -20.], ..., [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -4., -4., -4.]], [[ 4., 4., 4., ..., 2., 2., 2.], [ 4., 4., 4., ..., 2., 2., 2.], [ 4., 4., 4., ..., 3., 3., 3.], ..., [ -5., -5., -5., ..., -6., -6., -6.], [ -5., -5., -5., ..., -6., -6., -6.], [ -5., -5., -5., ..., -6., -6., -6.]]]], dtype=float32), array([[[[-89., -81., -65., ..., -73., -74., -75.], [-88., -80., -65., ..., -72., -73., -74.], [-88., -80., -65., ..., -70., -71., -72.], ..., [-26., -23., -24., ..., -19., -19., -18.], [-25., -24., -25., ..., -19., -19., -18.], [-26., -26., -28., ..., -20., -20., -18.]], [[-15., -15., -15., ..., -14., -14., -14.], [-15., -15., -15., ..., -14., -14., -14.], [-15., -15., -15., ..., -14., -14., -14.], ..., [ 2., 2., 2., ..., 1., 1., 1.], [ 2., 2., 2., ..., 1., 1., 1.], [ 2., 2., 2., ..., 1., 1., 1.]], [[ -2., -2., -1., ..., -2., -2., -2.], [ -2., -2., -1., ..., -2., -2., -2.], [ -1., -1., -1., ..., -2., -2., -2.], ..., [ -9., -9., -10., ..., -8., -8., -8.], [ -9., -9., -10., ..., -7., -8., -8.], [ -9., -9., -10., ..., -7., -8., -8.]]]], dtype=float32), array([[[[-127., -127., -128., ..., -121., -124., -126.], [-127., -127., -128., ..., -121., -124., -126.], [-127., -127., -128., ..., -121., -124., -126.], ..., [-128., -128., -128., ..., -96., -101., -104.], [-128., -128., -128., ..., -113., -118., -120.], [-128., -128., -128., ..., -123., -126., -126.]], [[ -1., -1., 1., ..., -3., -3., -3.], [ -1., -1., 1., ..., -3., -3., -3.], [ -1., -1., -1., ..., -3., -3., -3.], ..., [ 0., 0., 0., ..., 2., 2., 2.], [ 0., 0., 0., ..., 2., 2., 2.], [ 0., 0., 0., ..., 2., 2., 2.]], [[ -1., -1., -1., ..., -3., -3., -3.], [ -1., -1., -1., ..., -3., -3., -3.], [ -1., -1., -1., ..., -3., -3., -3.], ..., [ 0., 0., 0., ..., -6., -6., -6.], [ 0., 0., 0., ..., -6., -5., -5.], [ 0., 0., 0., ..., -6., -5., -5.]]]], dtype=float32), array([[[[ 14., 14., 14., ..., -15., -16., -16.], [ 15., 15., 15., ..., -15., -15., -15.], [ 15., 15., 16., ..., -16., -16., -16.], ..., [ -29., -29., -29., ..., -114., -114., -114.], [ -29., -29., -29., ..., -114., -114., -114.], [ -28., -28., -28., ..., -115., -115., -115.]], [[ -11., -11., -11., ..., -7., -7., -7.], [ -11., -11., -11., ..., -7., -7., -7.], [ -11., -11., -11., ..., -7., -7., -7.], ..., [ -6., -6., -6., ..., -4., -4., -4.], [ -6., -6., -6., ..., -4., -4., -4.], [ -6., -6., -6., ..., -4., -4., -4.]], [[ 6., 6., 6., ..., 1., 1., 1.], [ 6., 6., 6., ..., 1., 1., 1.], [ 5., 5., 5., ..., 0., 0., 0.], ..., [ -6., -6., -6., ..., -4., -4., -4.], [ -6., -6., -6., ..., -4., -4., -4.], [ -6., -6., -6., ..., -4., -4., -4.]]]], dtype=float32), array([[[[-114., -114., -115., ..., -31., -24., -19.], [-114., -114., -115., ..., -18., -15., -12.], [-114., -114., -115., ..., -9., -9., -9.], ..., [ -9., -9., -7., ..., -46., -49., -51.], [ -9., -9., -9., ..., -64., -67., -70.], [ -9., -10., -10., ..., -77., -81., -84.]], [[ -3., -3., -3., ..., -14., -14., -14.], [ -3., -3., -3., ..., -14., -14., -14.], [ -3., -3., -3., ..., -15., -15., -15.], ..., [ 2., 2., 2., ..., 3., 3., 3.], [ 2., 2., 2., ..., 6., 6., 6.], [ 2., 2., 2., ..., 6., 6., 6.]], [[ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., 1., 1., 1.], ..., [ -6., -6., -6., ..., -8., -8., -8.], [ -6., -6., -6., ..., -9., -9., -9.], [ -6., -6., -6., ..., -9., -9., -9.]]]], dtype=float32), array([[[[ -3., -3., -3., ..., -89., -89., -90.], [ -3., -2., -3., ..., -89., -89., -90.], [ -3., -3., -3., ..., -89., -89., -90.], ..., [ -3., -3., -3., ..., -125., -125., -125.], [ -3., -3., -3., ..., -126., -126., -126.], [ -2., -2., -2., ..., -125., -125., -125.]], [[ -16., -16., -16., ..., -23., -23., -23.], [ -16., -16., -16., ..., -23., -23., -23.], [ -15., -15., -15., ..., -23., -23., -23.], ..., [ -3., -3., -3., ..., -1., -1., -1.], [ -2., -2., -2., ..., -2., -2., -2.], [ -2., -2., -2., ..., -2., -2., -2.]], [[ 4., 4., 4., ..., -5., -5., -5.], [ 4., 4., 4., ..., -5., -5., -5.], [ 3., 3., 3., ..., -5., -5., -5.], ..., [ -12., -12., -12., ..., -4., -4., -4.], [ -13., -13., -13., ..., -3., -3., -3.], [ -13., -13., -13., ..., -3., -3., -3.]]]], dtype=float32), array([[[[ -85., -76., -79., ..., -115., -115., -115.], [ -82., -75., -79., ..., -115., -115., -115.], [ -77., -73., -80., ..., -115., -115., -115.], ..., [ -25., -23., -22., ..., -115., -115., -115.], [ -25., -23., -22., ..., -115., -115., -115.], [ -25., -23., -22., ..., -115., -115., -115.]], [[ 5., 5., 5., ..., -3., -3., -3.], [ 5., 5., 5., ..., -3., -3., -3.], [ 5., 5., 5., ..., -4., -4., -4.], ..., [ 1., 1., 1., ..., -3., -3., -3.], [ 1., 1., 1., ..., -4., -4., -4.], [ 1., 1., 1., ..., -4., -4., -4.]], [[ -13., -13., -13., ..., -3., -3., -3.], [ -13., -13., -13., ..., -3., -3., -3.], [ -13., -13., -12., ..., -4., -4., -4.], ..., [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.]]]], dtype=float32), array([[[[-114., -114., -114., ..., -103., -104., -104.], [-114., -114., -114., ..., -100., -101., -101.], [-114., -114., -114., ..., -97., -98., -100.], ..., [ -7., -7., -7., ..., -113., -113., -113.], [ -7., -7., -7., ..., -113., -113., -113.], [ -8., -8., -8., ..., -113., -113., -113.]], [[ -7., -7., -4., ..., -15., -14., -14.], [ -7., -7., -4., ..., -15., -14., -14.], [ -7., -7., -4., ..., -14., -16., -16.], ..., [ -2., -2., -2., ..., -6., -6., -6.], [ -2., -2., -2., ..., -6., -6., -6.], [ -2., -2., -2., ..., -6., -6., -6.]], [[ -6., -6., -5., ..., -1., -1., -1.], [ -6., -6., -5., ..., -1., -1., -1.], [ -6., -6., -5., ..., -1., -1., -1.], ..., [ -8., -8., -8., ..., -5., -5., -5.], [ -8., -8., -8., ..., -5., -5., -5.], [ -8., -8., -8., ..., -5., -5., -5.]]]], dtype=float32), array([[[[-114., -114., -114., ..., -81., -88., -88.], [-114., -114., -114., ..., -84., -90., -87.], [-114., -114., -114., ..., -87., -92., -85.], ..., [ -45., -45., -45., ..., -114., -115., -115.], [ -45., -45., -44., ..., -114., -115., -115.], [ -44., -44., -43., ..., -115., -114., -114.]], [[ -6., -6., -6., ..., -13., -8., -8.], [ -6., -6., -6., ..., -13., -8., -8.], [ -6., -6., -6., ..., -12., -8., -8.], ..., [ -4., -4., -4., ..., -2., -2., -2.], [ -4., -4., -4., ..., -1., 0., 0.], [ -4., -4., -4., ..., -1., 0., 0.]], [[ -8., -8., -8., ..., -6., -6., -6.], [ -8., -8., -8., ..., -6., -6., -6.], [ -8., -8., -8., ..., -7., -7., -7.], ..., [ -8., -8., -8., ..., -2., -2., -2.], [ -9., -9., -9., ..., -1., -2., -2.], [ -9., -9., -9., ..., -1., -2., -2.]]]], dtype=float32), array([[[[-88., -87., -85., ..., -26., -26., -26.], [-85., -84., -82., ..., -26., -26., -26.], [-82., -81., -79., ..., -26., -26., -26.], ..., [-31., -31., -31., ..., -41., -41., -41.], [-31., -31., -31., ..., -43., -43., -43.], [-31., -31., -31., ..., -44., -44., -44.]], [[ -6., -6., -6., ..., -10., -10., -10.], [ -6., -6., -6., ..., -10., -10., -10.], [ -6., -6., -6., ..., -10., -10., -10.], ..., [-11., -11., -11., ..., -12., -12., -12.], [-11., -11., -11., ..., -12., -12., -12.], [-11., -11., -11., ..., -12., -12., -12.]], [[ -1., -1., -1., ..., 4., 4., 4.], [ -1., -1., -1., ..., 4., 4., 4.], [ -1., -1., -1., ..., 4., 4., 4.], ..., [ 7., 7., 7., ..., 7., 7., 7.], [ 7., 7., 7., ..., 7., 7., 7.], [ 7., 7., 7., ..., 7., 7., 7.]]]], dtype=float32), array([[[[ -56., -59., -64., ..., -125., -123., -120.], [ -55., -59., -64., ..., -122., -119., -117.], [ -55., -59., -64., ..., -117., -115., -115.], ..., [ -25., -24., -23., ..., -44., -45., -45.], [ -25., -24., -23., ..., -47., -48., -48.], [ -25., -24., -23., ..., -49., -50., -50.]], [[ 6., 6., 6., ..., -2., -2., -2.], [ 6., 6., 6., ..., -2., -2., -2.], [ 6., 6., 6., ..., -2., -2., -2.], ..., [ -11., -11., -11., ..., -15., -15., -15.], [ -11., -11., -11., ..., -16., -16., -16.], [ -11., -11., -11., ..., -16., -16., -16.]], [[ -18., -18., -18., ..., -3., -5., -5.], [ -18., -18., -18., ..., -3., -5., -5.], [ -18., -18., -18., ..., -5., -5., -5.], ..., [ -3., -3., -3., ..., 0., 0., 0.], [ -3., -3., -3., ..., -2., -2., -2.], [ -3., -3., -3., ..., -2., -2., -2.]]]], dtype=float32), array([[[[-10., -10., -10., ..., -49., -49., -49.], [-10., -10., -10., ..., -49., -49., -49.], [-10., -10., -10., ..., -49., -49., -49.], ..., [ -3., -2., -2., ..., -76., -76., -76.], [ -3., -2., -2., ..., -76., -76., -76.], [ -3., -2., -2., ..., -76., -76., -76.]], [[ -8., -8., -8., ..., -14., -14., -14.], [ -8., -8., -8., ..., -14., -14., -14.], [ -8., -8., -8., ..., -14., -14., -14.], ..., [ 1., 1., 1., ..., -2., -2., -2.], [ 1., 1., 1., ..., -2., -2., -2.], [ 1., 1., 1., ..., -2., -2., -2.]], [[ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -4., -4., -4.], ..., [ -5., -5., -5., ..., -1., -1., -1.], [ -5., -5., -5., ..., -1., -1., -1.], [ -5., -5., -5., ..., -1., -1., -1.]]]], dtype=float32), array([[[[-115., -114., -114., ..., -29., -43., -60.], [-114., -114., -113., ..., -24., -37., -50.], [-114., -114., -112., ..., -21., -31., -41.], ..., [ -17., -16., -16., ..., -114., -114., -114.], [ -16., -15., -15., ..., -114., -114., -114.], [ -15., -15., -15., ..., -115., -115., -115.]], [[ -3., -3., -1., ..., -20., -20., -20.], [ -3., -3., -1., ..., -20., -20., -20.], [ -3., -3., -1., ..., -19., -20., -20.], ..., [ 1., 1., 1., ..., -4., -4., -4.], [ 1., 1., 1., ..., -4., -4., -4.], [ 1., 1., 1., ..., -4., -4., -4.]], [[ -2., -2., -1., ..., 6., 5., 5.], [ -2., -2., -1., ..., 6., 5., 5.], [ -2., -2., -1., ..., 5., 4., 4.], ..., [ -7., -7., -7., ..., -4., -4., -4.], [ -8., -8., -8., ..., -4., -4., -4.], [ -8., -8., -8., ..., -4., -4., -4.]]]], dtype=float32), array([[[[ -59., -59., -59., ..., -111., -113., -126.], [ -59., -59., -58., ..., -108., -112., -127.], [ -59., -59., -58., ..., -105., -111., -127.], ..., [ -51., -50., -48., ..., -128., -128., -128.], [ -51., -50., -48., ..., -128., -128., -128.], [ -52., -51., -49., ..., -128., -128., -128.]], [[ -5., -5., -5., ..., -5., -2., -2.], [ -5., -5., -5., ..., -5., -2., -2.], [ -5., -5., -5., ..., -5., -2., -2.], ..., [ -2., -2., -2., ..., 0., 0., 0.], [ -2., -2., -2., ..., 0., 0., 0.], [ -2., -2., -2., ..., 0., 0., 0.]], [[ -5., -5., -5., ..., 0., 0., 0.], [ -5., -5., -5., ..., 0., 0., 0.], [ -5., -5., -5., ..., 0., 0., 0.], ..., [ -8., -8., -8., ..., 0., 0., 0.], [ -8., -8., -8., ..., 0., 0., 0.], [ -8., -8., -8., ..., 0., 0., 0.]]]], dtype=float32), array([[[[-45., -45., -45., ..., -52., -52., -53.], [-45., -45., -45., ..., -52., -52., -52.], [-45., -45., -45., ..., -51., -51., -51.], ..., [ 3., 2., 1., ..., -86., -86., -87.], [ 4., 3., 2., ..., -86., -86., -86.], [ 4., 3., 2., ..., -85., -85., -85.]], [[-25., -25., -25., ..., -16., -16., -16.], [-25., -25., -25., ..., -16., -16., -16.], [-26., -26., -26., ..., -16., -16., -16.], ..., [ 3., 3., 3., ..., 3., 3., 3.], [ 3., 3., 3., ..., 2., 2., 2.], [ 3., 3., 3., ..., 2., 2., 2.]], [[ 5., 5., 5., ..., -3., -3., -3.], [ 5., 5., 5., ..., -3., -3., -3.], [ 6., 6., 6., ..., -3., -3., -3.], ..., [-15., -15., -15., ..., -8., -8., -8.], [-13., -13., -13., ..., -6., -6., -6.], [-13., -13., -13., ..., -6., -6., -6.]]]], dtype=float32), array([[[[ 12., 12., 13., ..., -17., -16., -15.], [ 12., 12., 12., ..., -16., -16., -15.], [ 13., 13., 13., ..., -16., -16., -15.], ..., [ -16., -13., -13., ..., -115., -115., -115.], [ -16., -14., -15., ..., -115., -115., -115.], [ -15., -15., -16., ..., -114., -114., -114.]], [[ -12., -12., -13., ..., -6., -6., -6.], [ -12., -12., -13., ..., -6., -6., -6.], [ -13., -13., -13., ..., -6., -5., -5.], ..., [ 1., 1., 1., ..., -3., -3., -3.], [ 1., 1., 1., ..., -3., -3., -3.], [ 1., 1., 1., ..., -3., -3., -3.]], [[ 6., 6., 6., ..., -1., -1., -1.], [ 6., 6., 6., ..., -1., -1., -1.], [ 4., 4., 4., ..., -1., -1., -1.], ..., [ -6., -6., -6., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.]]]], dtype=float32), array([[[[125., 125., 125., ..., -16., -17., -17.], [124., 125., 126., ..., -15., -16., -16.], [123., 123., 124., ..., -15., -15., -16.], ..., [ -8., -8., -7., ..., -37., -40., -42.], [ -8., -8., -7., ..., -51., -54., -56.], [ -9., -8., -8., ..., -63., -66., -69.]], [[ -1., -1., 0., ..., -12., -12., -12.], [ -1., -1., 0., ..., -12., -12., -12.], [ 2., 2., 1., ..., -12., -12., -12.], ..., [ -2., -2., -2., ..., -1., -1., -1.], [ -2., -2., -2., ..., 1., 1., 1.], [ -2., -2., -2., ..., 1., 1., 1.]], [[ -3., -3., -2., ..., 2., 2., 2.], [ -3., -3., -2., ..., 2., 2., 2.], [ 2., 2., 1., ..., 1., 1., 1.], ..., [ -6., -6., -6., ..., -7., -6., -6.], [ -5., -5., -5., ..., -5., -4., -4.], [ -5., -5., -5., ..., -5., -4., -4.]]]], dtype=float32), array([[[[ -21., -21., -21., ..., -44., -48., -52.], [ -21., -21., -21., ..., -44., -48., -52.], [ -21., -21., -21., ..., -44., -48., -52.], ..., [ -44., -44., -44., ..., -106., -106., -106.], [ -44., -44., -44., ..., -105., -106., -106.], [ -44., -44., -44., ..., -104., -105., -105.]], [[ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.], ..., [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.]], [[ -1., -1., -1., ..., -5., -5., -5.], [ -1., -1., -1., ..., -5., -5., -5.], [ -1., -1., -1., ..., -5., -5., -5.], ..., [ -6., -6., -6., ..., -5., -5., -5.], [ -6., -6., -6., ..., -3., -3., -3.], [ -6., -6., -6., ..., -3., -3., -3.]]]], dtype=float32), array([[[[-103., -103., -103., ..., 12., 11., 10.], [-103., -103., -103., ..., 12., 11., 10.], [-104., -104., -104., ..., 12., 11., 10.], ..., [ -1., -1., 0., ..., -103., -103., -103.], [ -1., -1., -1., ..., -102., -102., -102.], [ -2., -1., -1., ..., -102., -102., -102.]], [[ -2., -2., -2., ..., -11., -11., -11.], [ -2., -2., -2., ..., -11., -11., -11.], [ -2., -2., -2., ..., -11., -11., -11.], ..., [ -7., -7., -6., ..., -6., -6., -6.], [ -7., -7., -7., ..., -5., -5., -5.], [ -7., -7., -7., ..., -5., -5., -5.]], [[ -1., -1., -1., ..., -3., -3., -3.], [ -1., -1., -1., ..., -3., -3., -3.], [ -2., -2., -2., ..., -3., -3., -3.], ..., [ -10., -10., -9., ..., -8., -8., -8.], [ -11., -11., -10., ..., -6., -6., -6.], [ -11., -11., -10., ..., -6., -6., -6.]]]], dtype=float32), array([[[[-100., -100., -100., ..., -97., -97., -97.], [ -99., -99., -99., ..., -97., -97., -97.], [ -98., -98., -99., ..., -97., -97., -97.], ..., [ -38., -38., -38., ..., -59., -61., -61.], [ -38., -38., -38., ..., -63., -64., -65.], [ -38., -38., -38., ..., -66., -67., -68.]], [[ 1., 1., 1., ..., -4., -7., -7.], [ 1., 1., 1., ..., -4., -7., -7.], [ 1., 1., 1., ..., -4., -7., -7.], ..., [ 0., 0., 0., ..., -2., -2., -2.], [ 0., 0., 0., ..., -2., -2., -2.], [ 0., 0., 0., ..., -2., -2., -2.]], [[ -5., -5., -5., ..., 0., 0., 0.], [ -5., -5., -5., ..., 0., 0., 0.], [ -5., -5., -5., ..., 0., 0., 0.], ..., [ -3., -3., -3., ..., -6., -6., -6.], [ -3., -3., -3., ..., -6., -6., -6.], [ -3., -3., -3., ..., -6., -6., -6.]]]], dtype=float32), array([[[[ -6., -22., -29., ..., -114., -114., -114.], [ -9., -17., -27., ..., -114., -114., -114.], [ -11., -17., -29., ..., -114., -114., -114.], ..., [ -11., -11., -10., ..., -72., -76., -76.], [ -12., -12., -11., ..., -92., -96., -96.], [ -13., -13., -12., ..., -108., -112., -112.]], [[ -20., -20., -19., ..., 0., 0., 0.], [ -20., -20., -19., ..., 0., 0., 0.], [ -20., -20., -20., ..., 0., 0., 0.], ..., [ 0., 0., 0., ..., -2., -3., -3.], [ 0., 0., 0., ..., -1., -1., -1.], [ 0., 0., 0., ..., -1., -1., -1.]], [[ 6., 6., 7., ..., 0., 0., 0.], [ 6., 6., 7., ..., 0., 0., 0.], [ 5., 5., 6., ..., 0., 0., 0.], ..., [ -9., -9., -9., ..., -7., -8., -8.], [ -9., -9., -9., ..., -8., -9., -9.], [ -9., -9., -9., ..., -8., -9., -9.]]]], dtype=float32), array([[[[ -77., -78., -79., ..., -57., -82., -93.], [ -77., -77., -77., ..., -60., -82., -91.], [ -77., -77., -76., ..., -71., -88., -94.], ..., [ -85., -83., -80., ..., -128., -128., -128.], [ -86., -83., -80., ..., -128., -128., -128.], [ -86., -83., -80., ..., -128., -128., -128.]], [[ -8., -8., -10., ..., 10., 10., 10.], [ -8., -8., -10., ..., 10., 10., 10.], [ -8., -8., -10., ..., 9., 10., 10.], ..., [ -24., -24., -25., ..., 0., 0., 0.], [ -24., -24., -25., ..., 1., 1., 1.], [ -24., -24., -25., ..., 1., 1., 1.]], [[ -16., -16., -16., ..., -25., -25., -25.], [ -16., -16., -16., ..., -25., -25., -25.], [ -15., -15., -15., ..., -21., -20., -20.], ..., [ 22., 22., 21., ..., 0., 0., 0.], [ 20., 20., 20., ..., -1., -1., -1.], [ 20., 20., 20., ..., -1., -1., -1.]]]], dtype=float32), array([[[[-113., -114., -115., ..., -114., -115., -115.], [-113., -114., -115., ..., -114., -114., -115.], [-114., -114., -114., ..., -114., -114., -115.], ..., [ -29., -29., -29., ..., -114., -114., -114.], [ -28., -28., -28., ..., -115., -115., -115.], [ -27., -27., -27., ..., -115., -115., -115.]], [[ -5., -5., -5., ..., -9., -8., -8.], [ -5., -5., -5., ..., -9., -8., -8.], [ -6., -6., -6., ..., -9., -8., -8.], ..., [ -2., -2., -2., ..., -4., -4., -4.], [ -2., -2., -2., ..., -4., -4., -4.], [ -2., -2., -2., ..., -4., -4., -4.]], [[ -6., -6., -6., ..., -8., -8., -8.], [ -6., -6., -6., ..., -8., -8., -8.], [ -8., -8., -9., ..., -8., -8., -8.], ..., [ -7., -7., -7., ..., -4., -4., -4.], [ -6., -6., -6., ..., -3., -3., -3.], [ -6., -6., -6., ..., -3., -3., -3.]]]], dtype=float32), array([[[[-115., -115., -115., ..., -16., -17., -17.], [-115., -115., -115., ..., -16., -17., -17.], [-115., -115., -115., ..., -16., -16., -17.], ..., [ -23., -23., -24., ..., -115., -115., -115.], [ -22., -24., -24., ..., -115., -115., -115.], [ -21., -23., -23., ..., -114., -114., -114.]], [[ -3., -3., -3., ..., -8., -10., -10.], [ -3., -3., -3., ..., -8., -10., -10.], [ -3., -3., -3., ..., -7., -9., -9.], ..., [ -4., -4., -5., ..., -4., -4., -4.], [ -9., -9., -7., ..., -4., -4., -4.], [ -9., -9., -7., ..., -4., -4., -4.]], [[ -3., -3., -3., ..., -1., -1., -1.], [ -3., -3., -3., ..., -1., -1., -1.], [ -3., -3., -3., ..., -2., -2., -2.], ..., [ -6., -6., -5., ..., -6., -6., -6.], [ -4., -4., -4., ..., -5., -5., -5.], [ -4., -4., -4., ..., -5., -5., -5.]]]], dtype=float32), array([[[[ 46., 46., 40., ..., -66., -62., -67.], [ 42., 44., 40., ..., -73., -71., -76.], [ 37., 42., 41., ..., -81., -82., -87.], ..., [ 15., 15., 16., ..., -93., -93., -93.], [ 14., 15., 16., ..., -93., -93., -93.], [ 13., 15., 17., ..., -93., -93., -93.]], [[-16., -16., -16., ..., -3., -5., -5.], [-16., -16., -16., ..., -3., -5., -5.], [-16., -16., -15., ..., -4., -4., -4.], ..., [ -3., -3., -3., ..., -6., -6., -6.], [ -3., -3., -3., ..., -5., -5., -5.], [ -3., -3., -3., ..., -5., -5., -5.]], [[ 4., 4., 4., ..., -6., -6., -6.], [ 4., 4., 4., ..., -6., -6., -6.], [ 4., 4., 4., ..., -6., -6., -6.], ..., [ -5., -5., -5., ..., -6., -6., -6.], [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.]]]], dtype=float32), array([[[[ -41., -41., -40., ..., -107., -106., -106.], [ -41., -41., -39., ..., -107., -106., -106.], [ -41., -40., -39., ..., -107., -106., -106.], ..., [ -13., -13., -13., ..., -107., -107., -107.], [ -13., -13., -13., ..., -107., -107., -107.], [ -13., -13., -13., ..., -107., -107., -107.]], [[ 0., 0., 1., ..., -7., -8., -8.], [ 0., 0., 1., ..., -7., -8., -8.], [ 0., 0., 1., ..., -7., -8., -8.], ..., [ -17., -17., -17., ..., -2., -2., -2.], [ -17., -17., -17., ..., -3., -3., -3.], [ -17., -17., -17., ..., -3., -3., -3.]], [[ -16., -16., -16., ..., -5., -5., -5.], [ -16., -16., -16., ..., -5., -5., -5.], [ -16., -16., -16., ..., -5., -5., -5.], ..., [ 2., 2., 2., ..., -3., -3., -3.], [ 2., 2., 2., ..., -3., -3., -3.], [ 2., 2., 2., ..., -3., -3., -3.]]]], dtype=float32), array([[[[ -25., -23., -24., ..., -69., -70., -70.], [ -22., -21., -22., ..., -68., -69., -70.], [ -21., -20., -20., ..., -67., -68., -69.], ..., [ -4., -3., -2., ..., -114., -115., -115.], [ -4., -3., -2., ..., -113., -115., -114.], [ -4., -3., -2., ..., -114., -115., -115.]], [[ -35., -35., -35., ..., -17., -17., -17.], [ -35., -35., -35., ..., -17., -17., -17.], [ -35., -35., -36., ..., -18., -18., -18.], ..., [ 5., 5., 5., ..., 3., 2., 2.], [ 5., 5., 5., ..., -2., -2., -2.], [ 5., 5., 5., ..., -2., -2., -2.]], [[ 16., 16., 17., ..., 0., 0., 0.], [ 16., 16., 17., ..., 0., 0., 0.], [ 16., 16., 17., ..., 0., 0., 0.], ..., [ -8., -8., -8., ..., -10., -8., -8.], [ -8., -8., -8., ..., -6., -5., -5.], [ -8., -8., -8., ..., -6., -5., -5.]]]], dtype=float32), array([[[[ -10., -8., -6., ..., -27., -28., -28.], [ -10., -8., -5., ..., -26., -27., -27.], [ -10., -8., -5., ..., -26., -26., -26.], ..., [ -26., -30., -30., ..., -128., -128., -128.], [ -24., -29., -29., ..., -128., -128., -128.], [ -22., -27., -28., ..., -128., -128., -128.]], [[ -16., -16., -16., ..., -11., -12., -12.], [ -16., -16., -16., ..., -11., -12., -12.], [ -16., -16., -16., ..., -11., -13., -13.], ..., [ -2., -2., -2., ..., 0., 0., 0.], [ 0., 0., 0., ..., 0., 0., 0.], [ 0., 0., 0., ..., 0., 0., 0.]], [[ 2., 2., 2., ..., -1., 0., 0.], [ 2., 2., 2., ..., -1., 0., 0.], [ 2., 2., 2., ..., -1., -1., -1.], ..., [ -10., -10., -10., ..., 0., 0., 0.], [ -10., -10., -10., ..., 0., 0., 0.], [ -10., -10., -10., ..., 0., 0., 0.]]]], dtype=float32), array([[[[-81., -88., -96., ..., -18., -9., -2.], [-80., -87., -96., ..., -19., -10., -3.], [-78., -86., -95., ..., -19., -11., -4.], ..., [-25., -25., -24., ..., -98., -98., -98.], [-25., -25., -24., ..., -98., -98., -98.], [-26., -25., -25., ..., -98., -98., -98.]], [[ -8., -8., -8., ..., -5., -4., -4.], [ -8., -8., -8., ..., -5., -4., -4.], [ -8., -8., -8., ..., -5., -5., -5.], ..., [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -5., -5., -5.], [ -3., -3., -3., ..., -5., -5., -5.]], [[ -8., -8., -6., ..., -10., -11., -11.], [ -8., -8., -6., ..., -10., -11., -11.], [ -8., -8., -6., ..., -10., -11., -11.], ..., [ -6., -6., -6., ..., -5., -5., -5.], [ -6., -6., -6., ..., -4., -4., -4.], [ -6., -6., -6., ..., -4., -4., -4.]]]], dtype=float32), array([[[[ -15., -15., -15., ..., -106., -97., -95.], [ -14., -14., -15., ..., -109., -101., -96.], [ -14., -14., -15., ..., -109., -106., -98.], ..., [ -44., -44., -44., ..., -128., -128., -128.], [ -44., -44., -44., ..., -128., -128., -128.], [ -44., -44., -44., ..., -128., -128., -128.]], [[ -17., -17., -17., ..., -12., -14., -14.], [ -17., -17., -17., ..., -12., -14., -14.], [ -17., -17., -17., ..., -11., -13., -13.], ..., [ -3., -3., -3., ..., 0., 0., 0.], [ -3., -3., -3., ..., 1., 1., 1.], [ -3., -3., -3., ..., 1., 1., 1.]], [[ 6., 6., 6., ..., -6., -4., -4.], [ 6., 6., 6., ..., -6., -4., -4.], [ 6., 6., 6., ..., -5., -4., -4.], ..., [ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., -1., -1., -1.], [ -6., -6., -6., ..., -1., -1., -1.]]]], dtype=float32), array([[[[ -88., -79., -82., ..., -85., -85., -85.], [ -72., -66., -71., ..., -85., -85., -85.], [ -54., -54., -60., ..., -85., -85., -85.], ..., [ -52., -51., -51., ..., -127., -126., -126.], [ -52., -51., -51., ..., -128., -127., -127.], [ -52., -51., -51., ..., -128., -128., -128.]], [[ -16., -16., -17., ..., -15., -15., -15.], [ -16., -16., -17., ..., -15., -15., -15.], [ -17., -17., -19., ..., -15., -15., -15.], ..., [ 6., 6., 6., ..., 3., 3., 3.], [ 6., 6., 6., ..., 0., 0., 0.], [ 6., 6., 6., ..., 0., 0., 0.]], [[ 9., 9., 10., ..., 1., 1., 1.], [ 9., 9., 10., ..., 1., 1., 1.], [ 6., 6., 9., ..., 1., 1., 1.], ..., [ -10., -10., -10., ..., -1., -1., -1.], [ -10., -10., -10., ..., -1., 0., 0.], [ -10., -10., -10., ..., -1., 0., 0.]]]], dtype=float32), array([[[[-87., -87., -86., ..., 26., 17., -3.], [-86., -86., -85., ..., 28., 19., 0.], [-85., -85., -85., ..., 29., 21., 2.], ..., [ 29., 29., 29., ..., -87., -87., -87.], [ 26., 27., 29., ..., -87., -87., -87.], [ 23., 26., 29., ..., -87., -87., -87.]], [[ -7., -7., -7., ..., -11., -11., -11.], [ -7., -7., -7., ..., -11., -11., -11.], [ -7., -7., -7., ..., -11., -11., -11.], ..., [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.]], [[ -6., -6., -6., ..., -1., -1., -1.], [ -6., -6., -6., ..., -1., -1., -1.], [ -6., -6., -7., ..., -1., -1., -1.], ..., [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -3., -3., -3.], [ -5., -5., -5., ..., -3., -3., -3.]]]], dtype=float32), array([[[[ -39., -39., -40., ..., -75., -75., -75.], [ -40., -40., -41., ..., -75., -75., -74.], [ -41., -41., -41., ..., -75., -74., -74.], ..., [ -56., -55., -54., ..., -114., -114., -114.], [ -55., -55., -54., ..., -114., -114., -114.], [ -54., -54., -54., ..., -114., -114., -114.]], [[ -4., -4., -4., ..., -27., -28., -28.], [ -4., -4., -4., ..., -27., -28., -28.], [ -4., -4., -4., ..., -25., -27., -27.], ..., [ -5., -5., -5., ..., -1., -1., -1.], [ -6., -6., -6., ..., 0., 0., 0.], [ -6., -6., -6., ..., 0., 0., 0.]], [[ -6., -6., -5., ..., 14., 14., 14.], [ -6., -6., -5., ..., 14., 14., 14.], [ -7., -7., -5., ..., 12., 12., 12.], ..., [ -8., -8., -8., ..., 0., 0., 0.], [ -7., -7., -8., ..., 0., 0., 0.], [ -7., -7., -8., ..., 0., 0., 0.]]]], dtype=float32), array([[[[ -31., -32., -33., ..., -71., -66., -65.], [ -30., -31., -32., ..., -70., -66., -66.], [ -30., -30., -31., ..., -70., -65., -66.], ..., [ -22., -21., -19., ..., -128., -128., -128.], [ -23., -22., -20., ..., -128., -128., -128.], [ -24., -23., -21., ..., -128., -128., -128.]], [[ -10., -10., -10., ..., -20., -20., -20.], [ -10., -10., -10., ..., -20., -20., -20.], [ -10., -10., -10., ..., -19., -19., -19.], ..., [ -4., -4., -4., ..., -1., -1., -1.], [ -4., -4., -4., ..., 0., 0., 0.], [ -4., -4., -4., ..., 0., 0., 0.]], [[ -3., -3., -3., ..., -5., -5., -5.], [ -3., -3., -3., ..., -5., -5., -5.], [ -3., -3., -3., ..., -5., -6., -6.], ..., [ -10., -10., -10., ..., 0., 0., 0.], [ -10., -10., -10., ..., 0., 0., 0.], [ -10., -10., -10., ..., 0., 0., 0.]]]], dtype=float32), array([[[[ -32., -32., -32., ..., -80., -80., -79.], [ -31., -31., -31., ..., -80., -79., -79.], [ -31., -32., -32., ..., -81., -80., -80.], ..., [ -1., -1., 1., ..., -128., -128., -128.], [ -3., -3., -1., ..., -128., -128., -128.], [ -4., -4., -2., ..., -127., -127., -127.]], [[ -55., -55., -55., ..., -25., -25., -25.], [ -55., -55., -55., ..., -25., -25., -25.], [ -54., -54., -54., ..., -26., -26., -26.], ..., [ 4., 4., 4., ..., 2., 3., 3.], [ 4., 4., 4., ..., -1., -1., -1.], [ 4., 4., 4., ..., -1., -1., -1.]], [[ 27., 27., 27., ..., 4., 4., 4.], [ 27., 27., 27., ..., 4., 4., 4.], [ 25., 25., 25., ..., 3., 3., 3.], ..., [ -10., -10., -10., ..., -1., -1., -1.], [ -10., -10., -10., ..., 0., 0., 0.], [ -10., -10., -10., ..., 0., 0., 0.]]]], dtype=float32), array([[[[ -60., -52., -41., ..., -52., -50., -48.], [ -59., -51., -40., ..., -48., -47., -47.], [ -58., -50., -40., ..., -43., -44., -44.], ..., [ -65., -65., -66., ..., -114., -114., -114.], [ -65., -65., -66., ..., -114., -114., -114.], [ -65., -65., -65., ..., -114., -114., -114.]], [[ -13., -13., -14., ..., -13., -11., -11.], [ -13., -13., -14., ..., -13., -11., -11.], [ -14., -14., -14., ..., -13., -11., -11.], ..., [ -7., -7., -7., ..., 0., 0., 0.], [ -7., -7., -7., ..., 0., 0., 0.], [ -7., -7., -7., ..., 0., 0., 0.]], [[ 2., 2., 3., ..., 1., 2., 2.], [ 2., 2., 3., ..., 1., 2., 2.], [ 2., 2., 3., ..., -2., -1., -1.], ..., [ -8., -8., -8., ..., -1., -1., -1.], [ -7., -7., -7., ..., 0., 0., 0.], [ -7., -7., -7., ..., 0., 0., 0.]]]], dtype=float32), array([[[[ -43., -43., -43., ..., -34., -35., -36.], [ -43., -43., -42., ..., -37., -38., -39.], [ -43., -42., -42., ..., -39., -41., -43.], ..., [ -45., -45., -46., ..., -128., -128., -128.], [ -47., -47., -48., ..., -128., -128., -128.], [ -48., -48., -49., ..., -128., -128., -128.]], [[ -11., -11., -11., ..., -25., -25., -25.], [ -11., -11., -11., ..., -25., -25., -25.], [ -11., -11., -11., ..., -25., -26., -26.], ..., [ -5., -5., -5., ..., 1., 1., 1.], [ -4., -4., -4., ..., 2., 2., 2.], [ -4., -4., -4., ..., 2., 2., 2.]], [[ -5., -5., -5., ..., 0., 2., 2.], [ -5., -5., -5., ..., 0., 2., 2.], [ -5., -5., -5., ..., 0., 0., 0.], ..., [ -14., -14., -14., ..., -1., -1., -1.], [ -13., -13., -13., ..., -1., -1., -1.], [ -13., -13., -13., ..., -1., -1., -1.]]]], dtype=float32), array([[[[-72., -72., -72., ..., 21., 21., 21.], [-72., -72., -72., ..., 21., 21., 21.], [-72., -72., -72., ..., 21., 21., 21.], ..., [ 8., 8., 8., ..., -13., -14., -15.], [ 8., 8., 8., ..., -16., -18., -20.], [ 8., 8., 8., ..., -19., -21., -23.]], [[ -3., -3., -3., ..., -11., -11., -11.], [ -3., -3., -3., ..., -11., -11., -11.], [ -3., -3., -3., ..., -11., -11., -11.], ..., [ 2., 2., 2., ..., 1., 1., 1.], [ 2., 2., 2., ..., 1., 1., 1.], [ 2., 2., 2., ..., 1., 1., 1.]], [[ -3., -3., -3., ..., 2., 2., 2.], [ -3., -3., -3., ..., 2., 2., 2.], [ -3., -3., -3., ..., 2., 2., 2.], ..., [ -6., -6., -6., ..., -5., -5., -5.], [ -6., -6., -6., ..., -5., -5., -5.], [ -6., -6., -6., ..., -5., -5., -5.]]]], dtype=float32), array([[[[ -14., -14., -14., ..., -18., -18., -18.], [ -14., -14., -14., ..., -18., -18., -18.], [ -14., -14., -14., ..., -18., -18., -18.], ..., [ -22., -22., -22., ..., -102., -102., -102.], [ -22., -22., -22., ..., -102., -102., -102.], [ -22., -22., -22., ..., -102., -102., -102.]], [[ -12., -12., -12., ..., -13., -13., -13.], [ -12., -12., -12., ..., -13., -13., -13.], [ -12., -12., -12., ..., -13., -13., -13.], ..., [ 0., 0., 0., ..., -7., -7., -7.], [ -1., -1., -1., ..., -7., -7., -7.], [ -1., -1., -1., ..., -7., -7., -7.]], [[ 4., 4., 4., ..., 3., 3., 3.], [ 4., 4., 4., ..., 3., 3., 3.], [ 4., 4., 4., ..., 3., 3., 3.], ..., [ -5., -5., -5., ..., -6., -6., -6.], [ -3., -3., -3., ..., -6., -6., -6.], [ -3., -3., -3., ..., -6., -6., -6.]]]], dtype=float32), array([[[[ 30., 30., 30., ..., 6., 6., 6.], [ 28., 29., 29., ..., 6., 6., 6.], [ 26., 27., 27., ..., 6., 6., 6.], ..., [ 4., 5., 5., ..., -73., -73., -73.], [ 4., 5., 5., ..., -73., -73., -73.], [ 4., 5., 5., ..., -73., -73., -73.]], [[-11., -11., -11., ..., -6., -6., -6.], [-11., -11., -11., ..., -6., -6., -6.], [-12., -12., -12., ..., -6., -6., -6.], ..., [ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -4., -4., -4.]], [[ 5., 5., 5., ..., 0., 0., 0.], [ 5., 5., 5., ..., 0., 0., 0.], [ 4., 4., 4., ..., 0., 0., 0.], ..., [ -5., -5., -5., ..., -6., -6., -6.], [ -5., -5., -5., ..., -5., -5., -5.], [ -5., -5., -5., ..., -5., -5., -5.]]]], dtype=float32), array([[[[ 3., 3., 3., ..., -87., -95., -99.], [ 3., 3., 3., ..., -88., -94., -97.], [ 4., 4., 4., ..., -89., -94., -95.], ..., [-13., -13., -13., ..., -59., -60., -62.], [-13., -13., -13., ..., -69., -72., -73.], [-13., -14., -14., ..., -77., -80., -81.]], [[-12., -12., -12., ..., -6., -5., -5.], [-12., -12., -12., ..., -6., -5., -5.], [-13., -13., -13., ..., -6., -5., -5.], ..., [ 1., 1., 1., ..., 0., 0., 0.], [ 2., 2., 2., ..., 0., 0., 0.], [ 2., 2., 2., ..., 0., 0., 0.]], [[ 2., 2., 2., ..., -6., -6., -6.], [ 2., 2., 2., ..., -6., -6., -6.], [ 3., 3., 3., ..., -6., -6., -6.], ..., [ -5., -5., -5., ..., -8., -8., -8.], [ -5., -5., -5., ..., -8., -8., -8.], [ -5., -5., -5., ..., -8., -8., -8.]]]], dtype=float32), array([[[[ -12., -18., -17., ..., -23., -23., -24.], [ -13., -17., -17., ..., -21., -22., -22.], [ -14., -15., -17., ..., -20., -20., -21.], ..., [ -22., -19., -17., ..., -114., -114., -114.], [ -22., -18., -15., ..., -114., -114., -114.], [ -22., -17., -14., ..., -115., -115., -115.]], [[ -7., -7., -8., ..., -10., -10., -10.], [ -7., -7., -8., ..., -10., -10., -10.], [ -7., -7., -8., ..., -10., -10., -10.], ..., [ 1., 1., 1., ..., -3., -3., -3.], [ 1., 1., 1., ..., -3., -3., -3.], [ 1., 1., 1., ..., -3., -3., -3.]], [[ -3., -3., -2., ..., 0., 0., 0.], [ -3., -3., -2., ..., 0., 0., 0.], [ -3., -3., -2., ..., -1., -1., -1.], ..., [ -10., -10., -10., ..., -4., -4., -4.], [ -11., -11., -11., ..., -4., -4., -4.], [ -11., -11., -11., ..., -4., -4., -4.]]]], dtype=float32), array([[[[-100., -99., -97., ..., -44., -45., -46.], [ -99., -98., -97., ..., -44., -45., -46.], [ -99., -98., -97., ..., -44., -45., -46.], ..., [ 7., 7., 7., ..., -97., -97., -98.], [ 7., 7., 7., ..., -97., -98., -97.], [ 7., 7., 7., ..., -96., -96., -96.]], [[ -7., -7., -7., ..., 2., 2., 2.], [ -7., -7., -7., ..., 2., 2., 2.], [ -7., -7., -7., ..., 3., 3., 3.], ..., [ -11., -11., -11., ..., -7., -7., -7.], [ -11., -11., -11., ..., -6., -6., -6.], [ -11., -11., -11., ..., -6., -6., -6.]], [[ -6., -6., -6., ..., -11., -11., -11.], [ -6., -6., -6., ..., -11., -11., -11.], [ -6., -6., -6., ..., -11., -11., -11.], ..., [ -3., -3., -3., ..., -4., -4., -4.], [ -3., -3., -3., ..., -5., -5., -5.], [ -3., -3., -3., ..., -5., -5., -5.]]]], dtype=float32), array([[[[ -76., -76., -75., ..., -84., -83., -83.], [ -80., -80., -79., ..., -84., -83., -83.], [ -85., -85., -85., ..., -84., -83., -83.], ..., [ -17., -17., -17., ..., -128., -128., -128.], [ -17., -17., -17., ..., -128., -128., -128.], [ -17., -17., -17., ..., -128., -128., -128.]], [[ -25., -25., -25., ..., -20., -20., -20.], [ -25., -25., -25., ..., -20., -20., -20.], [ -22., -22., -22., ..., -20., -20., -20.], ..., [ 1., 1., 1., ..., 2., 2., 2.], [ 1., 1., 1., ..., 0., 0., 0.], [ 1., 1., 1., ..., 0., 0., 0.]], [[ 4., 4., 4., ..., -3., -4., -4.], [ 4., 4., 4., ..., -3., -4., -4.], [ 3., 3., 3., ..., -3., -4., -4.], ..., [ -10., -10., -8., ..., -2., -1., -1.], [ -10., -10., -8., ..., 0., 0., 0.], [ -10., -10., -8., ..., 0., 0., 0.]]]], dtype=float32), array([[[[ 8., 8., 9., ..., -19., -19., -19.], [ 9., 9., 9., ..., -18., -18., -18.], [ 9., 9., 9., ..., -17., -17., -17.], ..., [ -29., -26., -24., ..., -115., -115., -115.], [ -27., -25., -23., ..., -115., -115., -115.], [ -26., -24., -22., ..., -115., -115., -115.]], [[ -12., -12., -14., ..., -8., -7., -7.], [ -12., -12., -14., ..., -8., -7., -7.], [ -13., -13., -14., ..., -8., -7., -7.], ..., [ -4., -4., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.], [ -3., -3., -3., ..., -3., -3., -3.]], [[ 5., 5., 4., ..., 0., 0., 0.], [ 5., 5., 4., ..., 0., 0., 0.], [ 4., 4., 4., ..., -1., -1., -1.], ..., [ -9., -9., -7., ..., -4., -4., -4.], [ -9., -9., -7., ..., -3., -3., -3.], [ -9., -9., -7., ..., -3., -3., -3.]]]], dtype=float32), array([[[[-128., -128., -128., ..., -53., -53., -56.], [-127., -127., -128., ..., -53., -53., -55.], [-125., -125., -126., ..., -53., -52., -55.], ..., [ -25., -29., -32., ..., -128., -128., -128.], [ -26., -29., -33., ..., -128., -128., -128.], [ -25., -29., -33., ..., -128., -128., -128.]], [[ 2., 2., 2., ..., -7., -10., -10.], [ 2., 2., 2., ..., -7., -10., -10.], [ 2., 2., 2., ..., -7., -8., -8.], ..., [ -22., -22., -22., ..., 1., 1., 1.], [ -23., -23., -23., ..., 0., 0., 0.], [ -23., -23., -23., ..., 0., 0., 0.]], [[ -1., -1., -1., ..., -8., -8., -8.], [ -1., -1., -1., ..., -8., -8., -8.], [ -1., -1., -1., ..., -8., -8., -8.], ..., [ 4., 4., 4., ..., -1., -1., -1.], [ 4., 4., 4., ..., 0., 0., 0.], [ 4., 4., 4., ..., 0., 0., 0.]]]], dtype=float32)]}}, 'hbdk_dict': {'hbdk_pass_through_params': '--O3 --debug --core-num 1 --fast --jobs 8 ', 'input-source': {'images': 'pyramid', '_default_value': 'ddr'}}, 'node_dict': {}, 'check_mode': False, 'optimization': ['set_Softmax_input_int8,set_Softmax_output_int8']} 2026-08-07 10:39:58,490 file: model_builder.py func: model_builder line No: 35 Start to Horizon NN Model Convert. 2026-08-07 10:39:58,520 file: model_debugger.py func: model_debugger line No: 67 Loading horizon_nn debug methods:set() 2026-08-07 10:39:58,522 file: quantization_config.py func: quantization_config line No: 305 The activation calibration parameters: calibration_type: ['max', 'kl'] max_percentile: [0.99995, 1.0] per_channel: [True, False] asymmetric: [True, False] The modelwise search parameters: similarity: 0.995 metric: cosine-similarity The input of all Softmax nodes are set to : int8 2026-08-07 10:39:58,523 file: input_dict_parser.py func: input_dict_parser line No: 240 input images is from pyramid. Its layout is set to NHWC 2026-08-07 10:39:58,524 file: model_builder.py func: model_builder line No: 197 The specified model compilation architecture: bayes-e. 2026-08-07 10:39:58,524 file: model_builder.py func: model_builder line No: 207 The specified model compilation optimization parameters: []. 2026-08-07 10:39:58,525 file: model_builder.py func: model_builder line No: 35 Start to prepare the onnx model. 2026-08-07 10:39:58,609 file: prepare.py func: prepare line No: 106 Input ONNX Model Information: ONNX IR version: 6 Opset version: ['ai.onnx v11', 'horizon v1'] Producer: onnx.utils.extract_model Domain: None Version: None Graph input: images: shape=[1, 3, 640, 640], dtype=FLOAT32 Graph output: cls_s8: shape=[1, 80, 80, 4], dtype=FLOAT32 box_s8: shape=[1, 80, 80, 4], dtype=FLOAT32 cls_s16: shape=[1, 40, 40, 4], dtype=FLOAT32 box_s16: shape=[1, 40, 40, 4], dtype=FLOAT32 cls_s32: shape=[1, 20, 20, 4], dtype=FLOAT32 box_s32: shape=[1, 20, 20, 4], dtype=FLOAT32 2026-08-07 10:39:58,982 file: model_builder.py func: model_builder line No: 38 End to prepare the onnx model. 2026-08-07 10:39:59,024 file: model_builder.py func: model_builder line No: 265 Saving model to: best_bpu_bayese_640x640_nv12_original_float_model.onnx. 2026-08-07 10:39:59,025 file: model_builder.py func: model_builder line No: 35 Start to optimize the onnx model. 2026-08-07 10:39:59,210 file: constant_folding.py func: constant_folding line No: 66 Summary info for constant_folding: 2026-08-07 10:39:59,210 file: constant_folding.py func: constant_folding line No: 67 After constant_folding, the number of nodes has changed from 356 to 356. 2026-08-07 10:39:59,210 file: constant_folding.py func: constant_folding line No: 71 After constant_folding, the number of parameters has changed from 2375641 to 2375641. 2026-08-07 10:39:59,210 file: constant_folding.py func: constant_folding line No: 76 Detailed info for constant_folding: 2026-08-07 10:39:59,211 file: constant_folding.py func: constant_folding line No: 88 2026-08-07 10:39:59,714 file: model_builder.py func: model_builder line No: 38 End to optimize the onnx model. 2026-08-07 10:39:59,751 file: model_builder.py func: model_builder line No: 265 Saving model to: best_bpu_bayese_640x640_nv12_optimized_float_model.onnx. 2026-08-07 10:39:59,752 file: model_builder.py func: model_builder line No: 35 Start to calibrate the model. 2026-08-07 10:40:00,033 file: calibration_data_set.py func: calibration_data_set line No: 111 input name: images, number_of_samples: 50 2026-08-07 10:40:00,033 file: calibration_data_set.py func: calibration_data_set line No: 123 There are 50 samples in the data set. 2026-08-07 10:40:00,034 file: infer_thresholds.py func: infer_thresholds line No: 84 Run calibration model with modelwise search method. 2026-08-07 10:40:00,536 file: base.py func: base line No: 138 Calibration using batch 8 2026-08-07 10:40:05,981 file: ort.py func: ort line No: 207 Reset batch_size=1 and execute forward again... 2026-08-07 10:46:16,933 file: base.py func: base line No: 138 Calibration using batch 8 2026-08-07 10:46:18,673 file: ort.py func: ort line No: 207 Reset batch_size=1 and execute forward again... 2026-08-07 10:46:36,389 file: base.py func: base line No: 138 Calibration using batch 8 2026-08-07 10:46:41,254 file: ort.py func: ort line No: 207 Reset batch_size=1 and execute forward again... 2026-08-07 10:53:54,824 file: modelwise_search.py func: modelwise_search line No: 75 Select max-percentile:percentile=0.99995 method. 2026-08-07 10:53:55,891 file: model_builder.py func: model_builder line No: 38 End to calibrate the model. 2026-08-07 10:53:56,028 file: model_builder.py func: model_builder line No: 265 Saving model to: best_bpu_bayese_640x640_nv12_calibrated_model.onnx. 2026-08-07 10:53:56,028 file: model_builder.py func: model_builder line No: 35 Start to quantize the model. 2026-08-07 10:53:58,869 file: constant_folding.py func: constant_folding line No: 66 Summary info for constant_folding: 2026-08-07 10:53:58,869 file: constant_folding.py func: constant_folding line No: 67 After constant_folding, the number of nodes has changed from 309 to 309. 2026-08-07 10:53:58,869 file: constant_folding.py func: constant_folding line No: 71 After constant_folding, the number of parameters has changed from 2407371 to 2407371. 2026-08-07 10:53:58,870 file: constant_folding.py func: constant_folding line No: 76 Detailed info for constant_folding: 2026-08-07 10:53:58,870 file: constant_folding.py func: constant_folding line No: 88 2026-08-07 10:53:59,227 file: model_builder.py func: model_builder line No: 38 End to quantize the model. 2026-08-07 10:53:59,354 file: model_builder.py func: model_builder line No: 265 Saving model to: best_bpu_bayese_640x640_nv12_quantized_model.onnx. 2026-08-07 10:53:59,355 file: model_builder.py func: model_builder line No: 35 Start to compile the model with march bayes-e. 2026-08-07 10:54:00,099 file: hybrid_build.py func: hybrid_build line No: 111 Compile submodel: Extracted from {main_graph}_subgraph_0 2026-08-07 10:54:00,148 file: hbdk_cc.py func: hbdk_cc line No: 126 hbdk-cc parameters:['--O3', '--debug', '--core-num', '1', '--fast', '--jobs', '8', '--input-layout', 'NHWC', '--output-layout', 'NHWC', '--input-source', 'pyramid'] 2026-08-07 10:54:00,149 file: hbdk_cc.py func: hbdk_cc line No: 127 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmpn1xm3lyk/Extracted from {main_graph}_subgraph_0.hbir -o /tmp/tmpn1xm3lyk/Extracted from {main_graph}_subgraph_0.hbm --march bayes-e --progressbar --O3 --debug --core-num 1 --fast --jobs 8 --input-layout NHWC --output-layout NHWC --input-source pyramid 2026-08-07 10:59:35,665 file: tool_utils.py func: tool_utils line No: 326 consumed time 335.296 2026-08-07 10:59:35,998 file: tool_utils.py func: tool_utils line No: 326 FPS=112.19, latency = 8913.1 us, DDR = 20676096 bytes (see Extracted from {main_graph}_subgraph_0.html) 2026-08-07 10:59:36,279 file: model_builder.py func: model_builder line No: 38 End to compile the model with march bayes-e. 2026-08-07 10:59:40,750 file: print_info_dict.py func: print_info_dict line No: 72 The main quantized node information: ====================================================================================================================================== Node ON Subgraph Type Cosine Similarity Threshold DataType -------------------------------------------------------------------------------------------------------------------------------------- HZ_PREPROCESS_FOR_images BPU id(0) HzSQuantizedPreprocess 1.000036 127.0 int8 /model.0/conv/Conv BPU id(0) HzSQuantizedConv 0.999420 1.01336 int8 /model.0/act/Mul BPU id(0) HzLut 0.999356 41.2085 int8 /model.1/conv/Conv BPU id(0) HzSQuantizedConv 0.994858 34.6575 int8 /model.1/act/Mul BPU id(0) HzLut 0.994586 77.3055 int8 /model.2/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.988316 61.1196 int8 /model.2/cv1/act/Mul BPU id(0) HzLut 0.988277 58.76 int8 /model.2/Split BPU id(0) Split 0.987462 41.5502 int8 /model.2/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.997807 41.5502 int8 /model.2/m.0/cv1/act/Mul BPU id(0) HzLut 0.997295 6.48102 int8 /model.2/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.979294 4.49225 int8 /model.2/m.0/cv2/act/Mul BPU id(0) HzLut 0.984540 38.6259 int8 /model.2/m.0/Add BPU id(0) HzSElementwiseAdd 0.989001 41.5502 int8 /model.2/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.2/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.2/Concat BPU id(0) Concat 0.988635 41.5502 int8 /model.2/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.984512 42.3831 int8 /model.2/cv2/act/Mul BPU id(0) HzLut 0.983102 46.6969 int8 /model.3/conv/Conv BPU id(0) HzSQuantizedConv 0.990522 13.5453 int8 /model.3/act/Mul BPU id(0) HzLut 0.994629 8.41636 int8 /model.4/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.993375 7.23656 int8 /model.4/cv1/act/Mul BPU id(0) HzLut 0.993696 6.07195 int8 /model.4/Split BPU id(0) Split 0.992764 4.76361 int8 /model.4/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.993655 4.76361 int8 /model.4/m.0/cv1/act/Mul BPU id(0) HzLut 0.994053 4.97631 int8 /model.4/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.994427 4.93203 int8 /model.4/m.0/cv2/act/Mul BPU id(0) HzLut 0.994242 5.89425 int8 /model.4/m.0/Add BPU id(0) HzSElementwiseAdd 0.996519 4.76361 int8 /model.4/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.4/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.4/Concat BPU id(0) Concat 0.995726 4.76361 int8 /model.4/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.986882 6.03048 int8 /model.4/cv2/act/Mul BPU id(0) HzLut 0.984009 5.65269 int8 /model.5/conv/Conv BPU id(0) HzSQuantizedConv 0.993324 3.11747 int8 /model.5/act/Mul BPU id(0) HzLut 0.995369 5.72607 int8 /model.6/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.989999 5.04224 int8 /model.6/cv1/act/Mul BPU id(0) HzLut 0.991192 7.17241 int8 /model.6/Split BPU id(0) Split 0.991260 4.80649 int8 /model.6/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.993373 4.80649 int8 /model.6/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.986195 4.80649 int8 /model.6/m.0/cv1/act/Mul BPU id(0) HzLut 0.994111 3.73626 int8 /model.6/m.0/cv2/act/Mul BPU id(0) HzLut 0.985150 9.58291 int8 /model.6/m.0/m/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.991013 3.62476 int8 /model.6/m.0/m/m.0/cv1/act/Mul BPU id(0) HzLut 0.986674 6.74554 int8 /model.6/m.0/m/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.992821 5.26864 int8 /model.6/m.0/m/m.0/cv2/act/Mul BPU id(0) HzLut 0.993137 5.39304 int8 /model.6/m.0/m/m.0/Add BPU id(0) HzSElementwiseAdd 0.994573 3.62476 int8 /model.6/m.0/m/m.1/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.993472 4.86168 int8 /model.6/m.0/m/m.1/cv1/act/Mul BPU id(0) HzLut 0.992689 6.3859 int8 /model.6/m.0/m/m.1/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.998122 5.83982 int8 /model.6/m.0/m/m.1/cv2/act/Mul BPU id(0) HzLut 0.998130 9.77582 int8 /model.6/m.0/m/m.1/Add BPU id(0) HzSElementwiseAdd 0.998146 4.86168 int8 /model.6/m.0/Concat BPU id(0) Concat 0.997356 10.3462 int8 /model.6/m.0/cv3/conv/Conv BPU id(0) HzSQuantizedConv 0.993489 10.3462 int8 /model.6/m.0/cv3/act/Mul BPU id(0) HzLut 0.993455 7.45905 int8 /model.6/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.6/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.6/Concat BPU id(0) Concat 0.991860 4.80649 int8 /model.6/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.993102 5.02755 int8 /model.6/cv2/act/Mul BPU id(0) HzLut 0.990361 5.64807 int8 /model.7/conv/Conv BPU id(0) HzSQuantizedConv 0.995391 4.31525 int8 /model.7/act/Mul BPU id(0) HzLut 0.994359 7.36703 int8 /model.8/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.994277 4.54333 int8 /model.8/cv1/act/Mul BPU id(0) HzLut 0.992696 7.17016 int8 /model.8/Split BPU id(0) Split 0.992823 5.70526 int8 /model.8/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.996304 5.70526 int8 /model.8/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.990640 5.70526 int8 /model.8/m.0/cv1/act/Mul BPU id(0) HzLut 0.995520 4.21313 int8 /model.8/m.0/cv2/act/Mul BPU id(0) HzLut 0.988557 7.71699 int8 /model.8/m.0/m/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.997284 3.9048 int8 /model.8/m.0/m/m.0/cv1/act/Mul BPU id(0) HzLut 0.995017 7.82275 int8 /model.8/m.0/m/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.997509 7.27338 int8 /model.8/m.0/m/m.0/cv2/act/Mul BPU id(0) HzLut 0.997249 7.33082 int8 /model.8/m.0/m/m.0/Add BPU id(0) HzSElementwiseAdd 0.996879 3.9048 int8 /model.8/m.0/m/m.1/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.997167 7.49653 int8 /model.8/m.0/m/m.1/cv1/act/Mul BPU id(0) HzLut 0.996851 8.25873 int8 /model.8/m.0/m/m.1/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.998135 6.03099 int8 /model.8/m.0/m/m.1/cv2/act/Mul BPU id(0) HzLut 0.998254 10.5517 int8 /model.8/m.0/m/m.1/Add BPU id(0) HzSElementwiseAdd 0.998381 7.49653 int8 /model.8/m.0/Concat BPU id(0) Concat 0.997609 11.6159 int8 /model.8/m.0/cv3/conv/Conv BPU id(0) HzSQuantizedConv 0.996679 11.6159 int8 /model.8/m.0/cv3/act/Mul BPU id(0) HzLut 0.996159 6.92246 int8 /model.8/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.8/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.8/Concat BPU id(0) Concat 0.994004 5.70526 int8 /model.8/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.997247 5.78612 int8 /model.8/cv2/act/Mul BPU id(0) HzLut 0.996791 6.22125 int8 /model.9/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.993064 4.67106 int8 /model.9/m/MaxPool BPU id(0) HzQuantizedMaxPool 0.997418 9.42579 int8 /model.9/m_1/MaxPool BPU id(0) HzQuantizedMaxPool 0.998335 9.42579 int8 /model.9/m_2/MaxPool BPU id(0) HzQuantizedMaxPool 0.998701 9.42579 int8 /model.9/Concat BPU id(0) Concat 0.997993 9.42579 int8 /model.9/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.997652 9.42579 int8 /model.9/cv2/act/Mul BPU id(0) HzLut 0.994045 8.49893 int8 /model.9/Add BPU id(0) HzSElementwiseAdd 0.996028 5.19398 int8 /model.10/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.994108 5.83835 int8 /model.10/cv1/act/Mul BPU id(0) HzLut 0.994353 8.82042 int8 /model.10/Split BPU id(0) Split 0.991083 7.54646 int8 /model.10/m/m.0/attn/qkv/conv/Conv BPU id(0) HzSQuantizedConv 0.992373 7.54646 int8 /model.10/m/m.0/attn/Reshape BPU id(0) Reshape 0.992373 8.119 int8 /model.10/m/m.0/attn/Split BPU id(0) Split 0.995160 8.119 int8 /model.10/m/m.0/attn/Mul BPU id(0) HzSQuantizedConv 0.995104 8.119 int8 /model.10/m/m.0/attn/Reshape_2 BPU id(0) Reshape 0.991116 8.119 int8 /model.10/m/m.0/attn/Transpose BPU id(0) Transpose 0.995105 0.911441 int8 /model.10/m/m.0/attn/MatMul BPU id(0) HzSQuantizedMatmul 0.995910 0.911441 int8 ...0/attn/Softmax_reducemax_FROM_QUANTIZED_SOFTMAX BPU id(0) HzQuantizedReduceMax 0.999018 12.2527 int8 ...0/m/m.0/attn/Softmax_sub_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSElementwiseSub 0.944868 12.2527 int8 ...0/m/m.0/attn/Softmax_exp_FROM_QUANTIZED_SOFTMAX BPU id(0) HzLut 0.984749 5.64418 int8 ...0/attn/Softmax_reducesum_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSQuantizedReduceSum 0.993399 1.0 int8 .../attn/Softmax_reciprocal_FROM_QUANTIZED_SOFTMAX BPU id(0) HzLut 0.983322 207.972 int8 ...0/m/m.0/attn/Softmax_mul_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSElementwiseMul 0.979322 1.0 int8 /model.10/m/m.0/attn/Transpose_1 BPU id(0) Transpose 0.979315 0.208394 int8 /model.10/m/m.0/attn/MatMul_1 BPU id(0) HzSQuantizedMatmul 0.986326 8.119 int8 /model.10/m/m.0/attn/Reshape_1 BPU id(0) Reshape 0.986326 6.74763 int8 /model.10/m/m.0/attn/pe/conv/Conv BPU id(0) HzSQuantizedConv 0.987866 8.119 int8 /model.10/m/m.0/attn/proj/conv/Conv BPU id(0) HzSQuantizedConv 0.972852 5.45386 int8 /model.10/m/m.0/ffn/ffn.0/conv/Conv BPU id(0) HzSQuantizedConv 0.997112 7.28631 int8 /model.10/m/m.0/ffn/ffn.0/act/Mul BPU id(0) HzLut 0.995281 6.09157 int8 /model.10/m/m.0/ffn/ffn.1/conv/Conv BPU id(0) HzSQuantizedConv 0.962171 2.35477 int8 /model.10/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.10/Concat BPU id(0) Concat 0.987183 7.54646 int8 /model.10/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.994216 7.80393 int8 /model.10/cv2/act/Mul BPU id(0) HzLut 0.985009 9.20764 int8 /model.11/Resize BPU id(0) HzQuantizedResizeUpsample 0.985121 6.38025 int8 /model.11/Resize_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 ...el.6/cv2/act/Mul_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.12/Concat BPU id(0) Concat 0.985989 6.38025 int8 /model.13/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.989979 5.98782 int8 /model.13/cv1/act/Mul BPU id(0) HzLut 0.990556 6.54691 int8 /model.13/Split BPU id(0) Split 0.991098 4.74548 int8 /model.13/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.983283 4.74548 int8 /model.13/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.982005 4.74548 int8 /model.13/m.0/cv1/act/Mul BPU id(0) HzLut 0.982556 3.17934 int8 /model.13/m.0/cv2/act/Mul BPU id(0) HzLut 0.976270 7.26857 int8 /model.13/m.0/m/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.975905 2.79956 int8 /model.13/m.0/m/m.0/cv1/act/Mul BPU id(0) HzLut 0.963430 6.14238 int8 /model.13/m.0/m/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.975685 4.78456 int8 /model.13/m.0/m/m.0/cv2/act/Mul BPU id(0) HzLut 0.978614 6.78521 int8 /model.13/m.0/m/m.0/Add BPU id(0) HzSElementwiseAdd 0.980074 2.79956 int8 /model.13/m.0/m/m.1/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.973039 7.64293 int8 /model.13/m.0/m/m.1/cv1/act/Mul BPU id(0) HzLut 0.964364 5.96029 int8 /model.13/m.0/m/m.1/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.990541 4.29817 int8 /model.13/m.0/m/m.1/cv2/act/Mul BPU id(0) HzLut 0.990215 8.55439 int8 /model.13/m.0/m/m.1/Add BPU id(0) HzSElementwiseAdd 0.991257 7.64293 int8 /model.13/m.0/Concat BPU id(0) Concat 0.990729 11.0968 int8 /model.13/m.0/cv3/conv/Conv BPU id(0) HzSQuantizedConv 0.968278 11.0968 int8 /model.13/m.0/cv3/act/Mul BPU id(0) HzLut 0.954794 7.18235 int8 /model.13/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.13/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.13/Concat BPU id(0) Concat 0.982025 4.74548 int8 /model.13/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.980723 5.11903 int8 /model.13/cv2/act/Mul BPU id(0) HzLut 0.974762 7.49102 int8 /model.14/Resize BPU id(0) HzQuantizedResizeUpsample 0.974785 5.99656 int8 /model.14/Resize_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 ...el.4/cv2/act/Mul_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.15/Concat BPU id(0) Concat 0.977316 5.99656 int8 /model.16/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.990095 5.73912 int8 /model.16/cv1/act/Mul BPU id(0) HzLut 0.992167 4.04101 int8 /model.16/Split BPU id(0) Split 0.993017 3.8716 int8 /model.16/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.985172 3.8716 int8 /model.16/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.985501 3.8716 int8 /model.16/m.0/cv1/act/Mul BPU id(0) HzLut 0.989360 1.83598 int8 /model.16/m.0/cv2/act/Mul BPU id(0) HzLut 0.987262 5.85223 int8 /model.16/m.0/m/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.958495 1.56502 int8 /model.16/m.0/m/m.0/cv1/act/Mul BPU id(0) HzLut 0.962332 5.35932 int8 /model.16/m.0/m/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.950040 5.29731 int8 /model.16/m.0/m/m.0/cv2/act/Mul BPU id(0) HzLut 0.953116 6.3569 int8 /model.16/m.0/m/m.0/Add BPU id(0) HzSElementwiseAdd 0.963347 1.56502 int8 /model.16/m.0/m/m.1/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.964610 6.36076 int8 /model.16/m.0/m/m.1/cv1/act/Mul BPU id(0) HzLut 0.977967 6.51813 int8 /model.16/m.0/m/m.1/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.982150 4.79099 int8 /model.16/m.0/m/m.1/cv2/act/Mul BPU id(0) HzLut 0.984414 14.0709 int8 /model.16/m.0/m/m.1/Add BPU id(0) HzSElementwiseAdd 0.983990 6.36076 int8 /model.16/m.0/Concat BPU id(0) Concat 0.984136 14.4058 int8 /model.16/m.0/cv3/conv/Conv BPU id(0) HzSQuantizedConv 0.957334 14.4058 int8 /model.16/m.0/cv3/act/Mul BPU id(0) HzLut 0.965743 8.3484 int8 /model.16/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.16/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.16/Concat BPU id(0) Concat 0.977148 3.8716 int8 /model.16/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.964487 7.16826 int8 /model.16/cv2/act/Mul BPU id(0) HzLut 0.978834 11.6113 int8 /model.17/conv/Conv BPU id(0) HzSQuantizedConv 0.950695 5.13052 int8 /model.23/one2one_cv2.0/one2one_cv2.0.0/conv/Conv BPU id(0) HzSQuantizedConv 0.984795 5.13052 int8 ...3.0/one2one_cv3.0.0/one2one_cv3.0.0.0/conv/Conv BPU id(0) HzSQuantizedConv 0.987580 5.13052 int8 /model.17/act/Mul BPU id(0) HzLut 0.930396 6.96564 int8 /model.23/one2one_cv2.0/one2one_cv2.0.0/act/Mul BPU id(0) HzLut 0.985999 13.2136 int8 ...cv3.0/one2one_cv3.0.0/one2one_cv3.0.0.0/act/Mul BPU id(0) HzLut 0.987856 20.7502 int8 /model.18/Concat BPU id(0) Concat 0.951447 5.99656 int8 /model.23/one2one_cv2.0/one2one_cv2.0.1/conv/Conv BPU id(0) HzSQuantizedConv 0.967557 13.1305 int8 ...3.0/one2one_cv3.0.0/one2one_cv3.0.0.1/conv/Conv BPU id(0) HzSQuantizedConv 0.970183 20.7502 int8 /model.19/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.958548 5.99656 int8 /model.23/one2one_cv2.0/one2one_cv2.0.1/act/Mul BPU id(0) HzLut 0.963802 8.27278 int8 ...cv3.0/one2one_cv3.0.0/one2one_cv3.0.0.1/act/Mul BPU id(0) HzLut 0.923001 13.7487 int8 /model.19/cv1/act/Mul BPU id(0) HzLut 0.949418 7.41047 int8 /model.23/one2one_cv2.0/one2one_cv2.0.2/Conv BPU id(0) HzSQuantizedConv 0.989597 3.2914 int8 ...3.0/one2one_cv3.0.1/one2one_cv3.0.1.0/conv/Conv BPU id(0) HzSQuantizedConv 0.899571 5.69178 int8 /model.19/Split BPU id(0) Split 0.948781 7.20437 int8 /model.19/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.970307 7.20437 int8 /model.19/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.937324 7.20437 int8 ...cv3.0/one2one_cv3.0.1/one2one_cv3.0.1.0/act/Mul BPU id(0) HzLut 0.920887 22.5675 int8 ...3.0/one2one_cv3.0.1/one2one_cv3.0.1.1/conv/Conv BPU id(0) HzSQuantizedConv 0.846682 19.8505 int8 /model.19/m.0/cv1/act/Mul BPU id(0) HzLut 0.970815 3.30193 int8 /model.19/m.0/cv2/act/Mul BPU id(0) HzLut 0.932735 8.42875 int8 /model.19/m.0/m/m.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.944274 2.30525 int8 ...cv3.0/one2one_cv3.0.1/one2one_cv3.0.1.1/act/Mul BPU id(0) HzLut 0.889765 45.4591 int8 /model.23/one2one_cv3.0/one2one_cv3.0.2/Conv BPU id(0) HzSQuantizedConv 0.985422 25.4721 int8 /model.19/m.0/m/m.0/cv1/act/Mul BPU id(0) HzLut 0.927633 6.60601 int8 /model.19/m.0/m/m.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.960524 4.80511 int8 /model.19/m.0/m/m.0/cv2/act/Mul BPU id(0) HzLut 0.966209 5.54187 int8 /model.19/m.0/m/m.0/Add BPU id(0) HzSElementwiseAdd 0.971696 2.30525 int8 /model.19/m.0/m/m.1/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.955401 4.53885 int8 /model.19/m.0/m/m.1/cv1/act/Mul BPU id(0) HzLut 0.947777 6.86006 int8 /model.19/m.0/m/m.1/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.970424 5.40825 int8 /model.19/m.0/m/m.1/cv2/act/Mul BPU id(0) HzLut 0.974251 17.3934 int8 /model.19/m.0/m/m.1/Add BPU id(0) HzSElementwiseAdd 0.976167 4.53885 int8 /model.19/m.0/Concat BPU id(0) Concat 0.973390 17.7831 int8 /model.19/m.0/cv3/conv/Conv BPU id(0) HzSQuantizedConv 0.953354 17.7831 int8 /model.19/m.0/cv3/act/Mul BPU id(0) HzLut 0.957748 23.7055 int8 /model.19/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.19/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.19/Concat BPU id(0) Concat 0.955178 7.20437 int8 /model.19/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.962929 8.93029 int8 /model.19/cv2/act/Mul BPU id(0) HzLut 0.963644 20.8501 int8 /model.20/conv/Conv BPU id(0) HzSQuantizedConv 0.955497 5.21277 int8 /model.23/one2one_cv2.1/one2one_cv2.1.0/conv/Conv BPU id(0) HzSQuantizedConv 0.980611 5.21277 int8 ...3.1/one2one_cv3.1.0/one2one_cv3.1.0.0/conv/Conv BPU id(0) HzSQuantizedConv 0.985661 5.21277 int8 /model.20/act/Mul BPU id(0) HzLut 0.944386 8.21266 int8 /model.23/one2one_cv2.1/one2one_cv2.1.0/act/Mul BPU id(0) HzLut 0.983325 10.9868 int8 ...cv3.1/one2one_cv3.1.0/one2one_cv3.1.0.0/act/Mul BPU id(0) HzLut 0.985446 14.8115 int8 /model.21/Concat BPU id(0) Concat 0.966577 6.38025 int8 /model.23/one2one_cv2.1/one2one_cv2.1.1/conv/Conv BPU id(0) HzSQuantizedConv 0.969078 10.9866 int8 ...3.1/one2one_cv3.1.0/one2one_cv3.1.0.1/conv/Conv BPU id(0) HzSQuantizedConv 0.955590 14.8019 int8 /model.22/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.977936 6.38025 int8 /model.23/one2one_cv2.1/one2one_cv2.1.1/act/Mul BPU id(0) HzLut 0.971563 8.51278 int8 ...cv3.1/one2one_cv3.1.0/one2one_cv3.1.0.1/act/Mul BPU id(0) HzLut 0.915471 9.17167 int8 /model.22/cv1/act/Mul BPU id(0) HzLut 0.969077 8.71571 int8 /model.23/one2one_cv2.1/one2one_cv2.1.2/Conv BPU id(0) HzSQuantizedConv 0.993338 3.25176 int8 ...3.1/one2one_cv3.1.1/one2one_cv3.1.1.0/conv/Conv BPU id(0) HzSQuantizedConv 0.926187 6.95271 int8 /model.22/Split BPU id(0) Split 0.965075 8.30991 int8 /model.22/m.0/m.0.0/cv1/conv/Conv BPU id(0) HzSQuantizedConv 0.985673 8.30991 int8 ...cv3.1/one2one_cv3.1.1/one2one_cv3.1.1.0/act/Mul BPU id(0) HzLut 0.938265 25.5892 int8 ...3.1/one2one_cv3.1.1/one2one_cv3.1.1.1/conv/Conv BPU id(0) HzSQuantizedConv 0.903565 18.7127 int8 /model.22/m.0/m.0.0/cv1/act/Mul BPU id(0) HzLut 0.988338 7.48295 int8 /model.22/m.0/m.0.0/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.990393 6.61468 int8 ...cv3.1/one2one_cv3.1.1/one2one_cv3.1.1.1/act/Mul BPU id(0) HzLut 0.907712 45.6837 int8 /model.23/one2one_cv3.1/one2one_cv3.1.2/Conv BPU id(0) HzSQuantizedConv 0.989395 42.1331 int8 /model.22/m.0/m.0.0/cv2/act/Mul BPU id(0) HzLut 0.991100 9.21495 int8 /model.22/m.0/m.0.0/Add BPU id(0) HzSElementwiseAdd 0.990157 8.30991 int8 /model.22/m.0/m.0.1/attn/qkv/conv/Conv BPU id(0) HzSQuantizedConv 0.987827 8.53935 int8 /model.22/m.0/m.0.1/attn/Reshape BPU id(0) Reshape 0.987827 8.32244 int8 /model.22/m.0/m.0.1/attn/Split BPU id(0) Split 0.989705 8.32244 int8 /model.22/m.0/m.0.1/attn/Mul BPU id(0) HzSQuantizedConv 0.989628 8.32244 int8 /model.22/m.0/m.0.1/attn/Reshape_2 BPU id(0) Reshape 0.986348 8.32244 int8 /model.22/m.0/m.0.1/attn/Transpose BPU id(0) Transpose 0.989628 1.12781 int8 /model.22/m.0/m.0.1/attn/MatMul BPU id(0) HzSQuantizedMatmul 0.982834 1.12781 int8 ...1/attn/Softmax_reducemax_FROM_QUANTIZED_SOFTMAX BPU id(0) HzQuantizedReduceMax 0.998106 24.718 int8 ...0/m.0.1/attn/Softmax_sub_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSElementwiseSub 0.944814 24.718 int8 ...0/m.0.1/attn/Softmax_exp_FROM_QUANTIZED_SOFTMAX BPU id(0) HzLut 0.932880 5.64418 int8 ...1/attn/Softmax_reducesum_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSQuantizedReduceSum 0.963200 1.0 int8 .../attn/Softmax_reciprocal_FROM_QUANTIZED_SOFTMAX BPU id(0) HzLut 0.976782 138.664 int8 ...0/m.0.1/attn/Softmax_mul_FROM_QUANTIZED_SOFTMAX BPU id(0) HzSElementwiseMul 0.973404 1.0 int8 /model.22/m.0/m.0.1/attn/Transpose_1 BPU id(0) Transpose 0.973389 0.703209 int8 /model.22/m.0/m.0.1/attn/MatMul_1 BPU id(0) HzSQuantizedMatmul 0.981709 8.32244 int8 /model.22/m.0/m.0.1/attn/Reshape_1 BPU id(0) Reshape 0.981709 7.78857 int8 /model.22/m.0/m.0.1/attn/pe/conv/Conv BPU id(0) HzSQuantizedConv 0.981477 8.32244 int8 /model.22/m.0/m.0.1/attn/proj/conv/Conv BPU id(0) HzSQuantizedConv 0.981540 7.95935 int8 /model.22/m.0/m.0.1/ffn/ffn.0/conv/Conv BPU id(0) HzSQuantizedConv 0.990591 9.51949 int8 /model.22/m.0/m.0.1/ffn/ffn.0/act/Mul BPU id(0) HzLut 0.979219 14.447 int8 /model.22/m.0/m.0.1/ffn/ffn.1/conv/Conv BPU id(0) HzSQuantizedConv 0.980551 7.85633 int8 /model.22/Split_output_0_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.22/Split_output_1_calibrated_Requantize BPU id(0) HzRequantize -- -- int8 /model.22/Concat BPU id(0) Concat 0.981000 8.30991 int8 /model.22/cv2/conv/Conv BPU id(0) HzSQuantizedConv 0.990501 9.72894 int8 /model.22/cv2/act/Mul BPU id(0) HzLut 0.990327 15.4476 int8 /model.23/one2one_cv2.2/one2one_cv2.2.0/conv/Conv BPU id(0) HzSQuantizedConv 0.997510 11.1421 int8 ...3.2/one2one_cv3.2.0/one2one_cv3.2.0.0/conv/Conv BPU id(0) HzSQuantizedConv 0.987130 11.1421 int8 /model.23/one2one_cv2.2/one2one_cv2.2.0/act/Mul BPU id(0) HzLut 0.998104 7.45722 int8 ...cv3.2/one2one_cv3.2.0/one2one_cv3.2.0.0/act/Mul BPU id(0) HzLut 0.986272 13.8882 int8 /model.23/one2one_cv2.2/one2one_cv2.2.1/conv/Conv BPU id(0) HzSQuantizedConv 0.994880 7.45292 int8 ...3.2/one2one_cv3.2.0/one2one_cv3.2.0.1/conv/Conv BPU id(0) HzSQuantizedConv 0.985228 12.588 int8 /model.23/one2one_cv2.2/one2one_cv2.2.1/act/Mul BPU id(0) HzLut 0.994962 7.15209 int8 ...cv3.2/one2one_cv3.2.0/one2one_cv3.2.0.1/act/Mul BPU id(0) HzLut 0.980727 9.08317 int8 /model.23/one2one_cv2.2/one2one_cv2.2.2/Conv BPU id(0) HzSQuantizedConv 0.999024 7.06212 int8 ...3.2/one2one_cv3.2.1/one2one_cv3.2.1.0/conv/Conv BPU id(0) HzSQuantizedConv 0.980994 7.83007 int8 ...cv3.2/one2one_cv3.2.1/one2one_cv3.2.1.0/act/Mul BPU id(0) HzLut 0.981529 23.5955 int8 ...3.2/one2one_cv3.2.1/one2one_cv3.2.1.1/conv/Conv BPU id(0) HzSQuantizedConv 0.979626 20.3248 int8 ...cv3.2/one2one_cv3.2.1/one2one_cv3.2.1.1/act/Mul BPU id(0) HzLut 0.978119 35.9431 int8 /model.23/one2one_cv3.2/one2one_cv3.2.2/Conv BPU id(0) HzSQuantizedConv 0.998478 21.8894 int8 2026-08-07 10:59:40,751 file: print_info_dict.py func: print_info_dict line No: 72 The quantized model output: ============================================================================= Output Cosine Similarity L1 Distance L2 Distance Chebyshev Distance ----------------------------------------------------------------------------- cls_s8 0.985422 2.081548 0.024582 73.135422 box_s8 0.989597 0.201690 0.002376 4.414954 cls_s16 0.989395 1.614797 0.035827 35.102242 box_s16 0.993338 0.194142 0.004491 3.120226 cls_s32 0.998478 0.769498 0.025959 5.004253 box_s32 0.999024 0.123850 0.004851 0.863881 2026-08-07 10:59:40,763 file: model_builder.py func: model_builder line No: 38 End to Horizon NN Model Convert. 2026-08-07 10:59:40,780 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 601 start convert to *.bin file.... 2026-08-07 10:59:41,033 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4326 ONNX model output num : 6 2026-08-07 10:59:41,037 file: layout_util.py func: layout_util line No: 15 set_featuremap_layout start 2026-08-07 10:59:41,038 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4060 model_deps_info: {'hb_mapper_version': '1.24.3', 'hbdk_version': '3.49.15', 'hbdk_runtime_version': ' 3.15.55.0', 'horizon_nn_version': '1.1.0', 'onnx_model': '/workspace/smart_car_2026/model/x5_quantization/best_bpu.onnx', 'march': 'bayes-e', 'layer_out_dump': False, 'log_level': 'DEBUG', 'working_dir': '/workspace/smart_car_2026/model/x5_quantization/mapper_output_bpu', 'model_prefix': 'best_bpu_bayese_640x640_nv12', 'input_names': ['images'], 'input_type_rt': ['nv12'], 'input_space_and_range': ['regular'], 'input_type_train': ['rgb'], 'input_layout_rt': [''], 'input_layout_train': ['NCHW'], 'norm_type': ['data_scale'], 'scale_value': ['0.003921568627451,'], 'mean_value': [''], 'input_shape': ['1x3x640x640'], 'input_batch': [], 'cal_dir': ['/workspace/smart_car_2026/model/x5_quantization/calibration_data'], 'cal_data_type': ['float32'], 'preprocess_on': False, 'calibration_type': 'default', 'per_channel': 'False', 'optimization': ['set_Softmax_input_int8,set_Softmax_output_int8'], 'hbdk_params': {'hbdk_pass_through_params': '--O3 --debug --core-num 1 --fast --jobs 8 ', 'input-source': {'images': 'pyramid', '_default_value': 'ddr'}}, 'debug': True, 'compile_mode': 'latency'} 2026-08-07 10:59:41,040 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4183 ############# model deps info ############# 2026-08-07 10:59:41,041 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4184 hb_mapper version : 1.24.3 2026-08-07 10:59:41,041 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4187 hbdk version : 3.49.15 2026-08-07 10:59:41,042 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4189 hbdk runtime version: 3.15.55.0 2026-08-07 10:59:41,042 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4192 horizon_nn version : 1.1.0 2026-08-07 10:59:41,043 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4196 ############# model_parameters info ############# 2026-08-07 10:59:41,044 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4202 onnx_model : /workspace/smart_car_2026/model/x5_quantization/best_bpu.onnx 2026-08-07 10:59:41,044 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4203 BPU march : bayes-e 2026-08-07 10:59:41,044 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4204 layer_out_dump : False 2026-08-07 10:59:41,045 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4205 log_level : DEBUG 2026-08-07 10:59:41,045 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4206 working dir : /workspace/smart_car_2026/model/x5_quantization/mapper_output_bpu 2026-08-07 10:59:41,045 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4207 output_model_file_prefix: best_bpu_bayese_640x640_nv12 2026-08-07 10:59:41,046 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4228 ############# input_parameters info ############# 2026-08-07 10:59:41,046 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4246 ------------------------------------------ 2026-08-07 10:59:41,046 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4248 ---------input info : images --------- 2026-08-07 10:59:41,047 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4249 input_name : images 2026-08-07 10:59:41,047 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4250 input_type_rt : nv12 2026-08-07 10:59:41,047 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4252 input_space&range : regular 2026-08-07 10:59:41,048 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4254 input_layout_rt : None 2026-08-07 10:59:41,048 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4255 input_type_train : rgb 2026-08-07 10:59:41,048 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4256 input_layout_train : NCHW 2026-08-07 10:59:41,049 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4257 norm_type : data_scale 2026-08-07 10:59:41,049 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4258 input_shape : 1x3x640x640 2026-08-07 10:59:41,049 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4266 scale_value : 0.003921568627451, 2026-08-07 10:59:41,050 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4268 cal_data_dir : /workspace/smart_car_2026/model/x5_quantization/calibration_data 2026-08-07 10:59:41,050 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4270 cal_data_type : float32 2026-08-07 10:59:41,050 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4271 ---------input info : images end ------- 2026-08-07 10:59:41,051 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4272 ------------------------------------------ 2026-08-07 10:59:41,051 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4274 ############# calibration_parameters info ############# 2026-08-07 10:59:41,051 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4275 preprocess_on : False 2026-08-07 10:59:41,051 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4276 calibration_type: : default 2026-08-07 10:59:41,052 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4278 optimization : set_Softmax_input_int8,set_Softmax_output_int8; 2026-08-07 10:59:41,052 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4284 per_channel : False 2026-08-07 10:59:41,052 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4303 ############# compiler_parameters info ############# 2026-08-07 10:59:41,053 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4305 debug : True 2026-08-07 10:59:41,053 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4307 compile_mode : latency 2026-08-07 10:59:41,053 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4310 hbdk_pass_through_params: --O3 --debug --core-num 1 --fast --jobs 8 2026-08-07 10:59:41,054 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4310 input-source : {'images': 'pyramid', '_default_value': 'ddr'} 2026-08-07 10:59:41,062 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 783 Convert to runtime bin file successfully! 2026-08-07 10:59:41,063 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 784 End Model Convert