首批通过分布式安全可靠测评，为关键业务系统打造
划线反馈
UPDATE SQL 语句产生大量 RPC 请求问题分析的原因和解决方法
更新时间：2026-05-28 02:06
分享
适用版本：V4.0.x、V4.1.x、V4.2.x内容类型：Troubleshoot
问题现象
业务中存在 F 表会根据分区更新 20 万数据，建有触发器，F 表的每条变更都会在 M 表插入 1 条记录，即 F 表更新 20 万时会导致 M 表插入 20 万数据。F 表和 M 表建在同一表组，为何 F 表更新时有大量 RPC 请求，更新 20 万数据会导致 RPC_COUNT 691057 不符合预期。
关键信息
计划走 DAS 计划有关键字
DISTRIBUTED UPDATE。======================================================================================= |ID|OPERATOR |NAME |EST.ROWS|EST.TIME(us)| --------------------------------------------------------------------------------------- |0 |DISTRIBUTED UPDATE | |1 |27 | |1 |└─DISTRIBUTED TABLE FULL SCAN|XXXXXXXXX |1 |3 | =======================================================================================show trace 可以看到在 sql_execute 执行阶段有大量的全链路诊断 PL 的路径标签如 pl_entry 、do_local_das_task 标签。
super@xxxxx 17:45: [nsip_insurance_finance_tmp]> set ob_enable_show_trace=on; Query OK, 0 rows affected (0.00 sec) super@xxxxx 20:26: [nsip_insurance_finance_tmp]> UPDATE tb_finance_policy_flow_new SET outer_check_status = 2 WHERE company_sub_id = '211118111SM845' AND is_del = 0 AND collect_time BETWEEN '2024-04-01 00:00:00.0' AND '2024-04-03 23:59:59.0' AND busi_time BETWEEN '2024-04-01 00:00:00.0' AND '2024-04-03 23:59:59.0'; Query OK, 0 rows affected (2 min 13.19 sec) Rows matched: 68206 Changed: 0 Warnings: 0 super@xxxxx 20:30: [nsip_insurance_finance_tmp]> show trace; +---------------------------------------------------------------------+----------------------------+---------------+ | Operation | StartTime | ElapseTime | +---------------------------------------------------------------------+----------------------------+---------------+ | ob_proxy | 2024-04-16 20:28:15.279527 | 133194.951 ms | | ├── com_query_process | 2024-04-16 20:28:15.279141 | 133182.583 ms | | │ └── mpquery_single_stmt | 2024-04-16 20:28:15.279144 | 133182.573 ms | | │ └── sql_execute | 2024-04-16 20:28:15.286650 | 133175.020 ms | | │ ├── open | 2024-04-16 20:28:15.286651 | 133174.741 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.344608 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.344612 | 1.859 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.344623 | 1.602 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.344623 | 1.596 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.344675 | 1.513 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.346120 | 0.045 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.346182 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.346197 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.346510 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.346540 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.346545 | 1.857 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.346554 | 1.604 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.346554 | 1.597 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.346606 | 1.514 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.348040 | 0.044 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.348114 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.348127 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.348440 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.348470 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.348474 | 1.888 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.348488 | 1.622 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.348488 | 1.599 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.348534 | 1.517 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.349959 | 0.054 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.350045 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.350058 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.350428 | 0.031 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.350467 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.350474 | 1.842 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.350483 | 1.569 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.350483 | 1.564 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.350537 | 1.481 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.351952 | 0.045 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.352013 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.352024 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.352358 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.352388 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.352394 | 1.862 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.352404 | 1.590 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.352404 | 1.584 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.352472 | 1.483 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.353884 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.353948 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.353965 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.354299 | 0.034 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.354341 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.354345 | 1.885 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.354354 | 1.586 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.354354 | 1.581 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.354400 | 1.503 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.355826 | 0.052 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.355898 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.355910 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.356274 | 0.027 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.356321 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.356326 | 2.018 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.356336 | 1.628 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.356336 | 1.621 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.356398 | 1.520 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.357829 | 0.057 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.357910 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.357926 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.358411 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.358445 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.358451 | 2.015 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.358463 | 1.689 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.358463 | 1.684 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.358529 | 1.542 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.359997 | 0.045 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.360063 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.360116 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.360511 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.360542 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.360547 | 1.996 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.360556 | 1.682 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.360557 | 1.673 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.360603 | 1.580 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.362059 | 0.089 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.362173 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.362193 | 0.010 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.362587 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.362620 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.362626 | 1.973 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.362635 | 1.665 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.362635 | 1.658 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.362691 | 1.563 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.364169 | 0.053 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.364245 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.364263 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.364661 | 0.030 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.364699 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.364703 | 1.877 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.364712 | 1.620 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.364712 | 1.614 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.364759 | 1.528 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.366207 | 0.057 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.366281 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.366296 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.366621 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.366654 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.366658 | 1.859 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.366667 | 1.613 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.366667 | 1.606 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.366714 | 1.528 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.368167 | 0.049 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.368232 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.368250 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.368560 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.368591 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.368608 | 1.960 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.368619 | 1.641 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.368620 | 1.632 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.368666 | 1.533 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.370121 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.370190 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.370207 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.370613 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.370647 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.370651 | 1.931 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.370661 | 1.636 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.370661 | 1.628 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.370716 | 1.540 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.372184 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.372250 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.372264 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.372626 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.372656 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.372663 | 2.046 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.372674 | 1.761 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.372675 | 1.755 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.372725 | 1.675 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.374171 | 0.205 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.374394 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.374406 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.374751 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.374783 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.374787 | 1.918 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.374797 | 1.608 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.374797 | 1.604 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.374843 | 1.527 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.376288 | 0.059 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.376365 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.376377 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.376753 | 0.031 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.376799 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.376805 | 1.999 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.376815 | 1.642 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.376815 | 1.636 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.376870 | 1.552 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.378343 | 0.056 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.378416 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.378428 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.378850 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.378882 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.378888 | 1.938 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.378898 | 1.615 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.378898 | 1.609 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.378946 | 1.522 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.380382 | 0.049 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.380460 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.380475 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.380867 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.380901 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.380908 | 1.888 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.380917 | 1.621 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.380918 | 1.616 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.380971 | 1.533 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.382433 | 0.049 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.382498 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.382511 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.382839 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.382871 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.382876 | 1.946 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.382885 | 1.644 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.382885 | 1.636 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.382932 | 1.530 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.384383 | 0.059 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.384457 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.384470 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.384882 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.384913 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.384927 | 1.932 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.384937 | 1.629 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.384937 | 1.624 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.384984 | 1.546 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.386460 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.386525 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.386538 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.386917 | 0.031 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.386961 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.386969 | 2.032 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.386981 | 1.772 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.386981 | 1.767 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.387035 | 1.682 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.388646 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.388712 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.388725 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.389044 | 0.022 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.389073 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.389078 | 1.884 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.389087 | 1.632 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.389087 | 1.625 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.389154 | 1.525 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.390602 | 0.053 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.390673 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.390687 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.391003 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.391039 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.391043 | 1.910 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.391052 | 1.670 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.391052 | 1.665 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.391134 | 1.544 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.392604 | 0.047 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.392670 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.392688 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.392999 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.393031 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.393037 | 1.857 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.393048 | 1.602 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.393049 | 1.596 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.393113 | 1.495 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.394533 | 0.047 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.394599 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.394617 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.394937 | 0.027 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.394978 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.394984 | 1.859 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.394995 | 1.609 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.394995 | 1.604 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.395041 | 1.512 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.396474 | 0.053 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.396545 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.396570 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.396895 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.396926 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.396932 | 1.920 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.396942 | 1.672 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.396942 | 1.664 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.396989 | 1.581 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.398486 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.398561 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.398578 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.398887 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.398918 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.398923 | 1.897 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.398934 | 1.626 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.398934 | 1.618 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.398985 | 1.524 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.400433 | 0.047 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.400501 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.400520 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.400855 | 0.033 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.400895 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.400900 | 1.919 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.400909 | 1.683 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.400909 | 1.677 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.400956 | 1.601 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.402462 | 0.062 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.402550 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.402563 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.402853 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.402884 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.402888 | 1.848 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.402903 | 1.588 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.402903 | 1.583 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.402948 | 1.508 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.404364 | 0.063 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.404449 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.404463 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.404771 | 0.032 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.404810 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.404817 | 1.840 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.404826 | 1.613 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.404826 | 1.608 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.404882 | 1.523 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.406317 | 0.045 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.406400 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.406412 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.406701 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.406738 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.406744 | 1.877 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.406755 | 1.628 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.406756 | 1.622 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.406811 | 1.530 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.408252 | 0.059 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.408333 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.408350 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.408663 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.408694 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.408702 | 2.009 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.408712 | 1.713 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.408712 | 1.707 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.408758 | 1.630 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.410187 | 0.162 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.410380 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.410396 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.410767 | 0.028 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.410808 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.410813 | 1.905 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.410823 | 1.645 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.410823 | 1.640 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.410872 | 1.553 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.412349 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.412417 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.412435 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.412759 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.412791 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.412797 | 1.924 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.412807 | 1.683 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.412807 | 1.678 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.412875 | 1.571 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.414328 | 0.076 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.414421 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.414460 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.414768 | 0.027 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.414803 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.414807 | 1.930 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.414824 | 1.635 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.414824 | 1.630 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.414891 | 1.534 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.416349 | 0.052 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.416419 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.416431 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.416775 | 0.039 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.416823 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.416830 | 1.921 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.416840 | 1.643 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.416840 | 1.630 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.416888 | 1.552 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.418368 | 0.049 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.418434 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.418446 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.418790 | 0.029 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.418829 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.418838 | 1.976 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.418849 | 1.679 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.418849 | 1.674 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.418915 | 1.568 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.420405 | 0.053 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.420476 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.420489 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.420849 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.420880 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.420886 | 1.919 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.420896 | 1.635 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.420896 | 1.629 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.420948 | 1.543 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.422410 | 0.057 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.422485 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.422500 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.422846 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.422879 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.422883 | 1.990 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.422892 | 1.689 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.422892 | 1.684 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.422939 | 1.595 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.424392 | 0.077 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.424520 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.424544 | 0.005 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.424914 | 0.027 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.424949 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.424953 | 2.046 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.424963 | 1.710 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.424963 | 1.705 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.425030 | 1.604 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.426560 | 0.050 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.426628 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.426643 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.427041 | 0.025 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.427073 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.427078 | 1.898 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.427087 | 1.655 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.427087 | 1.649 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.427154 | 1.551 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.428628 | 0.054 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.428700 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.428713 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.429013 | 0.041 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.429062 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.429066 | 2.001 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.429076 | 1.694 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.429076 | 1.687 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.429140 | 1.567 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.430601 | 0.060 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.430681 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.430720 | 0.010 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.431120 | 0.036 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.431164 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.431168 | 1.833 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.431178 | 1.607 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.431178 | 1.601 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.431224 | 1.506 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.432658 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.432725 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.432738 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.433038 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.433068 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.433072 | 1.818 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.433082 | 1.577 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.433082 | 1.572 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.433145 | 1.480 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.434553 | 0.050 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.434620 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.434632 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.434926 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.434956 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.434960 | 1.815 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.434969 | 1.578 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.434969 | 1.571 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.435014 | 1.498 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.436447 | 0.044 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.436507 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.436518 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.436808 | 0.023 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.436837 | 0.001 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.436842 | 1.872 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.436850 | 1.629 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.436851 | 1.623 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.436895 | 1.551 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.438377 | 0.045 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.438441 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.438452 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.438752 | 0.022 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.438781 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.438785 | 1.908 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.438794 | 1.643 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.438794 | 1.638 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.438850 | 1.547 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.440324 | 0.048 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.440390 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.440404 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.440748 | 0.030 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.440797 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.440804 | 1.876 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.440815 | 1.589 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.440815 | 1.579 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.440865 | 1.476 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.442259 | 0.056 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.442334 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.442350 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.442718 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.442752 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.442756 | 2.025 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.442766 | 1.654 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.442766 | 1.649 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.442813 | 1.563 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.444267 | 0.079 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.444366 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.444385 | 0.005 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.444825 | 0.043 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.444876 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.444882 | 2.122 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.444893 | 1.801 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.444893 | 1.796 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.444953 | 1.696 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.446454 | 0.156 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.446629 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.446659 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.447046 | 0.029 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.447083 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.447089 | 1.959 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.447115 | 1.649 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.447115 | 1.643 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.447174 | 1.549 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.448641 | 0.053 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.448714 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.448732 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.449087 | 0.056 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.449151 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.449156 | 1.877 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.449165 | 1.587 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.449165 | 1.582 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.449218 | 1.497 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.450633 | 0.057 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.450708 | 0.001 ms | | │ │ │ └── close | 2024-04-16 20:30:28.450723 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.451079 | 0.040 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.451129 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.451136 | 1.881 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.451148 | 1.629 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.451148 | 1.624 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.451199 | 1.542 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.452652 | 0.047 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.452734 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.452749 | 0.004 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.453053 | 0.024 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.453087 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.453106 | 1.912 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.453117 | 1.670 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.453118 | 1.664 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.453187 | 1.565 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.454661 | 0.068 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.454746 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.454759 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.455053 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.455086 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.455090 | 1.856 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.455115 | 1.581 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.455115 | 1.574 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.455161 | 1.487 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.456579 | 0.047 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.456642 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.456657 | 0.003 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.456984 | 0.026 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.457020 | 0.000 ms | | │ │ ├── pl_entry | 2024-04-16 20:30:28.457026 | 2.242 ms | | │ │ │ └── pl_spi_execute | 2024-04-16 20:30:28.457078 | 1.720 ms | | │ │ │ └── pl_spi_query | 2024-04-16 20:30:28.457078 | 1.713 ms | | │ │ │ ├── open | 2024-04-16 20:30:28.457139 | 1.612 ms | | │ │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.458638 | 0.049 ms | | │ │ │ │ └── close_das_task | 2024-04-16 20:30:28.458733 | 0.000 ms | | │ │ │ └── close | 2024-04-16 20:30:28.458761 | 0.005 ms | | │ │ ├── do_local_das_task | 2024-04-16 20:30:28.459329 | 0.027 ms | | │ │ ├── close_das_task | 2024-04-16 20:30:28.459365 | 0.000 ms | | │ │ └── pl_entry | 2024-04-16 20:30:28.459370 | 1.991 ms | | │ │ └── pl_spi_execute | 2024-04-16 20:30:28.459380 | 1.629 ms | | │ │ └── pl_spi_query | 2024-04-16 20:30:28.459380 | 1.609 ms | | │ │ ├── open | 2024-04-16 20:30:28.459428 | 1.529 ms | | │ │ │ ├── do_local_das_task | 2024-04-16 20:30:28.460856 | 0.075 ms | | │ │ │ └── close_das_task | 2024-04-16 20:30:28.460951 | 0.001 ms | | │ │ └── close | 2024-04-16 20:30:28.460963 | 0.004 ms | | │ └── close | 2024-04-16 20:30:28.461398 | 0.268 ms | | │ ├── close_das_task | 2024-04-16 20:30:28.461399 | 0.074 ms | | │ └── end_transaction | 2024-04-16 20:30:28.461548 | 0.111 ms | | ├── ob_proxy_partition_location_lookup | 2024-04-16 20:28:15.279531 | 0.081 ms | | └── ob_proxy_server_process_req | 2024-04-16 20:28:15.279686 | 133194.499 ms | +---------------------------------------------------------------------+----------------------------+---------------+ 531 rows in set (0.11 sec)判断数据表分区的 Leader 和业务用户 GTS Leader 不在一个节点。
select TENANT_ID, LS_ID , SVR_IP, ROLE from CDB_OB_LS_LOCATIONS order by ROLE; select * from CDB_OB_TABLE_LOCATIONS where tenant_id = XXX and table_name like 'XXX%' and role = 'leader';
最后查询执行的 sql audit 发现 RPC_COUNT 字段比较大通常远远大于更新的数据量可以判断为遇到相同的问题。
简化版的触发器
tb_finance_policy_flow 表包含以下字段：policy_flow_id, policy_no, update_time。
tb_finance_policy_flow_mdy 表包括：id，policy_flow_id，policy_no，modify_type，和 r_create_time。
UPDATE tb_finance_policy_flow SET outer_check_status = 0 WHERE company_sub_id = '211118111SM845' AND is_del = 0 AND collect_time BETWEEN '2024-04-01 00:00:00.0' AND '2024-04-10 23:59:59.0' AND busi_time BETWEEN '2024-04-01 00:00:00.0' AND '2024-04-30 23:59:59.0';
DELIMITER #
CREATE TRIGGER trigger_tb_finance_policy_simple_update
AFTER UPDATE ON tb_finance_policy_flow
FOR EACH ROW
BEGIN
INSERT INTO tb_finance_policy_flow_mdy (policy_flow_id, policy_no, modify_type, r_create_time)
VALUES (NEW.policy_flow_id, NEW.policy_no, 3, NOW());
END; #
DELIMITER ;
问题原因
业务表为分区表，并且在表上面建有 UPDATE 语句的触发器 TRIGGER，如果 UPDATE 语句会更新大量的数据同时也走了 DAS 的计划（Distributed Data Access Service 即 OceanBase 数据库中的分布式数据访问服务），同时更新数据表分区的 Leader 和业务用户 GTS Leader 不在一个节点，不在一个节点取 GTS 会导致跨机的 RPC，TRIGGER 内部的语句执行会使用自己的 SNAPSHOT，取 SNAPSHOT 会访问 GTS，嵌套语句的多次执行访问 GTS 会导致的 RPC 数量过高，通过迁移了表的 Leader 位置和业务用户 GTS Leader 在相同节点可以减少 RPC 次数。
问题的风险及影响
大量的 RPC 增加了业务的耗时和开销影响业务的 RT。
影响租户
影响 OceanBase 数据库中的 SYS 租户和 Oracle 租户以及 MySQL 租户。
适用版本
OceanBase 数据库 V4.x 版本。
解决方法及规避方式
暂时通过迁移表的 Leader 位置和业务用户 GTS Leader 在相同节点可以减少 RPC 次数。
