Query e74dc2b6876dacba:cb6b342c00000000
Query (id=e74dc2b6876dacba:cb6b342c00000000):
Summary:
Session ID: 1a42f1343534511d:5b22382af98e1196
Session Type: BEESWAX
Start Time: 2025-09-17 05:40:01.984596000
End Time: 2025-09-17 05:40:02.126115000
Query Type: DML
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 3.2.0-cdh6.3.2 RELEASE (build 1bb9836227301b839a32c6bc230e35439d5984ac)
User: root
Connected User: root
Delegated User:
Network Address: 172.19.5.216:34232
Default Db: default
Sql Statement: INSERT overwrite TABLE educator.event_data_impala_tmp SELECT event_name,count(1) as impala_count,date_time FROM educator.t_event WHERE date_time ='2025-09-16' GROUP BY event_name,date_time
Coordinator: hadoop001:22000
Query Options (set by configuration): CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Query Options (set by configuration and planner): MT_DOP=0,CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Plan:
----------------
Max Per-Host Resource Reservation: Memory=4.94MB Threads=3
Per-Host Resource Estimates: Memory=36MB
WARNING: The following tables have potentially corrupt table statistics.
Drop and re-compute statistics to resolve this problem.
educator.t_event
Analyzed query: SELECT event_name, count(*) impala_count, date_time FROM
educator.t_event WHERE date_time = '2025-09-16' GROUP BY event_name, date_time
F01:PLAN FRAGMENT [HASH(event_name,date_time)] hosts=1 instances=1
| Per-Host Resources: mem-estimate=10.05MB mem-reservation=1.94MB thread-reservation=1
WRITE TO HDFS [educator.event_data_impala_tmp, OVERWRITE=true]
| partitions=1
| mem-estimate=43B mem-reservation=0B thread-reservation=0
|
03:AGGREGATE [FINALIZE]
| output: count:merge(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 03(GETNEXT), 00(OPEN)
|
02:EXCHANGE [HASH(event_name,date_time)]
| mem-estimate=46.32KB mem-reservation=0B thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=26.00MB mem-reservation=3.00MB thread-reservation=2
01:AGGREGATE [STREAMING]
| output: count(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
00:SCAN HDFS [educator.t_event, RANDOM]
partition predicates: date_time = '2025-09-16'
partitions=1/2007 files=1 size=973.52KB
stored statistics:
table: rows=11759979 size=235.14MB
partitions: 1/1 rows=0
columns: all
extrapolated-rows=disabled max-scan-range-rows=11759979
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=1
tuple-ids=0 row-size=34B cardinality=0
in pipelines: 00(GETNEXT)
----------------
Estimated Per-Host Mem: 37796169
Tables With Corrupt Table Stats: educator.t_event
Per Host Min Memory Reservation: hadoop002:22000(4.94 MB)
Request Pool: root.root
Admission result: Admitted immediately
Cluster Memory Admitted: 36.05 MB
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
---------------------------------------------------------------------------------------------------------------------------
F01:HDFS WRITER 1 14.000ms 14.000ms 50.00 KB 43.00 B
03:AGGREGATE 1 1.000ms 1.000ms 38 0 1.98 MB 10.00 MB FINALIZE
02:EXCHANGE 1 0.000ns 0.000ns 38 0 120.00 KB 46.32 KB HASH(event_name,date_time)
F00:EXCHANGE SENDER 1 0.000ns 0.000ns 3.88 KB 0
01:AGGREGATE 1 5.000ms 5.000ms 38 0 2.07 MB 10.00 MB STREAMING
00:SCAN HDFS 1 2.000ms 2.000ms 73.77K 0 1.74 MB 16.00 MB educator.t_event
Errors:
Query Compilation: 1.516ms
- Metadata of all 2 tables cached: 229.545us (229.545us)
- Analysis finished: 619.952us (390.407us)
- Value transfer graph computed: 627.358us (7.406us)
- Single node plan created: 737.112us (109.754us)
- Runtime filters computed: 761.611us (24.499us)
- Distributed plan created: 771.918us (10.307us)
- Lineage info computed: 794.892us (22.974us)
- Planning finished: 1.516ms (721.203us)
Query Timeline: 206.008ms
- Query submitted: 0.000ns (0.000ns)
- Planning finished: 2.000ms (2.000ms)
- Submit for admission: 2.000ms (0.000ns)
- Completed admission: 3.000ms (1.000ms)
- Ready to start on 1 backends: 3.000ms (0.000ns)
- All 1 execution backends (2 fragment instances) started: 4.000ms (1.000ms)
- Last row fetched: 141.005ms (137.005ms)
- Released admission control resources: 141.005ms (0.000ns)
- DML data written: 142.005ms (1.000ms)
- DML Metastore update finished: 149.005ms (7.000ms)
- Request finished: 149.005ms (0.000ns)
- Unregister query: 204.008ms (55.002ms)
- AdmissionControlTimeSinceLastUpdate: 88.000ms
- ComputeScanRangeAssignmentTimer: 0.000ns
Frontend:
ImpalaServer:
- ClientFetchWaitTimer: 55.002ms
- MetastoreUpdateTimer: 7.000ms
- RowMaterializationTimer: 0.000ns
Execution Profile e74dc2b6876dacba:cb6b342c00000000:(Total: 139.005ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms
Slowest backend to start up: hadoop002:22000
Per Node Peak Memory Usage: hadoop002:22000(6.14 MB)
Per Node Bytes Read: hadoop002:22000(121.33 KB)
Per Node User Time: hadoop002:22000(189.783ms)
Per Node System Time: hadoop002:22000(1.012ms)
DML Stats:
Partition: Default
NumModifiedRows: 38
BytesWritten: 967.00 B
- ExchangeScanRatio: 0.01
- FiltersReceived: 0 (0)
- FinalizationTimer: 9.000ms
- FileDeletionTimer: 2.000ms
- FileMoveTimer: 3.000ms
- Overwrite/PartitionCreationTimer: 3.000ms
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumFragmentInstances: 2 (2)
- NumFragments: 2 (2)
- TotalBytesRead: 121.33 KB (124247)
- TotalBytesSent: 1.58 KB (1617)
- TotalCpuTime: 190.795ms
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 1.58 KB (1617)
Per Node Profiles:
hadoop002:22000:
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
Averaged Fragment F01:(Total: 127.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:128.005ms max:128.005ms mean: 128.005ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 33.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 127.004ms
- TotalThreadsSysTime: 1.012ms
- TotalThreadsUserTime: 80.466ms
- TotalThreadsVoluntaryContextSwitches: 27 (27)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 15.000ms
- ExecTreeExecTime: 1.000ms
- OpenTime: 112.004ms
- ExecTreeOpenTime: 33.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 14.000ms, non-child: 14.000ms, % non-child: 100.00%)
- BytesWritten: 967.00 B (967)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 38 (38)
- TmpFileCreateTimer: 5.000ms
AGGREGATION_NODE (id=3):(Total: 34.001ms, non-child: 1.000ms, % non-child: 2.94%)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.12 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 13.31K (13312)
- LargestPartitionPercent: 21 (21)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 38 (38)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.06 MB (1114112)
- CumulativeAllocations: 17 (17)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.06 MB (1114112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 33.001ms, non-child: 33.001ms, % non-child: 100.00%)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.15 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 31.001ms
- TotalBytesDequeued: 2.26 KB (2318)
- TotalGetBatchTime: 33.001ms
- DataWaitTime: 33.001ms
Enqueue:
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.58 KB (1617)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 79.003ms, non-child: 79.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 2 (2)
- CodegenTotalWallClockTime: 79.003ms
- CodegenSysTime: 993.000us
- CodegenUserTime: 77.449ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 19.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 14.000ms
Fragment F01:
Instance e74dc2b6876dacba:cb6b342c00000001 (host=hadoop002:22000):(Total: 127.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-09-17 05:40:02.116
Fragment Instance Lifecycle Event Timeline: 127.004ms
- Prepare Finished: 0.000ns (0.000ns)
- Open Finished: 112.004ms (112.004ms)
- First Batch Produced: 112.004ms (0.000ns)
- First Batch Sent: 117.004ms (5.000ms)
- ExecInternal Finished: 127.004ms (10.000ms)
- MemoryUsage (500.000ms): 478.12 KB
- ThreadUsage (500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 33.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 127.004ms
- TotalThreadsSysTime: 1.012ms
- TotalThreadsUserTime: 80.466ms
- TotalThreadsVoluntaryContextSwitches: 27 (27)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 15.000ms
- ExecTreeExecTime: 1.000ms
- OpenTime: 112.004ms
- ExecTreeOpenTime: 33.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 14.000ms, non-child: 14.000ms, % non-child: 100.00%)
- BytesWritten: 967.00 B (967)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 38 (38)
- TmpFileCreateTimer: 5.000ms
AGGREGATION_NODE (id=3):(Total: 34.001ms, non-child: 1.000ms, % non-child: 2.94%)
Node Lifecycle Event Timeline: 127.004ms
- Open Started: 79.003ms (79.003ms)
- Open Finished: 112.004ms (33.001ms)
- First Batch Requested: 112.004ms (0.000ns)
- First Batch Returned: 112.004ms (0.000ns)
- Last Batch Returned: 118.004ms (6.000ms)
- Closed: 127.004ms (9.000ms)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.12 K/sec
GroupingAggregator 0:
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 13.31K (13312)
- LargestPartitionPercent: 21 (21)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 38 (38)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.06 MB (1114112)
- CumulativeAllocations: 17 (17)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.06 MB (1114112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 33.001ms, non-child: 0.000ns, % non-child: 0.00%)
Node Lifecycle Event Timeline: 112.004ms
- Open Started: 79.003ms (79.003ms)
- Open Finished: 110.004ms (31.001ms)
- First Batch Requested: 110.004ms (0.000ns)
- First Batch Returned: 112.004ms (2.000ms)
- Last Batch Returned: 112.004ms (0.000ns)
- Closed: 112.004ms (0.000ns)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.15 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- BytesDequeued (500.000ms): 0
- FirstBatchWaitTime: 31.001ms
- TotalBytesDequeued: 2.26 KB (2318)
- TotalGetBatchTime: 33.001ms
- DataWaitTime: 33.001ms
Enqueue:
- BytesReceived (500.000ms): 0
- DeferredQueueSize (500.000ms): 0
- DispatchTime: (Avg: 14.467us ; Min: 9.307us ; Max: 34.741us ; Number of samples: 14)
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.58 KB (1617)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 79.003ms, non-child: 79.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 2 (2)
- CodegenTotalWallClockTime: 79.003ms
- CodegenSysTime: 993.000us
- CodegenUserTime: 77.449ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 19.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 14.000ms
Averaged Fragment F00:(Total: 112.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 973.52 KB, max: 973.52 KB, avg: 973.52 KB, stddev: 0
completion times: min:128.005ms max:128.005ms mean: 128.005ms stddev:0.000ns
execution rates: min:7.43 MB/sec max:7.43 MB/sec mean:7.43 MB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.01
- PeakMemoryUsage: 3.82 MB (4009103)
- PeakReservation: 3.00 MB (3145728)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 3.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 117.004ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 109.317ms
- TotalThreadsVoluntaryContextSwitches: 31 (31)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 10.000ms
- ExecTreeExecTime: 7.000ms
- OpenTime: 102.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
KrpcDataStreamSender (dst_id=2):(Total: 3.000ms, non-child: 3.000ms, % non-child: 100.00%)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 38 (38)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.58 KB (1617)
- UncompressedRowBatchSize: 2.26 KB (2318)
AGGREGATION_NODE (id=1):(Total: 7.000ms, non-child: 5.000ms, % non-child: 71.43%)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 38 (38)
- RowsReturnedRate: 5.43 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 1.000ms
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 38 (38)
- StreamingTime: 5.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 2.000ms, non-child: 2.000ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 121.33 KB (124247)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 121.33 KB (124247)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 121.33 KB (124247)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 1.74 MB (1827837)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 118.49 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.79 MB (1876992)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 693.00 KB (709632)
- RowBatchQueuePutWaitTime: 4.000ms
- RowBatchesEnqueued: 75 (75)
- RowsRead: 73.77K (73765)
- RowsReturned: 73.77K (73765)
- RowsReturnedRate: 36.88 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 5.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.751ms
- ScannerThreadsVoluntaryContextSwitches: 11 (11)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 1.00 MB (1048576)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 102.003ms, non-child: 102.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 2 (2)
- CodegenTotalWallClockTime: 102.003ms
- CodegenSysTime: 0.000ns
- CodegenUserTime: 101.876ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 27.001ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 57.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 14.000ms
Fragment F00:
Instance e74dc2b6876dacba:cb6b342c00000000 (host=hadoop002:22000):(Total: 112.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-09-17 05:40:02.116
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/973.52 KB
Fragment Instance Lifecycle Event Timeline: 113.004ms
- Prepare Finished: 1.000ms (1.000ms)
- Open Finished: 103.003ms (102.003ms)
- First Batch Produced: 110.004ms (7.000ms)
- First Batch Sent: 110.004ms (0.000ns)
- ExecInternal Finished: 113.004ms (3.000ms)
- MemoryUsage (500.000ms): 755.00 KB
- ThreadUsage (500.000ms): 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.01
- PeakMemoryUsage: 3.82 MB (4009103)
- PeakReservation: 3.00 MB (3145728)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 3.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 2 (2)
- TotalThreadsTotalWallClockTime: 117.004ms
- TotalThreadsSysTime: 0.000ns
- TotalThreadsUserTime: 109.317ms
- TotalThreadsVoluntaryContextSwitches: 31 (31)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 10.000ms
- ExecTreeExecTime: 7.000ms
- OpenTime: 102.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
KrpcDataStreamSender (dst_id=2):(Total: 3.000ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Hash Partitioned Sender Codegen Enabled
- BytesSent (500.000ms): 0
- NetworkThroughput: (Avg: 1.60 MB/sec ; Min: 327.83 KB/sec ; Max: 3.97 MB/sec ; Number of samples: 14)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 38 (38)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.58 KB (1617)
- UncompressedRowBatchSize: 2.26 KB (2318)
AGGREGATION_NODE (id=1):(Total: 7.000ms, non-child: 5.000ms, % non-child: 71.43%)
Node Lifecycle Event Timeline: 113.004ms
- Open Started: 103.003ms (103.003ms)
- Open Finished: 103.003ms (0.000ns)
- First Batch Requested: 103.003ms (0.000ns)
- First Batch Returned: 110.004ms (7.000ms)
- Last Batch Returned: 111.004ms (1.000ms)
- Closed: 113.004ms (2.000ms)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 38 (38)
- RowsReturnedRate: 5.43 K/sec
GroupingAggregator 0:
ExecOption: Streaming Preaggregation, Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 1.000ms
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 38 (38)
- StreamingTime: 5.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 2.000ms, non-child: 2.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/973.52 KB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:1
Node Lifecycle Event Timeline: 110.004ms
- Open Started: 103.003ms (103.003ms)
- Open Finished: 103.003ms (0.000ns)
- First Batch Requested: 103.003ms (0.000ns)
- First Batch Returned: 105.004ms (2.000ms)
- Last Batch Returned: 110.004ms (5.000ms)
- Closed: 110.004ms (0.000ns)
- BytesRead (500.000ms): 0
- FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- ParquetCompressedBytesReadPerColumn: (Avg: 20.82 KB (21315) ; Min: 20.82 KB (21315) ; Max: 20.82 KB (21315) ; Number of samples: 1)
- ParquetCompressedPageSize: (Avg: 10.41 KB (10657) ; Min: 2.06 KB (2106) ; Max: 18.76 KB (19209) ; Number of samples: 2)
- ParquetRowGroupActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1)
- ParquetRowGroupIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 1)
- ParquetUncompressedBytesReadPerColumn: (Avg: 54.18 KB (55481) ; Min: 54.18 KB (55481) ; Max: 54.18 KB (55481) ; Number of samples: 1)
- ParquetUncompressedPageSize: (Avg: 27.09 KB (27740) ; Min: 2.63 KB (2692) ; Max: 51.55 KB (52789) ; Number of samples: 2)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 121.33 KB (124247)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 121.33 KB (124247)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 121.33 KB (124247)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 1.74 MB (1827837)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 118.49 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.79 MB (1876992)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 693.00 KB (709632)
- RowBatchQueuePutWaitTime: 4.000ms
- RowBatchesEnqueued: 75 (75)
- RowsRead: 73.77K (73765)
- RowsReturned: 73.77K (73765)
- RowsReturnedRate: 36.88 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 5.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.751ms
- ScannerThreadsVoluntaryContextSwitches: 11 (11)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 1.00 MB (1048576)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 102.003ms, non-child: 102.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 2 (2)
- CodegenTotalWallClockTime: 102.003ms
- CodegenSysTime: 0.000ns
- CodegenUserTime: 101.876ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 27.001ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 57.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 14.000ms