Query 0a4dc6df6f944080:f23f0b9f00000000
Query (id=0a4dc6df6f944080:f23f0b9f00000000):
Summary:
Session ID: be40581b86dced4f:35cc075abdd6a892
Session Type: BEESWAX
Start Time: 2025-09-17 05:47:02.010635000
End Time: 2025-09-17 05:47:02.147302000
Query Type: DML
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 3.2.0-cdh6.3.2 RELEASE (build 1bb9836227301b839a32c6bc230e35439d5984ac)
User: root
Connected User: root
Delegated User:
Network Address: 172.19.5.216:39186
Default Db: default
Sql Statement: INSERT overwrite TABLE educator.event_data_impala_tmp SELECT event_name,count(1) as impala_count,date_time FROM educator.t_event WHERE date_time ='2025-09-16' GROUP BY event_name,date_time
Coordinator: hadoop001:22000
Query Options (set by configuration): CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Query Options (set by configuration and planner): MT_DOP=0,CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Plan:
----------------
Max Per-Host Resource Reservation: Memory=4.94MB Threads=3
Per-Host Resource Estimates: Memory=36MB
WARNING: The following tables have potentially corrupt table statistics.
Drop and re-compute statistics to resolve this problem.
educator.t_event
Analyzed query: SELECT event_name, count(*) impala_count, date_time FROM
educator.t_event WHERE date_time = '2025-09-16' GROUP BY event_name, date_time
F01:PLAN FRAGMENT [HASH(event_name,date_time)] hosts=1 instances=1
| Per-Host Resources: mem-estimate=10.05MB mem-reservation=1.94MB thread-reservation=1
WRITE TO HDFS [educator.event_data_impala_tmp, OVERWRITE=true]
| partitions=1
| mem-estimate=43B mem-reservation=0B thread-reservation=0
|
03:AGGREGATE [FINALIZE]
| output: count:merge(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 03(GETNEXT), 00(OPEN)
|
02:EXCHANGE [HASH(event_name,date_time)]
| mem-estimate=46.32KB mem-reservation=0B thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=26.00MB mem-reservation=3.00MB thread-reservation=2
01:AGGREGATE [STREAMING]
| output: count(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
00:SCAN HDFS [educator.t_event, RANDOM]
partition predicates: date_time = '2025-09-16'
partitions=1/2007 files=1 size=973.52KB
stored statistics:
table: rows=11759979 size=235.14MB
partitions: 1/1 rows=0
columns: all
extrapolated-rows=disabled max-scan-range-rows=11759979
mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=1
tuple-ids=0 row-size=34B cardinality=0
in pipelines: 00(GETNEXT)
----------------
Estimated Per-Host Mem: 37796169
Tables With Corrupt Table Stats: educator.t_event
Per Host Min Memory Reservation: hadoop002:22000(4.94 MB)
Request Pool: root.root
Admission result: Admitted immediately
Cluster Memory Admitted: 36.05 MB
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
---------------------------------------------------------------------------------------------------------------------------
F01:HDFS WRITER 1 14.000ms 14.000ms 50.00 KB 43.00 B
03:AGGREGATE 1 2.000ms 2.000ms 38 0 1.98 MB 10.00 MB FINALIZE
02:EXCHANGE 1 0.000ns 0.000ns 38 0 120.00 KB 46.32 KB HASH(event_name,date_time)
F00:EXCHANGE SENDER 1 0.000ns 0.000ns 3.88 KB 0
01:AGGREGATE 1 3.000ms 3.000ms 38 0 2.07 MB 10.00 MB STREAMING
00:SCAN HDFS 1 2.000ms 2.000ms 73.77K 0 1.74 MB 16.00 MB educator.t_event
Errors:
Query Compilation: 1.513ms
- Metadata of all 2 tables cached: 248.170us (248.170us)
- Analysis finished: 588.322us (340.152us)
- Value transfer graph computed: 596.157us (7.835us)
- Single node plan created: 703.313us (107.156us)
- Runtime filters computed: 730.500us (27.187us)
- Distributed plan created: 740.469us (9.969us)
- Lineage info computed: 763.533us (23.064us)
- Planning finished: 1.513ms (750.283us)
Query Timeline: 206.008ms
- Query submitted: 0.000ns (0.000ns)
- Planning finished: 2.000ms (2.000ms)
- Submit for admission: 3.000ms (1.000ms)
- Completed admission: 3.000ms (0.000ns)
- Ready to start on 1 backends: 3.000ms (0.000ns)
- All 1 execution backends (2 fragment instances) started: 4.000ms (1.000ms)
- Last row fetched: 137.005ms (133.005ms)
- Released admission control resources: 137.005ms (0.000ns)
- DML data written: 137.005ms (0.000ns)
- DML Metastore update finished: 144.005ms (7.000ms)
- Request finished: 144.005ms (0.000ns)
- Unregister query: 204.008ms (60.002ms)
- AdmissionControlTimeSinceLastUpdate: 85.000ms
- ComputeScanRangeAssignmentTimer: 0.000ns
Frontend:
ImpalaServer:
- ClientFetchWaitTimer: 60.002ms
- MetastoreUpdateTimer: 7.000ms
- RowMaterializationTimer: 0.000ns
Execution Profile 0a4dc6df6f944080:f23f0b9f00000000:(Total: 134.005ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms
Slowest backend to start up: hadoop002:22000
Per Node Peak Memory Usage: hadoop002:22000(6.14 MB)
Per Node Bytes Read: hadoop002:22000(121.33 KB)
Per Node User Time: hadoop002:22000(185.576ms)
Per Node System Time: hadoop002:22000(3.809ms)
DML Stats:
Partition: Default
NumModifiedRows: 38
BytesWritten: 967.00 B
- ExchangeScanRatio: 0.01
- FiltersReceived: 0 (0)
- FinalizationTimer: 8.000ms
- FileDeletionTimer: 1.000ms
- FileMoveTimer: 2.000ms
- Overwrite/PartitionCreationTimer: 3.000ms
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumFragmentInstances: 2 (2)
- NumFragments: 2 (2)
- TotalBytesRead: 121.33 KB (124247)
- TotalBytesSent: 1.58 KB (1617)
- TotalCpuTime: 189.385ms
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 1.58 KB (1617)
Per Node Profiles:
hadoop002:22000:
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
Averaged Fragment F01:(Total: 123.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:125.004ms max:125.004ms mean: 125.004ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 27.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 4 (4)
- TotalThreadsTotalWallClockTime: 123.004ms
- TotalThreadsSysTime: 992.000us
- TotalThreadsUserTime: 80.812ms
- TotalThreadsVoluntaryContextSwitches: 29 (29)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 15.000ms
- ExecTreeExecTime: 1.000ms
- OpenTime: 108.004ms
- ExecTreeOpenTime: 28.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 14.000ms, non-child: 14.000ms, % non-child: 100.00%)
- BytesWritten: 967.00 B (967)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 38 (38)
- TmpFileCreateTimer: 5.000ms
AGGREGATION_NODE (id=3):(Total: 29.001ms, non-child: 2.000ms, % non-child: 6.90%)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.31 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 13.31K (13312)
- LargestPartitionPercent: 21 (21)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 38 (38)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.06 MB (1114112)
- CumulativeAllocations: 17 (17)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.06 MB (1114112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 27.001ms, non-child: 27.001ms, % non-child: 100.00%)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.41 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 27.001ms
- TotalBytesDequeued: 2.26 KB (2318)
- TotalGetBatchTime: 27.001ms
- DataWaitTime: 27.001ms
Enqueue:
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.58 KB (1617)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 80.003ms, non-child: 80.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 4 (4)
- CodegenTotalWallClockTime: 80.003ms
- CodegenSysTime: 992.000us
- CodegenUserTime: 78.433ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 22.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 13.000ms
Fragment F01:
Instance 0a4dc6df6f944080:f23f0b9f00000001 (host=hadoop002:22000):(Total: 123.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-09-17 05:47:02.139
Fragment Instance Lifecycle Event Timeline: 123.004ms
- Prepare Finished: 0.000ns (0.000ns)
- Open Finished: 108.004ms (108.004ms)
- First Batch Produced: 109.004ms (1.000ms)
- First Batch Sent: 114.004ms (5.000ms)
- ExecInternal Finished: 123.004ms (9.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 27.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 4 (4)
- TotalThreadsTotalWallClockTime: 123.004ms
- TotalThreadsSysTime: 992.000us
- TotalThreadsUserTime: 80.812ms
- TotalThreadsVoluntaryContextSwitches: 29 (29)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 15.000ms
- ExecTreeExecTime: 1.000ms
- OpenTime: 108.004ms
- ExecTreeOpenTime: 28.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 14.000ms, non-child: 14.000ms, % non-child: 100.00%)
- BytesWritten: 967.00 B (967)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 38 (38)
- TmpFileCreateTimer: 5.000ms
AGGREGATION_NODE (id=3):(Total: 29.001ms, non-child: 2.000ms, % non-child: 6.90%)
Node Lifecycle Event Timeline: 123.004ms
- Open Started: 80.003ms (80.003ms)
- Open Finished: 108.004ms (28.001ms)
- First Batch Requested: 108.004ms (0.000ns)
- First Batch Returned: 109.004ms (1.000ms)
- Last Batch Returned: 114.004ms (5.000ms)
- Closed: 123.004ms (9.000ms)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.31 K/sec
GroupingAggregator 0:
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 13.31K (13312)
- LargestPartitionPercent: 21 (21)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 38 (38)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.06 MB (1114112)
- CumulativeAllocations: 17 (17)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.06 MB (1114112)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 27.001ms, non-child: 0.000ns, % non-child: 0.00%)
Node Lifecycle Event Timeline: 108.004ms
- Open Started: 80.003ms (80.003ms)
- Open Finished: 107.004ms (27.001ms)
- First Batch Requested: 108.004ms (1.000ms)
- First Batch Returned: 108.004ms (0.000ns)
- Last Batch Returned: 108.004ms (0.000ns)
- Closed: 108.004ms (0.000ns)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 38 (38)
- RowsReturnedRate: 1.41 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 27.001ms
- TotalBytesDequeued: 2.26 KB (2318)
- TotalGetBatchTime: 27.001ms
- DataWaitTime: 27.001ms
Enqueue:
- DispatchTime: (Avg: 11.163us ; Min: 7.112us ; Max: 30.095us ; Number of samples: 14)
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.58 KB (1617)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 80.003ms, non-child: 80.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 4 (4)
- CodegenTotalWallClockTime: 80.003ms
- CodegenSysTime: 992.000us
- CodegenUserTime: 78.433ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 22.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 13.000ms
Averaged Fragment F00:(Total: 108.004ms, non-child: 1.000ms, % non-child: 0.93%)
split sizes: min: 973.52 KB, max: 973.52 KB, avg: 973.52 KB, stddev: 0
completion times: min:125.004ms max:125.004ms mean: 125.004ms stddev:0.000ns
execution rates: min:7.61 MB/sec max:7.61 MB/sec mean:7.61 MB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.01
- PeakMemoryUsage: 3.82 MB (4009103)
- PeakReservation: 3.00 MB (3145728)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 112.004ms
- TotalThreadsSysTime: 2.817ms
- TotalThreadsUserTime: 104.764ms
- TotalThreadsVoluntaryContextSwitches: 73 (73)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 102.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 38 (38)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.58 KB (1617)
- UncompressedRowBatchSize: 2.26 KB (2318)
AGGREGATION_NODE (id=1):(Total: 5.000ms, non-child: 3.000ms, % non-child: 60.00%)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 38 (38)
- RowsReturnedRate: 7.60 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 38 (38)
- StreamingTime: 3.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 2.000ms, non-child: 2.000ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 121.33 KB (124247)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 121.33 KB (124247)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 121.33 KB (124247)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 1.74 MB (1827837)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 118.49 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.79 MB (1876992)
- RowBatchQueueGetWaitTime: 2.000ms
- RowBatchQueuePeakMemoryUsage: 693.00 KB (709632)
- RowBatchQueuePutWaitTime: 2.000ms
- RowBatchesEnqueued: 75 (75)
- RowsRead: 73.77K (73765)
- RowsReturned: 73.77K (73765)
- RowsReturnedRate: 36.88 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 4.000ms
- ScannerThreadsSysTime: 799.000us
- ScannerThreadsUserTime: 799.000us
- ScannerThreadsVoluntaryContextSwitches: 56 (56)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 1.00 MB (1048576)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 101.003ms, non-child: 101.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 3 (3)
- CodegenTotalWallClockTime: 101.003ms
- CodegenSysTime: 1.987ms
- CodegenUserTime: 98.971ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 26.001ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 59.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 12.000ms
Fragment F00:
Instance 0a4dc6df6f944080:f23f0b9f00000000 (host=hadoop002:22000):(Total: 108.004ms, non-child: 1.000ms, % non-child: 0.93%)
Last report received time: 2025-09-17 05:47:02.139
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/973.52 KB
Fragment Instance Lifecycle Event Timeline: 108.004ms
- Prepare Finished: 0.000ns (0.000ns)
- Open Finished: 102.003ms (102.003ms)
- First Batch Produced: 107.004ms (5.000ms)
- First Batch Sent: 107.004ms (0.000ns)
- ExecInternal Finished: 108.004ms (1.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.01
- PeakMemoryUsage: 3.82 MB (4009103)
- PeakReservation: 3.00 MB (3145728)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 6.14 MB (6440064)
- RowsProduced: 38 (38)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 3 (3)
- TotalThreadsTotalWallClockTime: 112.004ms
- TotalThreadsSysTime: 2.817ms
- TotalThreadsUserTime: 104.764ms
- TotalThreadsVoluntaryContextSwitches: 73 (73)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 102.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Hash Partitioned Sender Codegen Enabled
- NetworkThroughput: (Avg: 2.20 MB/sec ; Min: 958.96 KB/sec ; Max: 6.57 MB/sec ; Number of samples: 14)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 38 (38)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.58 KB (1617)
- UncompressedRowBatchSize: 2.26 KB (2318)
AGGREGATION_NODE (id=1):(Total: 5.000ms, non-child: 3.000ms, % non-child: 60.00%)
Node Lifecycle Event Timeline: 108.004ms
- Open Started: 102.003ms (102.003ms)
- Open Finished: 102.003ms (0.000ns)
- First Batch Requested: 102.003ms (0.000ns)
- First Batch Returned: 107.004ms (5.000ms)
- Last Batch Returned: 108.004ms (1.000ms)
- Closed: 108.004ms (0.000ns)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 38 (38)
- RowsReturnedRate: 7.60 K/sec
GroupingAggregator 0:
ExecOption: Streaming Preaggregation, Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 38 (38)
- StreamingTime: 3.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 2.000ms, non-child: 2.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/973.52 KB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:1
Node Lifecycle Event Timeline: 107.004ms
- Open Started: 102.003ms (102.003ms)
- Open Finished: 102.003ms (0.000ns)
- First Batch Requested: 102.003ms (0.000ns)
- First Batch Returned: 104.004ms (2.000ms)
- Last Batch Returned: 107.004ms (3.000ms)
- Closed: 107.004ms (0.000ns)
- FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- ParquetCompressedBytesReadPerColumn: (Avg: 20.82 KB (21315) ; Min: 20.82 KB (21315) ; Max: 20.82 KB (21315) ; Number of samples: 1)
- ParquetCompressedPageSize: (Avg: 10.41 KB (10657) ; Min: 2.06 KB (2106) ; Max: 18.76 KB (19209) ; Number of samples: 2)
- ParquetRowGroupActualReservation: (Avg: 1.00 MB (1048576) ; Min: 1.00 MB (1048576) ; Max: 1.00 MB (1048576) ; Number of samples: 1)
- ParquetRowGroupIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 1)
- ParquetUncompressedBytesReadPerColumn: (Avg: 54.18 KB (55481) ; Min: 54.18 KB (55481) ; Max: 54.18 KB (55481) ; Number of samples: 1)
- ParquetUncompressedPageSize: (Avg: 27.09 KB (27740) ; Min: 2.63 KB (2692) ; Max: 51.55 KB (52789) ; Number of samples: 2)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 121.33 KB (124247)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 121.33 KB (124247)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 121.33 KB (124247)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 1.74 MB (1827837)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 118.49 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.79 MB (1876992)
- RowBatchQueueGetWaitTime: 2.000ms
- RowBatchQueuePeakMemoryUsage: 693.00 KB (709632)
- RowBatchQueuePutWaitTime: 2.000ms
- RowBatchesEnqueued: 75 (75)
- RowsRead: 73.77K (73765)
- RowsReturned: 73.77K (73765)
- RowsReturnedRate: 36.88 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 4.000ms
- ScannerThreadsSysTime: 799.000us
- ScannerThreadsUserTime: 799.000us
- ScannerThreadsVoluntaryContextSwitches: 56 (56)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 1.00 MB (1048576)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 101.003ms, non-child: 101.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 3 (3)
- CodegenTotalWallClockTime: 101.003ms
- CodegenSysTime: 1.987ms
- CodegenUserTime: 98.971ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 26.001ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 59.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 12.000ms