Query d14e7f4f6f05165b:bdf7dc9a00000000
Query (id=d14e7f4f6f05165b:bdf7dc9a00000000):
Summary:
Session ID: cf4e551e2d0865e1:984ba5d3a7dd6b8a
Session Type: BEESWAX
Start Time: 2025-06-18 05:59:01.511987000
End Time: 2025-06-18 05:59:01.730483000
Query Type: DML
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 3.2.0-cdh6.3.2 RELEASE (build 1bb9836227301b839a32c6bc230e35439d5984ac)
User: root
Connected User: root
Delegated User:
Network Address: 172.19.5.216:52938
Default Db: default
Sql Statement: INSERT overwrite TABLE educator.event_data_impala_tmp SELECT event_name,count(1) as impala_count,date_time FROM educator.t_event WHERE date_time ='2025-06-17' GROUP BY event_name,date_time
Coordinator: hadoop001:22000
Query Options (set by configuration): CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Query Options (set by configuration and planner): MT_DOP=0,CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Plan:
----------------
Max Per-Host Resource Reservation: Memory=5.94MB Threads=3
Per-Host Resource Estimates: Memory=36MB
WARNING: The following tables have potentially corrupt table statistics.
Drop and re-compute statistics to resolve this problem.
educator.t_event
Analyzed query: SELECT event_name, count(*) impala_count, date_time FROM
educator.t_event WHERE date_time = '2025-06-17' GROUP BY event_name, date_time
F01:PLAN FRAGMENT [HASH(event_name,date_time)] hosts=1 instances=1
| Per-Host Resources: mem-estimate=10.05MB mem-reservation=1.94MB thread-reservation=1
WRITE TO HDFS [educator.event_data_impala_tmp, OVERWRITE=true]
| partitions=1
| mem-estimate=43B mem-reservation=0B thread-reservation=0
|
03:AGGREGATE [FINALIZE]
| output: count:merge(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 03(GETNEXT), 00(OPEN)
|
02:EXCHANGE [HASH(event_name,date_time)]
| mem-estimate=46.32KB mem-reservation=0B thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=26.00MB mem-reservation=4.00MB thread-reservation=2
01:AGGREGATE [STREAMING]
| output: count(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
00:SCAN HDFS [educator.t_event, RANDOM]
partition predicates: date_time = '2025-06-17'
partitions=1/1916 files=1 size=1.06MB
stored statistics:
table: rows=11759979 size=235.14MB
partitions: 1/1 rows=0
columns: all
extrapolated-rows=disabled max-scan-range-rows=11759979
mem-estimate=16.00MB mem-reservation=2.00MB thread-reservation=1
tuple-ids=0 row-size=34B cardinality=0
in pipelines: 00(GETNEXT)
----------------
Estimated Per-Host Mem: 37796169
Tables With Corrupt Table Stats: educator.t_event
Per Host Min Memory Reservation: hadoop001:22000(5.94 MB)
Request Pool: root.root
Admission result: Admitted immediately
Cluster Memory Admitted: 36.05 MB
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
-----------------------------------------------------------------------------------------------------------------------------
F01:HDFS WRITER 1 103.004ms 103.004ms 50.00 KB 43.00 B
03:AGGREGATE 1 0.000ns 0.000ns 45 0 1.98 MB 10.00 MB FINALIZE
02:EXCHANGE 1 0.000ns 0.000ns 45 0 128.00 KB 46.32 KB HASH(event_name,date_time)
F00:EXCHANGE SENDER 1 0.000ns 0.000ns 3.88 KB 0
01:AGGREGATE 1 5.000ms 5.000ms 45 0 2.07 MB 10.00 MB STREAMING
00:SCAN HDFS 1 1.000ms 1.000ms 80.12K 0 3.39 MB 16.00 MB educator.t_event
Errors:
Query Compilation: 1.756ms
- Metadata of all 2 tables cached: 289.768us (289.768us)
- Analysis finished: 703.994us (414.226us)
- Value transfer graph computed: 717.519us (13.525us)
- Single node plan created: 905.396us (187.877us)
- Runtime filters computed: 940.059us (34.663us)
- Distributed plan created: 961.271us (21.212us)
- Lineage info computed: 988.798us (27.527us)
- Planning finished: 1.756ms (767.559us)
Query Timeline: 307.012ms
- Query submitted: 0.000ns (0.000ns)
- Planning finished: 3.000ms (3.000ms)
- Submit for admission: 3.000ms (0.000ns)
- Completed admission: 3.000ms (0.000ns)
- Ready to start on 1 backends: 4.000ms (1.000ms)
- All 1 execution backends (2 fragment instances) started: 4.000ms (0.000ns)
- Last row fetched: 219.008ms (215.008ms)
- Released admission control resources: 219.008ms (0.000ns)
- DML data written: 219.008ms (0.000ns)
- DML Metastore update finished: 228.009ms (9.000ms)
- Request finished: 228.009ms (0.000ns)
- Unregister query: 305.012ms (77.003ms)
- AdmissionControlTimeSinceLastUpdate: 83.000ms
- ComputeScanRangeAssignmentTimer: 0.000ns
Frontend:
ImpalaServer:
- ClientFetchWaitTimer: 77.003ms
- MetastoreUpdateTimer: 9.000ms
- RowMaterializationTimer: 0.000ns
Execution Profile d14e7f4f6f05165b:bdf7dc9a00000000:(Total: 216.008ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, min / max: 0 / 0, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0
Slowest backend to start up:
Per Node Peak Memory Usage: hadoop001:22000(7.45 MB)
Per Node Bytes Read: hadoop001:22000(122.66 KB)
Per Node User Time: hadoop001:22000(178.235ms)
Per Node System Time: hadoop001:22000(3.041ms)
DML Stats:
Partition: Default
NumModifiedRows: 45
BytesWritten: 1.14 KB
- ExchangeScanRatio: 0.02
- FiltersReceived: 0 (0)
- FinalizationTimer: 7.000ms
- FileDeletionTimer: 1.000ms
- FileMoveTimer: 2.000ms
- Overwrite/PartitionCreationTimer: 2.000ms
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumFragmentInstances: 2 (2)
- NumFragments: 2 (2)
- TotalBytesRead: 122.66 KB (125601)
- TotalBytesSent: 1.86 KB (1906)
- TotalCpuTime: 181.276ms
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 1.86 KB (1906)
Per Node Profiles:
hadoop001:22000:
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
Averaged Fragment F01:(Total: 206.008ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:208.008ms max:208.008ms mean: 208.008ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2216483)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 28.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 206.008ms
- TotalThreadsSysTime: 2.048ms
- TotalThreadsUserTime: 76.493ms
- TotalThreadsVoluntaryContextSwitches: 28 (28)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 103.004ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 103.004ms
- ExecTreeOpenTime: 28.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 103.004ms, non-child: 103.004ms, % non-child: 100.00%)
- BytesWritten: 1.14 KB (1164)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 45 (45)
- TmpFileCreateTimer: 94.003ms
AGGREGATION_NODE (id=3):(Total: 28.001ms, non-child: 0.000ns, % non-child: 0.00%)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.61 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 15.36K (15360)
- LargestPartitionPercent: 17 (17)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 45 (45)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.19 MB (1245184)
- CumulativeAllocations: 19 (19)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.19 MB (1245184)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 28.001ms, non-child: 28.001ms, % non-child: 100.00%)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 128.00 KB (131072)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.61 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 128.00 KB (131072)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 27.001ms
- TotalBytesDequeued: 2.70 KB (2769)
- TotalGetBatchTime: 28.001ms
- DataWaitTime: 28.001ms
Enqueue:
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.86 KB (1906)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 75.002ms, non-child: 75.002ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 75.002ms
- CodegenSysTime: 991.000us
- CodegenUserTime: 74.001ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 18.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 12.000ms
Fragment F01:
Instance d14e7f4f6f05165b:bdf7dc9a00000001 (host=hadoop001:22000):(Total: 206.008ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-06-18 05:59:01.723
Fragment Instance Lifecycle Event Timeline: 207.008ms
- Prepare Finished: 1.000ms (1.000ms)
- Open Finished: 104.004ms (103.004ms)
- First Batch Produced: 104.004ms (0.000ns)
- First Batch Sent: 198.007ms (94.003ms)
- ExecInternal Finished: 207.008ms (9.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2216483)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 28.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 206.008ms
- TotalThreadsSysTime: 2.048ms
- TotalThreadsUserTime: 76.493ms
- TotalThreadsVoluntaryContextSwitches: 28 (28)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 103.004ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 103.004ms
- ExecTreeOpenTime: 28.001ms
- PrepareTime: 0.000ns
- ExecTreePrepareTime: 0.000ns
HdfsTableSink:(Total: 103.004ms, non-child: 103.004ms, % non-child: 100.00%)
- BytesWritten: 1.14 KB (1164)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 9.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 45 (45)
- TmpFileCreateTimer: 94.003ms
AGGREGATION_NODE (id=3):(Total: 28.001ms, non-child: 0.000ns, % non-child: 0.00%)
Node Lifecycle Event Timeline: 207.008ms
- Open Started: 76.003ms (76.003ms)
- Open Finished: 104.004ms (28.001ms)
- First Batch Requested: 104.004ms (0.000ns)
- First Batch Returned: 104.004ms (0.000ns)
- Last Batch Returned: 198.007ms (94.003ms)
- Closed: 207.008ms (9.000ms)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.61 K/sec
GroupingAggregator 0:
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 15.36K (15360)
- LargestPartitionPercent: 17 (17)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 45 (45)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.19 MB (1245184)
- CumulativeAllocations: 19 (19)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.19 MB (1245184)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 28.001ms, non-child: 0.000ns, % non-child: 0.00%)
Node Lifecycle Event Timeline: 104.004ms
- Open Started: 76.003ms (76.003ms)
- Open Finished: 103.004ms (27.001ms)
- First Batch Requested: 103.004ms (0.000ns)
- First Batch Returned: 104.004ms (1.000ms)
- Last Batch Returned: 104.004ms (0.000ns)
- Closed: 104.004ms (0.000ns)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 128.00 KB (131072)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.61 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 128.00 KB (131072)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 27.001ms
- TotalBytesDequeued: 2.70 KB (2769)
- TotalGetBatchTime: 28.001ms
- DataWaitTime: 28.001ms
Enqueue:
- DispatchTime: (Avg: 11.098us ; Min: 6.470us ; Max: 34.237us ; Number of samples: 14)
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.86 KB (1906)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 75.002ms, non-child: 75.002ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 75.002ms
- CodegenSysTime: 991.000us
- CodegenUserTime: 74.001ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 18.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 42.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 12.000ms
Averaged Fragment F00:(Total: 104.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 1.06 MB, max: 1.06 MB, avg: 1.06 MB, stddev: 0
completion times: min:208.008ms max:208.008ms mean: 208.008ms stddev:0.000ns
execution rates: min:5.12 MB/sec max:5.12 MB/sec mean:5.12 MB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.02
- PeakMemoryUsage: 5.47 MB (5733729)
- PeakReservation: 4.00 MB (4194304)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 106.004ms
- TotalThreadsSysTime: 993.000us
- TotalThreadsUserTime: 101.742ms
- TotalThreadsVoluntaryContextSwitches: 49 (49)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 97.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 45 (45)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.86 KB (1906)
- UncompressedRowBatchSize: 2.70 KB (2769)
AGGREGATION_NODE (id=1):(Total: 6.000ms, non-child: 5.000ms, % non-child: 83.33%)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 45 (45)
- RowsReturnedRate: 7.50 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 1.000ms
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 45 (45)
- StreamingTime: 4.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 122.66 KB (125601)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 122.66 KB (125601)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 122.66 KB (125601)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 1.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.39 MB (3552463)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 0.00 /sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.94 MB (2030592)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 1.32 MB (1385472)
- RowBatchQueuePutWaitTime: 1.000ms
- RowBatchesEnqueued: 81 (81)
- RowsRead: 80.12K (80122)
- RowsReturned: 80.12K (80122)
- RowsReturnedRate: 80.12 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 0.000ns
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 3.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.661ms
- ScannerThreadsVoluntaryContextSwitches: 31 (31)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 0.000ns
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 97.003ms, non-child: 97.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 97.003ms
- CodegenSysTime: 992.000us
- CodegenUserTime: 95.992ms
- CodegenVoluntaryContextSwitches: 1 (1)
- CompileTime: 25.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 56.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 12.000ms
Fragment F00:
Instance d14e7f4f6f05165b:bdf7dc9a00000000 (host=hadoop001:22000):(Total: 104.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-06-18 05:59:01.723
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/1.06 MB
Fragment Instance Lifecycle Event Timeline: 104.004ms
- Prepare Finished: 1.000ms (1.000ms)
- Open Finished: 98.003ms (97.003ms)
- First Batch Produced: 103.004ms (5.000ms)
- First Batch Sent: 103.004ms (0.000ns)
- ExecInternal Finished: 104.004ms (1.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.02
- PeakMemoryUsage: 5.47 MB (5733729)
- PeakReservation: 4.00 MB (4194304)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 106.004ms
- TotalThreadsSysTime: 993.000us
- TotalThreadsUserTime: 101.742ms
- TotalThreadsVoluntaryContextSwitches: 49 (49)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 97.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Hash Partitioned Sender Codegen Enabled
- NetworkThroughput: (Avg: 2.57 MB/sec ; Min: 1.05 MB/sec ; Max: 5.17 MB/sec ; Number of samples: 14)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 45 (45)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.86 KB (1906)
- UncompressedRowBatchSize: 2.70 KB (2769)
AGGREGATION_NODE (id=1):(Total: 6.000ms, non-child: 5.000ms, % non-child: 83.33%)
Node Lifecycle Event Timeline: 104.004ms
- Open Started: 98.003ms (98.003ms)
- Open Finished: 98.003ms (0.000ns)
- First Batch Requested: 98.003ms (0.000ns)
- First Batch Returned: 103.004ms (5.000ms)
- Last Batch Returned: 104.004ms (1.000ms)
- Closed: 104.004ms (0.000ns)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 45 (45)
- RowsReturnedRate: 7.50 K/sec
GroupingAggregator 0:
ExecOption: Streaming Preaggregation, Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 1.000ms
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 45 (45)
- StreamingTime: 4.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/1.06 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:1
Node Lifecycle Event Timeline: 103.004ms
- Open Started: 98.003ms (98.003ms)
- Open Finished: 98.003ms (0.000ns)
- First Batch Requested: 98.003ms (0.000ns)
- First Batch Returned: 99.003ms (1.000ms)
- Last Batch Returned: 103.004ms (4.000ms)
- Closed: 103.004ms (0.000ns)
- FooterProcessingTime: (Avg: 1.000ms ; Min: 1.000ms ; Max: 1.000ms ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 2.00 MB (2097152) ; Min: 2.00 MB (2097152) ; Max: 2.00 MB (2097152) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- ParquetCompressedBytesReadPerColumn: (Avg: 22.06 KB (22585) ; Min: 22.06 KB (22585) ; Max: 22.06 KB (22585) ; Number of samples: 1)
- ParquetCompressedPageSize: (Avg: 11.03 KB (11292) ; Min: 3.42 KB (3507) ; Max: 18.63 KB (19078) ; Number of samples: 2)
- ParquetRowGroupActualReservation: (Avg: 2.00 MB (2097152) ; Min: 2.00 MB (2097152) ; Max: 2.00 MB (2097152) ; Number of samples: 1)
- ParquetRowGroupIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 1)
- ParquetUncompressedBytesReadPerColumn: (Avg: 58.85 KB (60260) ; Min: 58.85 KB (60260) ; Max: 58.85 KB (60260) ; Number of samples: 1)
- ParquetUncompressedPageSize: (Avg: 29.42 KB (30130) ; Min: 7.17 KB (7345) ; Max: 51.67 KB (52915) ; Number of samples: 2)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 122.66 KB (125601)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 122.66 KB (125601)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 122.66 KB (125601)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 1.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.39 MB (3552463)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 0.00 /sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.94 MB (2030592)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 1.32 MB (1385472)
- RowBatchQueuePutWaitTime: 1.000ms
- RowBatchesEnqueued: 81 (81)
- RowsRead: 80.12K (80122)
- RowsReturned: 80.12K (80122)
- RowsReturnedRate: 80.12 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 0.000ns
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 3.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.661ms
- ScannerThreadsVoluntaryContextSwitches: 31 (31)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 0.000ns
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 97.003ms, non-child: 97.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 97.003ms
- CodegenSysTime: 992.000us
- CodegenUserTime: 95.992ms
- CodegenVoluntaryContextSwitches: 1 (1)
- CompileTime: 25.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 56.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 12.000ms