Query ac450713a0b17d3c:9ab7ed8f00000000
Query (id=ac450713a0b17d3c:9ab7ed8f00000000):
Summary:
Session ID: bd45593488ae2b5c:311581104571c0a8
Session Type: BEESWAX
Start Time: 2025-06-18 05:55:01.455270000
End Time: 2025-06-18 05:55:01.585148000
Query Type: DML
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 3.2.0-cdh6.3.2 RELEASE (build 1bb9836227301b839a32c6bc230e35439d5984ac)
User: root
Connected User: root
Delegated User:
Network Address: 172.19.5.216:50580
Default Db: default
Sql Statement: INSERT overwrite TABLE educator.event_data_impala_tmp SELECT event_name,count(1) as impala_count,date_time FROM educator.t_event WHERE date_time ='2025-06-17' GROUP BY event_name,date_time
Coordinator: hadoop001:22000
Query Options (set by configuration): CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Query Options (set by configuration and planner): MT_DOP=0,CLIENT_IDENTIFIER=Impala Shell v3.2.0-cdh6.3.2 (1bb9836) built on Fri Nov 8 07:22:06 PST 2019
Plan:
----------------
Max Per-Host Resource Reservation: Memory=5.94MB Threads=3
Per-Host Resource Estimates: Memory=36MB
WARNING: The following tables have potentially corrupt table statistics.
Drop and re-compute statistics to resolve this problem.
educator.t_event
Analyzed query: SELECT event_name, count(*) impala_count, date_time FROM
educator.t_event WHERE date_time = '2025-06-17' GROUP BY event_name, date_time
F01:PLAN FRAGMENT [HASH(event_name,date_time)] hosts=1 instances=1
| Per-Host Resources: mem-estimate=10.05MB mem-reservation=1.94MB thread-reservation=1
WRITE TO HDFS [educator.event_data_impala_tmp, OVERWRITE=true]
| partitions=1
| mem-estimate=43B mem-reservation=0B thread-reservation=0
|
03:AGGREGATE [FINALIZE]
| output: count:merge(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 03(GETNEXT), 00(OPEN)
|
02:EXCHANGE [HASH(event_name,date_time)]
| mem-estimate=46.32KB mem-reservation=0B thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
Per-Host Resources: mem-estimate=26.00MB mem-reservation=4.00MB thread-reservation=2
01:AGGREGATE [STREAMING]
| output: count(*)
| group by: event_name, date_time
| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=1 row-size=42B cardinality=0
| in pipelines: 00(GETNEXT)
|
00:SCAN HDFS [educator.t_event, RANDOM]
partition predicates: date_time = '2025-06-17'
partitions=1/1916 files=1 size=1.06MB
stored statistics:
table: rows=11759979 size=235.14MB
partitions: 1/1 rows=0
columns: all
extrapolated-rows=disabled max-scan-range-rows=11759979
mem-estimate=16.00MB mem-reservation=2.00MB thread-reservation=1
tuple-ids=0 row-size=34B cardinality=0
in pipelines: 00(GETNEXT)
----------------
Estimated Per-Host Mem: 37796169
Tables With Corrupt Table Stats: educator.t_event
Per Host Min Memory Reservation: hadoop001:22000(5.94 MB)
Request Pool: root.root
Admission result: Admitted immediately
Cluster Memory Admitted: 36.05 MB
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
---------------------------------------------------------------------------------------------------------------------------
F01:HDFS WRITER 1 12.000ms 12.000ms 50.00 KB 43.00 B
03:AGGREGATE 1 2.000ms 2.000ms 45 0 1.98 MB 10.00 MB FINALIZE
02:EXCHANGE 1 0.000ns 0.000ns 45 0 120.00 KB 46.32 KB HASH(event_name,date_time)
F00:EXCHANGE SENDER 1 0.000ns 0.000ns 3.88 KB 0
01:AGGREGATE 1 2.000ms 2.000ms 45 0 2.07 MB 10.00 MB STREAMING
00:SCAN HDFS 1 4.000ms 4.000ms 80.12K 0 3.39 MB 16.00 MB educator.t_event
Errors:
Query Compilation: 1.719ms
- Metadata of all 2 tables cached: 259.446us (259.446us)
- Analysis finished: 664.798us (405.352us)
- Value transfer graph computed: 677.562us (12.764us)
- Single node plan created: 872.122us (194.560us)
- Runtime filters computed: 906.663us (34.541us)
- Distributed plan created: 927.024us (20.361us)
- Lineage info computed: 954.571us (27.547us)
- Planning finished: 1.719ms (765.098us)
Query Timeline: 205.008ms
- Query submitted: 0.000ns (0.000ns)
- Planning finished: 2.000ms (2.000ms)
- Submit for admission: 2.000ms (0.000ns)
- Completed admission: 2.000ms (0.000ns)
- Ready to start on 1 backends: 3.000ms (1.000ms)
- All 1 execution backends (2 fragment instances) started: 3.000ms (0.000ns)
- Last row fetched: 129.005ms (126.004ms)
- Released admission control resources: 130.005ms (1.000ms)
- DML data written: 130.005ms (0.000ns)
- DML Metastore update finished: 136.005ms (6.000ms)
- Request finished: 136.005ms (0.000ns)
- Unregister query: 204.008ms (68.002ms)
- AdmissionControlTimeSinceLastUpdate: 99.000ms
- ComputeScanRangeAssignmentTimer: 0.000ns
Frontend:
ImpalaServer:
- ClientFetchWaitTimer: 68.002ms
- MetastoreUpdateTimer: 6.000ms
- RowMaterializationTimer: 0.000ns
Execution Profile ac450713a0b17d3c:9ab7ed8f00000000:(Total: 128.005ms, non-child: 0.000ns, % non-child: 0.00%)
Number of filters: 0
Filter routing table:
ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled
-------------------------------------------------------------------------------------------------------------------
Backend startup latencies: Count: 1, min / max: 0 / 0, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0
Slowest backend to start up:
Per Node Peak Memory Usage: hadoop001:22000(7.45 MB)
Per Node Bytes Read: hadoop001:22000(122.66 KB)
Per Node User Time: hadoop001:22000(180.510ms)
Per Node System Time: hadoop001:22000(3.777ms)
DML Stats:
Partition: Default
NumModifiedRows: 45
BytesWritten: 1.14 KB
- ExchangeScanRatio: 0.02
- FiltersReceived: 0 (0)
- FinalizationTimer: 6.000ms
- FileDeletionTimer: 1.000ms
- FileMoveTimer: 2.000ms
- Overwrite/PartitionCreationTimer: 2.000ms
- InnerNodeSelectivityRatio: 0.00
- NumBackends: 1 (1)
- NumFragmentInstances: 2 (2)
- NumFragments: 2 (2)
- TotalBytesRead: 122.66 KB (125601)
- TotalBytesSent: 1.86 KB (1906)
- TotalCpuTime: 184.287ms
- TotalInnerBytesSent: 0
- TotalScanBytesSent: 1.86 KB (1906)
Per Node Profiles:
hadoop001:22000:
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
Averaged Fragment F01:(Total: 119.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:120.004ms max:120.004ms mean: 120.004ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 30.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 118.004ms
- TotalThreadsSysTime: 1.761ms
- TotalThreadsUserTime: 76.465ms
- TotalThreadsVoluntaryContextSwitches: 28 (28)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 12.000ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 106.004ms
- ExecTreeOpenTime: 31.001ms
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
HdfsTableSink:(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
- BytesWritten: 1.14 KB (1164)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 8.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 45 (45)
- TmpFileCreateTimer: 4.000ms
AGGREGATION_NODE (id=3):(Total: 32.001ms, non-child: 2.000ms, % non-child: 6.25%)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.41 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 15.36K (15360)
- LargestPartitionPercent: 17 (17)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 45 (45)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 1.000ms
- CumulativeAllocationBytes: 1.19 MB (1245184)
- CumulativeAllocations: 19 (19)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.19 MB (1245184)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 30.001ms, non-child: 30.001ms, % non-child: 100.00%)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.50 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 30.001ms
- TotalBytesDequeued: 2.70 KB (2769)
- TotalGetBatchTime: 30.001ms
- DataWaitTime: 30.001ms
Enqueue:
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.86 KB (1906)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 75.002ms, non-child: 75.002ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 75.002ms
- CodegenSysTime: 1.728ms
- CodegenUserTime: 73.247ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 17.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 41.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 14.000ms
Fragment F01:
Instance ac450713a0b17d3c:9ab7ed8f00000001 (host=hadoop001:22000):(Total: 119.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-06-18 05:55:01.578
Fragment Instance Lifecycle Event Timeline: 119.004ms
- Prepare Finished: 1.000ms (1.000ms)
- Open Finished: 107.004ms (106.004ms)
- First Batch Produced: 107.004ms (0.000ns)
- First Batch Sent: 111.004ms (4.000ms)
- ExecInternal Finished: 119.004ms (8.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.00
- PeakMemoryUsage: 2.11 MB (2208291)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 30.001ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 118.004ms
- TotalThreadsSysTime: 1.761ms
- TotalThreadsUserTime: 76.465ms
- TotalThreadsVoluntaryContextSwitches: 28 (28)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 12.000ms
- ExecTreeExecTime: 0.000ns
- OpenTime: 106.004ms
- ExecTreeOpenTime: 31.001ms
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
HdfsTableSink:(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%)
- BytesWritten: 1.14 KB (1164)
- CompressTimer: 0.000ns
- EncodeTimer: 0.000ns
- FilesCreated: 1 (1)
- FinalizePartitionFileTimer: 8.000ms
- HdfsWriteTimer: 0.000ns
- PartitionsCreated: 1 (1)
- PeakMemoryUsage: 50.00 KB (51200)
- RowsInserted: 45 (45)
- TmpFileCreateTimer: 4.000ms
AGGREGATION_NODE (id=3):(Total: 32.001ms, non-child: 2.000ms, % non-child: 6.25%)
Node Lifecycle Event Timeline: 119.004ms
- Open Started: 76.003ms (76.003ms)
- Open Finished: 107.004ms (31.001ms)
- First Batch Requested: 107.004ms (0.000ns)
- First Batch Returned: 107.004ms (0.000ns)
- Last Batch Returned: 111.004ms (4.000ms)
- Closed: 119.004ms (8.000ms)
- PeakMemoryUsage: 1.98 MB (2074752)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.41 K/sec
GroupingAggregator 0:
ExecOption: Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 15.36K (15360)
- LargestPartitionPercent: 17 (17)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 1.97 MB (2070656)
- PeakReservation: 1.94 MB (2031616)
- PeakUsedReservation: 0
- RowsRepartitioned: 0 (0)
- RowsReturned: 45 (45)
- SpilledPartitions: 0 (0)
Buffer pool:
- AllocTime: 1.000ms
- CumulativeAllocationBytes: 1.19 MB (1245184)
- CumulativeAllocations: 19 (19)
- PeakReservation: 1.94 MB (2031616)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.19 MB (1245184)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
EXCHANGE_NODE (id=2):(Total: 30.001ms, non-child: 0.000ns, % non-child: 0.00%)
Node Lifecycle Event Timeline: 107.004ms
- Open Started: 76.003ms (76.003ms)
- Open Finished: 106.004ms (30.001ms)
- First Batch Requested: 107.004ms (1.000ms)
- First Batch Returned: 107.004ms (0.000ns)
- Last Batch Returned: 107.004ms (0.000ns)
- Closed: 107.004ms (0.000ns)
- ConvertRowBatchTime: 0.000ns
- PeakMemoryUsage: 120.00 KB (122880)
- RowsReturned: 45 (45)
- RowsReturnedRate: 1.50 K/sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 224.00 KB (229376)
- CumulativeAllocations: 28 (28)
- PeakReservation: 120.00 KB (122880)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 120.00 KB (122880)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Dequeue:
- FirstBatchWaitTime: 30.001ms
- TotalBytesDequeued: 2.70 KB (2769)
- TotalGetBatchTime: 30.001ms
- DataWaitTime: 30.001ms
Enqueue:
- DispatchTime: (Avg: 10.971us ; Min: 6.987us ; Max: 32.317us ; Number of samples: 14)
- DeserializeRowBatchTime: 0.000ns
- TotalBatchesEnqueued: 14 (14)
- TotalBatchesReceived: 14 (14)
- TotalBytesReceived: 1.86 KB (1906)
- TotalEarlySenders: 0 (0)
- TotalEosReceived: 1 (1)
- TotalHasDeferredRPCsTime: 0.000ns
- TotalRPCsDeferred: 0 (0)
CodeGen:(Total: 75.002ms, non-child: 75.002ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 75.002ms
- CodegenSysTime: 1.728ms
- CodegenUserTime: 73.247ms
- CodegenVoluntaryContextSwitches: 0 (0)
- CompileTime: 17.000ms
- IrGenerationTime: 2.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 44 (44)
- NumInstructions: 872 (872)
- OptimizationTime: 41.001ms
- PeakMemoryUsage: 436.00 KB (446464)
- PrepareTime: 14.000ms
Averaged Fragment F00:(Total: 107.004ms, non-child: 0.000ns, % non-child: 0.00%)
split sizes: min: 1.06 MB, max: 1.06 MB, avg: 1.06 MB, stddev: 0
completion times: min:120.004ms max:120.004ms mean: 120.004ms stddev:0.000ns
execution rates: min:8.87 MB/sec max:8.87 MB/sec mean:8.87 MB/sec stddev:0.00 /sec
num instances: 1
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.02
- PeakMemoryUsage: 5.47 MB (5733729)
- PeakReservation: 4.00 MB (4194304)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 109.004ms
- TotalThreadsSysTime: 2.016ms
- TotalThreadsUserTime: 104.045ms
- TotalThreadsVoluntaryContextSwitches: 55 (55)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 100.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 45 (45)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.86 KB (1906)
- UncompressedRowBatchSize: 2.70 KB (2769)
AGGREGATION_NODE (id=1):(Total: 6.000ms, non-child: 2.000ms, % non-child: 33.33%)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 45 (45)
- RowsReturnedRate: 7.50 K/sec
GroupingAggregator 0:
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 45 (45)
- StreamingTime: 3.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 122.66 KB (125601)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 122.66 KB (125601)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 122.66 KB (125601)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 1.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.39 MB (3552463)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 119.78 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.94 MB (2030592)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 1.32 MB (1385472)
- RowBatchQueuePutWaitTime: 1.000ms
- RowBatchesEnqueued: 81 (81)
- RowsRead: 80.12K (80122)
- RowsReturned: 80.12K (80122)
- RowsReturnedRate: 20.03 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 3.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.418ms
- ScannerThreadsVoluntaryContextSwitches: 37 (37)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 100.003ms, non-child: 100.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 100.003ms
- CodegenSysTime: 1.984ms
- CodegenUserTime: 98.007ms
- CodegenVoluntaryContextSwitches: 1 (1)
- CompileTime: 23.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 58.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 15.000ms
Fragment F00:
Instance ac450713a0b17d3c:9ab7ed8f00000000 (host=hadoop001:22000):(Total: 107.004ms, non-child: 0.000ns, % non-child: 0.00%)
Last report received time: 2025-06-18 05:55:01.578
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/1.06 MB
Fragment Instance Lifecycle Event Timeline: 107.004ms
- Prepare Finished: 1.000ms (1.000ms)
- Open Finished: 101.003ms (100.003ms)
- First Batch Produced: 106.004ms (5.000ms)
- First Batch Sent: 106.004ms (0.000ns)
- ExecInternal Finished: 107.004ms (1.000ms)
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- ExchangeScanRatio: 0.02
- PeakMemoryUsage: 5.47 MB (5733729)
- PeakReservation: 4.00 MB (4194304)
- PeakUsedReservation: 0
- PerHostPeakMemUsage: 7.45 MB (7810948)
- RowsProduced: 45 (45)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 1.000ms
- TotalStorageWaitTime: 1.000ms
- TotalThreadsInvoluntaryContextSwitches: 1 (1)
- TotalThreadsTotalWallClockTime: 109.004ms
- TotalThreadsSysTime: 2.016ms
- TotalThreadsUserTime: 104.045ms
- TotalThreadsVoluntaryContextSwitches: 55 (55)
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 0
- CumulativeAllocations: 0 (0)
- PeakReservation: 0
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 0
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- ReservationLimit: 0
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
Fragment Instance Lifecycle Timings:
- ExecTime: 6.000ms
- ExecTreeExecTime: 5.000ms
- OpenTime: 100.003ms
- ExecTreeOpenTime: 0.000ns
- PrepareTime: 1.000ms
- ExecTreePrepareTime: 1.000ms
KrpcDataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 0.000ns, % non-child: 0.00%)
ExecOption: Hash Partitioned Sender Codegen Enabled
- NetworkThroughput: (Avg: 3.10 MB/sec ; Min: 1.06 MB/sec ; Max: 8.14 MB/sec ; Number of samples: 14)
- EosSent: 1 (1)
- PeakMemoryUsage: 3.88 KB (3968)
- RowsSent: 45 (45)
- RpcFailure: 0 (0)
- RpcRetry: 0 (0)
- SerializeBatchTime: 0.000ns
- TotalBytesSent: 1.86 KB (1906)
- UncompressedRowBatchSize: 2.70 KB (2769)
AGGREGATION_NODE (id=1):(Total: 6.000ms, non-child: 2.000ms, % non-child: 33.33%)
Node Lifecycle Event Timeline: 107.004ms
- Open Started: 101.003ms (101.003ms)
- Open Finished: 101.003ms (0.000ns)
- First Batch Requested: 101.003ms (0.000ns)
- First Batch Returned: 106.004ms (5.000ms)
- Last Batch Returned: 107.004ms (1.000ms)
- Closed: 107.004ms (0.000ns)
- PeakMemoryUsage: 2.07 MB (2165888)
- RowsReturned: 45 (45)
- RowsReturnedRate: 7.50 K/sec
GroupingAggregator 0:
ExecOption: Streaming Preaggregation, Codegen Enabled
- BuildTime: 0.000ns
- GetResultsTime: 0.000ns
- HTResizeTime: 0.000ns
- HashBuckets: 28.67K (28672)
- LargestPartitionPercent: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.03 MB (2132096)
- PeakReservation: 2.00 MB (2097152)
- PeakUsedReservation: 0
- ReductionFactorEstimate: 0.00
- ReductionFactorThresholdToExpand: 0.00
- RowsPassedThrough: 0 (0)
- RowsReturned: 45 (45)
- StreamingTime: 3.000ms
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 1.44 MB (1507328)
- CumulativeAllocations: 23 (23)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 1.44 MB (1507328)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
HDFS_SCAN_NODE (id=0):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/1.06 MB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1
Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0%
File Formats: PARQUET/SNAPPY:1
Node Lifecycle Event Timeline: 106.004ms
- Open Started: 101.003ms (101.003ms)
- Open Finished: 101.003ms (0.000ns)
- First Batch Requested: 101.003ms (0.000ns)
- First Batch Returned: 103.004ms (2.000ms)
- Last Batch Returned: 106.004ms (3.000ms)
- Closed: 106.004ms (0.000ns)
- FooterProcessingTime: (Avg: 0.000ns ; Min: 0.000ns ; Max: 0.000ns ; Number of samples: 1)
- InitialRangeActualReservation: (Avg: 2.00 MB (2097152) ; Min: 2.00 MB (2097152) ; Max: 2.00 MB (2097152) ; Number of samples: 1)
- InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1)
- ParquetCompressedBytesReadPerColumn: (Avg: 22.06 KB (22585) ; Min: 22.06 KB (22585) ; Max: 22.06 KB (22585) ; Number of samples: 1)
- ParquetCompressedPageSize: (Avg: 11.03 KB (11292) ; Min: 3.42 KB (3507) ; Max: 18.63 KB (19078) ; Number of samples: 2)
- ParquetRowGroupActualReservation: (Avg: 2.00 MB (2097152) ; Min: 2.00 MB (2097152) ; Max: 2.00 MB (2097152) ; Number of samples: 1)
- ParquetRowGroupIdealReservation: (Avg: 32.00 KB (32768) ; Min: 32.00 KB (32768) ; Max: 32.00 KB (32768) ; Number of samples: 1)
- ParquetUncompressedBytesReadPerColumn: (Avg: 58.85 KB (60260) ; Min: 58.85 KB (60260) ; Max: 58.85 KB (60260) ; Number of samples: 1)
- ParquetUncompressedPageSize: (Avg: 29.42 KB (30130) ; Min: 7.17 KB (7345) ; Max: 51.67 KB (52915) ; Number of samples: 2)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 0.00
- BytesRead: 122.66 KB (125601)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 122.66 KB (125601)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 122.66 KB (125601)
- CachedFileHandlesHitCount: 2 (2)
- CachedFileHandlesMissCount: 0 (0)
- CollectionItemsRead: 0 (0)
- DataCacheHitBytes: 0
- DataCacheHitCount: 0 (0)
- DataCacheMissBytes: 0
- DataCacheMissCount: 0 (0)
- DataCachePartialHitCount: 0 (0)
- DecompressionTime: 0.000ns
- MaterializeTupleTime(*): 1.000ms
- MaxCompressedTextFileLength: 0
- NumColumns: 1 (1)
- NumDictFilteredRowGroups: 0 (0)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 1 (1)
- NumScannerThreadMemUnavailable: 0 (0)
- NumScannerThreadReservationsDenied: 0 (0)
- NumScannerThreadsStarted: 1 (1)
- NumScannersWithNoReads: 0 (0)
- NumStatsFilteredRowGroups: 0 (0)
- PeakMemoryUsage: 3.39 MB (3552463)
- PeakScannerThreadConcurrency: 1 (1)
- PerReadThreadRawHdfsThroughput: 119.78 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchBytesEnqueued: 1.94 MB (2030592)
- RowBatchQueueGetWaitTime: 1.000ms
- RowBatchQueuePeakMemoryUsage: 1.32 MB (1385472)
- RowBatchQueuePutWaitTime: 1.000ms
- RowBatchesEnqueued: 81 (81)
- RowsRead: 80.12K (80122)
- RowsReturned: 80.12K (80122)
- RowsReturnedRate: 20.03 M/sec
- ScanRangesComplete: 1 (1)
- ScannerIoWaitTime: 1.000ms
- ScannerThreadWorklessLoops: 0 (0)
- ScannerThreadsInvoluntaryContextSwitches: 0 (0)
- ScannerThreadsTotalWallClockTime: 3.000ms
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 1.418ms
- ScannerThreadsVoluntaryContextSwitches: 37 (37)
- TotalRawHdfsOpenFileTime(*): 0.000ns
- TotalRawHdfsReadTime(*): 1.000ms
- TotalReadThroughput: 0.00 /sec
Buffer pool:
- AllocTime: 0.000ns
- CumulativeAllocationBytes: 160.00 KB (163840)
- CumulativeAllocations: 2 (2)
- PeakReservation: 2.00 MB (2097152)
- PeakUnpinnedBytes: 0
- PeakUsedReservation: 128.00 KB (131072)
- ReadIoBytes: 0
- ReadIoOps: 0 (0)
- ReadIoWaitTime: 0.000ns
- SystemAllocTime: 0.000ns
- WriteIoBytes: 0
- WriteIoOps: 0 (0)
- WriteIoWaitTime: 0.000ns
CodeGen:(Total: 100.003ms, non-child: 100.003ms, % non-child: 100.00%)
- CodegenInvoluntaryContextSwitches: 1 (1)
- CodegenTotalWallClockTime: 100.003ms
- CodegenSysTime: 1.984ms
- CodegenUserTime: 98.007ms
- CodegenVoluntaryContextSwitches: 1 (1)
- CompileTime: 23.000ms
- IrGenerationTime: 3.000ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 2.28 MB (2393536)
- NumFunctions: 55 (55)
- NumInstructions: 1.42K (1418)
- OptimizationTime: 58.002ms
- PeakMemoryUsage: 709.00 KB (726016)
- PrepareTime: 15.000ms