3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 460 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 25
Associated Job Ids:
238
DAG Visualization
digraph G { subgraph clusterstage_460 { label="Stage 460"; subgraph cluster3192 { label="Exchange"; 1220 [labelType="html" label="ShuffledRowRDD [1220] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3191 { label="InMemoryTableScan"; 1221 [labelType="html" label="MapPartitionsRDD [1221] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 1222 [labelType="html" label="Exchange hashpartitioning(worklistShardItemId#40837L, 25), REPARTITION_BY_NUM, [plan_id=12351]\n+- *(2) HashAggregate(keys=[demandChannel#40840, shardId#40836, kpis#40842, version#40838, qty#40839, worklistShardItemId#40837L, demandStream#40841], functions=[], output=[shardId#40836, worklistShardItemId#40837L, version#40838, qty#40839, demandChannel#40840, demandStream#40841, kpis#40842])\n +- Exchange hashpartitioning(demandChannel#40840, shardId#40836, kpis#40842, version#40838, qty#40839, worklistShardItemId#40837L, demandStream#40841, 25), ENSURE_REQUIREMENTS, [plan_id=12347]\n +- HashAggregate(keys=[demandChannel#40840, shardId#40836, knownfloatingpointnormalized(transform(kpis#40842, lambdafunction(knownfloatingpointnormalized(if (isnull(lambda arg#41483)) null else named_struct(label, lambda arg#41483.label, dateTime, lambda arg#41483.dateTime, value, knownfloatingpointnormalized(normalizenanandzero(lambda arg#41483.value)))), lambda arg#41483, false))) AS kpis#40842, version#40838, knownfloatin... [1222] [Cached] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 1223 [labelType="html" label="MapPartitionsRDD [1223] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 1224 [labelType="html" label="MapPartitionsRDD [1224] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 1225 [labelType="html" label="MapPartitionsRDD [1225] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3188 { label="WholeStageCodegen (1)"; 1226 [labelType="html" label="MapPartitionsRDD [1226] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3187 { label="Exchange"; 1227 [labelType="html" label="MapPartitionsRDD [1227] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } } 1220->1221; 1221->1222; 1222->1223; 1223->1224; 1224->1225; 1225->1226; 1226->1227; }
1219,1220
1222
Event Timeline
Enable zooming
Tasks: 25. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time