3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 60 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 25
Input Size / Records:
111.0 KiB / 24
Shuffle Write Size / Records:
1872.0 B / 25
Associated Job Ids:
37
DAG Visualization
digraph G { subgraph clusterstage_60 { label="Stage 60"; subgraph cluster526 { label="Exchange"; 188 [labelType="html" label="ShuffledRowRDD [188] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster516 { label="WholeStageCodegen (5)"; 189 [labelType="html" label="MapPartitionsRDD [189] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster527 { label="mapPartitionsInternal"; 190 [labelType="html" label="MapPartitionsRDD [190] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster528 { label="mapPartitionsInternal"; 191 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [supplierGroup#2999, supplier#3000, plant#3001, deliveryDateTime#3002, subrange#3003, productOrderScheduleExploded#3301.product AS product#3315, productOrderScheduleExploded#3301.orderDateTime AS orderDateTime#3316, productOrderScheduleExploded#3301.availabilityDateTime AS availabilityDateTime#3317, productOrderScheduleExploded#3301.nextAvailabilityDateTime AS nextAvailabilityDateTime#3318, productOrderScheduleExploded#3301.mrpController AS mrpController#3319, productOrderScheduleExploded#3301.sourceOfSupplyUuid AS sourceOfSupplyUuid#3320, productOrderScheduleExploded#3301.purchasingOrg AS purchasingOrg#3321, productOrderScheduleExploded#3301.purchasingGroup AS purchasingGroup#3322, xxhash64(CASE WHEN (_extract_supplier#4175 <=> true) THEN supplierOrGroup#3208 END, CASE WHEN (_extract_deliveryDate#4176 <=> true) THEN deliveryDateTime#3002 END, CASE WHEN (_extract_orderDate#4177 <=> true) THEN productOrderScheduleExploded#3301.orderDateTime END, CASE WHEN (_ext... [191] [Cached] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster534 { label="InMemoryTableScan"; 192 [labelType="html" label="MapPartitionsRDD [192] [Unordered]<br>count at WorklistShardingImpl.java:107"]; 193 [labelType="html" label="MapPartitionsRDD [193] [Unordered]<br>count at WorklistShardingImpl.java:107"]; 194 [labelType="html" label="MapPartitionsRDD [194] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster530 { label="WholeStageCodegen (1)"; 195 [labelType="html" label="MapPartitionsRDD [195] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster529 { label="Exchange"; 196 [labelType="html" label="MapPartitionsRDD [196] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } } 188->189; 189->190; 190->191; 191->192; 192->193; 193->194; 194->195; 195->196; }
182,188
191
Event Timeline
Enable zooming
Tasks: 25. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time