3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 67 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Process local: 25
Input Size / Records:
111.0 KiB / 24
Shuffle Write Size / Records:
11.5 KiB / 123
Associated Job Ids:
39
DAG Visualization
digraph G { subgraph clusterstage_67 { label="Stage 67"; subgraph cluster526 { label="Exchange"; 188 [labelType="html" label="ShuffledRowRDD [188] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster516 { label="WholeStageCodegen (5)"; 189 [labelType="html" label="MapPartitionsRDD [189] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster527 { label="mapPartitionsInternal"; 190 [labelType="html" label="MapPartitionsRDD [190] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster528 { label="mapPartitionsInternal"; 191 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [supplierGroup#2999, supplier#3000, plant#3001, deliveryDateTime#3002, subrange#3003, productOrderScheduleExploded#3301.product AS product#3315, productOrderScheduleExploded#3301.orderDateTime AS orderDateTime#3316, productOrderScheduleExploded#3301.availabilityDateTime AS availabilityDateTime#3317, productOrderScheduleExploded#3301.nextAvailabilityDateTime AS nextAvailabilityDateTime#3318, productOrderScheduleExploded#3301.mrpController AS mrpController#3319, productOrderScheduleExploded#3301.sourceOfSupplyUuid AS sourceOfSupplyUuid#3320, productOrderScheduleExploded#3301.purchasingOrg AS purchasingOrg#3321, productOrderScheduleExploded#3301.purchasingGroup AS purchasingGroup#3322, xxhash64(CASE WHEN (_extract_supplier#4175 <=> true) THEN supplierOrGroup#3208 END, CASE WHEN (_extract_deliveryDate#4176 <=> true) THEN deliveryDateTime#3002 END, CASE WHEN (_extract_orderDate#4177 <=> true) THEN productOrderScheduleExploded#3301.orderDateTime END, CASE WHEN (_ext... [191] [Cached] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster566 { label="InMemoryTableScan"; 200 [labelType="html" label="MapPartitionsRDD [200] [Unordered]<br>count at WorklistShardingImpl.java:108"]; 201 [labelType="html" label="MapPartitionsRDD [201] [Unordered]<br>count at WorklistShardingImpl.java:108"]; 202 [labelType="html" label="MapPartitionsRDD [202] [Unordered]<br>count at WorklistShardingImpl.java:108"]; } subgraph cluster562 { label="WholeStageCodegen (1)"; 203 [labelType="html" label="MapPartitionsRDD [203] [Unordered]<br>count at WorklistShardingImpl.java:108"]; } subgraph cluster561 { label="Exchange"; 204 [labelType="html" label="MapPartitionsRDD [204] [Unordered]<br>count at WorklistShardingImpl.java:108"]; } } 188->189; 189->190; 190->191; 191->200; 200->201; 201->202; 202->203; 203->204; }
182,188
191
Event Timeline
Enable zooming
Tasks: 25. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time