3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 79 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 25
Input Size / Records:
111.0 KiB / 24
Shuffle Write Size / Records:
107.0 KiB / 1196
Associated Job Ids:
42
DAG Visualization
digraph G { subgraph clusterstage_79 { label="Stage 79"; subgraph cluster526 { label="Exchange"; 188 [labelType="html" label="ShuffledRowRDD [188] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster516 { label="WholeStageCodegen (5)"; 189 [labelType="html" label="MapPartitionsRDD [189] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster527 { label="mapPartitionsInternal"; 190 [labelType="html" label="MapPartitionsRDD [190] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster528 { label="mapPartitionsInternal"; 191 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [supplierGroup#2999, supplier#3000, plant#3001, deliveryDateTime#3002, subrange#3003, productOrderScheduleExploded#3301.product AS product#3315, productOrderScheduleExploded#3301.orderDateTime AS orderDateTime#3316, productOrderScheduleExploded#3301.availabilityDateTime AS availabilityDateTime#3317, productOrderScheduleExploded#3301.nextAvailabilityDateTime AS nextAvailabilityDateTime#3318, productOrderScheduleExploded#3301.mrpController AS mrpController#3319, productOrderScheduleExploded#3301.sourceOfSupplyUuid AS sourceOfSupplyUuid#3320, productOrderScheduleExploded#3301.purchasingOrg AS purchasingOrg#3321, productOrderScheduleExploded#3301.purchasingGroup AS purchasingGroup#3322, xxhash64(CASE WHEN (_extract_supplier#4175 <=> true) THEN supplierOrGroup#3208 END, CASE WHEN (_extract_deliveryDate#4176 <=> true) THEN deliveryDateTime#3002 END, CASE WHEN (_extract_orderDate#4177 <=> true) THEN productOrderScheduleExploded#3301.orderDateTime END, CASE WHEN (_ext... [191] [Cached] [Unordered]<br>count at WorklistShardingImpl.java:107"]; } subgraph cluster597 { label="InMemoryTableScan"; 211 [labelType="html" label="MapPartitionsRDD [211] [Unordered]<br>collectAsList at FileStorageAdapterImpl.java:260"]; 212 [labelType="html" label="MapPartitionsRDD [212] [Unordered]<br>collectAsList at FileStorageAdapterImpl.java:260"]; 213 [labelType="html" label="MapPartitionsRDD [213] [Unordered]<br>collectAsList at FileStorageAdapterImpl.java:260"]; } subgraph cluster595 { label="Exchange"; 214 [labelType="html" label="MapPartitionsRDD [214] [Unordered]<br>collectAsList at FileStorageAdapterImpl.java:260"]; } } 188->189; 189->190; 190->191; 191->211; 211->212; 212->213; 213->214; }
182,188
191
Event Timeline
Enable zooming
Tasks: 25. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time