3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 483 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Node local: 2
Output Size / Records:
31.1 KiB / 4
Shuffle Read Size / Records:
2.5 KiB / 16
Associated Job Ids:
248
DAG Visualization
digraph G { subgraph clusterstage_483 { label="Stage 483"; subgraph cluster3320 { label="AQEShuffleRead"; 1270 [labelType="html" label="ShuffledRowRDD [1270] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster3317 { label="WholeStageCodegen (4)"; 1271 [labelType="html" label="MapPartitionsRDD [1271] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster3325 { label="AQEShuffleRead"; 1272 [labelType="html" label="ShuffledRowRDD [1272] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster3322 { label="WholeStageCodegen (5)"; 1273 [labelType="html" label="MapPartitionsRDD [1273] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster3312 { label="WholeStageCodegen (6)"; 1274 [labelType="html" label="ZippedPartitionsRDD2 [1274] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; 1275 [labelType="html" label="MapPartitionsRDD [1275] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster3311 { label="WriteFiles"; 1276 [labelType="html" label="MapPartitionsRDD [1276] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } } 1270->1271; 1272->1273; 1271->1274; 1273->1274; 1274->1275; 1275->1276; }
1269,1270
1262,1272
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time