3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 421 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
42 ms
Locality Level Summary:
Node local: 1
Shuffle Read Size / Records:
7.8 KiB / 52
Shuffle Write Size / Records:
4.7 KiB / 26
Associated Job Ids:
218
DAG Visualization
digraph G { subgraph clusterstage_421 { label="Stage 421"; subgraph cluster2916 { label="AQEShuffleRead"; 1095 [labelType="html" label="ShuffledRowRDD [1095] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster2913 { label="WholeStageCodegen (1)"; 1096 [labelType="html" label="MapPartitionsRDD [1096] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster2921 { label="AQEShuffleRead"; 1097 [labelType="html" label="ShuffledRowRDD [1097] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster2918 { label="WholeStageCodegen (2)"; 1098 [labelType="html" label="MapPartitionsRDD [1098] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster2909 { label="WholeStageCodegen (3)"; 1099 [labelType="html" label="ZippedPartitionsRDD2 [1099] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; 1100 [labelType="html" label="MapPartitionsRDD [1100] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } subgraph cluster2908 { label="Exchange"; 1101 [labelType="html" label="MapPartitionsRDD [1101] [Unordered]<br>save at FileStorageAdapterImpl.java:755"]; } } 1095->1096; 1097->1098; 1096->1099; 1098->1099; 1099->1100; 1100->1101; }
1088,1095
1091,1097
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time