3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 457 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
21.0 B / 0
Associated Job Ids:
237
DAG Visualization
digraph G { subgraph clusterstage_457 { label="Stage 457"; 1194 [labelType="html" label="SQLExecutionRDD [1194] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 1199 [labelType="html" label="SQLExecutionRDD [1199] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; subgraph cluster3076 { label="Exchange"; 1191 [labelType="html" label="ShuffledRowRDD [1191] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3073 { label="WholeStageCodegen (2)"; 1192 [labelType="html" label="MapPartitionsRDD [1192] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3072 { label="DeserializeToObject"; 1193 [labelType="html" label="MapPartitionsRDD [1193] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3138 { label="mapPartitions"; 1195 [labelType="html" label="MapPartitionsRDD [1195] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3139 { label="zipWithIndex"; 1196 [labelType="html" label="ZippedWithIndexRDD [1196] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3148 { label="Scan"; 1197 [labelType="html" label="MapPartitionsRDD [1197] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3140 { label="WholeStageCodegen (1)"; 1198 [labelType="html" label="MapPartitionsRDD [1198] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3149 { label="map"; 1200 [labelType="html" label="Delta Source Snapshot #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/out/kpi-curve-update/10000000096/stream-10000000096-1/_delta_log [1200] [Cached] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3171 { label="WholeStageCodegen (1)"; 1207 [labelType="html" label="MapPartitionsRDD [1207] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3173 { label="mapPartitionsInternal"; 1208 [labelType="html" label="MapPartitionsRDD [1208] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster3174 { label="map"; 1209 [labelType="html" label="MapPartitionsRDD [1209] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } } 1191->1192; 1192->1193; 1193->1194; 1194->1195; 1195->1196; 1196->1197; 1197->1198; 1198->1199; 1199->1200; 1200->1207; 1207->1208; 1208->1209; }
1190,1191
1200
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time