3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 154 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
92 ms
Locality Level Summary:
Process local: 1
Associated Job Ids:
75
DAG Visualization
digraph G { subgraph clusterstage_154 { label="Stage 154"; 378 [labelType="html" label="SQLExecutionRDD [378] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; 383 [labelType="html" label="SQLExecutionRDD [383] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; subgraph cluster873 { label="Exchange"; 375 [labelType="html" label="ShuffledRowRDD [375] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster870 { label="WholeStageCodegen (2)"; 376 [labelType="html" label="MapPartitionsRDD [376] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster869 { label="DeserializeToObject"; 377 [labelType="html" label="MapPartitionsRDD [377] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster963 { label="mapPartitions"; 379 [labelType="html" label="MapPartitionsRDD [379] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster964 { label="zipWithIndex"; 380 [labelType="html" label="ZippedWithIndexRDD [380] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster969 { label="Scan"; 381 [labelType="html" label="MapPartitionsRDD [381] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster965 { label="WholeStageCodegen (1)"; 382 [labelType="html" label="MapPartitionsRDD [382] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster970 { label="map"; 384 [labelType="html" label="Delta Source Snapshot #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/out/kpi-curve-update/10000000095/stream-10000000095-1/_delta_log [384] [Cached] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster971 { label="WholeStageCodegen (1)"; 385 [labelType="html" label="MapPartitionsRDD [385] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster973 { label="mapPartitionsInternal"; 386 [labelType="html" label="MapPartitionsRDD [386] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } subgraph cluster974 { label="map"; 387 [labelType="html" label="MapPartitionsRDD [387] [Unordered]<br>start at FileStorageAdapterImpl.java:529"]; } } 375->376; 376->377; 377->378; 378->379; 379->380; 380->381; 381->382; 382->383; 383->384; 384->385; 385->386; 386->387; }
374,375
384
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time