3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 42 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Node local: 15; Process local: 35
Shuffle Read Size / Records:
16.2 KiB / 32
Associated Job Ids:
28
DAG Visualization
digraph G { subgraph clusterstage_42 { label="Stage 42"; 156 [labelType="html" label="SQLExecutionRDD [156] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 160 [labelType="html" label="SQLExecutionRDD [160] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster424 { label="Exchange"; 151 [labelType="html" label="ShuffledRowRDD [151] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster419 { label="WholeStageCodegen (3)"; 152 [labelType="html" label="MapPartitionsRDD [152] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster418 { label="DeserializeToObject"; 153 [labelType="html" label="MapPartitionsRDD [153] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster417 { label="MapPartitions"; 154 [labelType="html" label="MapPartitionsRDD [154] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster414 { label="WholeStageCodegen (4)"; 155 [labelType="html" label="MapPartitionsRDD [155] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster425 { label="map"; 157 [labelType="html" label="Delta Table State #28 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile/_delta_log [157] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster427 { label="WholeStageCodegen (1)"; 158 [labelType="html" label="MapPartitionsRDD [158] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster426 { label="Project"; 159 [labelType="html" label="MapPartitionsRDD [159] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster434 { label="map"; 161 [labelType="html" label="Delta Table State with Stats #28 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile/_delta_log [161] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster435 { label="WholeStageCodegen (1)"; 162 [labelType="html" label="MapPartitionsRDD [162] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster439 { label="mapPartitionsInternal"; 163 [labelType="html" label="MapPartitionsRDD [163] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 151->152; 152->153; 153->154; 154->155; 155->156; 156->157; 157->158; 158->159; 159->160; 160->161; 161->162; 162->163; }
150,151
157
161
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time