3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 211 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Process local: 50
Input Size / Records:
6.4 KiB / 16
Associated Job Ids:
106
DAG Visualization
digraph G { subgraph clusterstage_211 { label="Stage 211"; 60 [labelType="html" label="SQLExecutionRDD [60] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster155 { label="Exchange"; 55 [labelType="html" label="ShuffledRowRDD [55] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster150 { label="WholeStageCodegen (3)"; 56 [labelType="html" label="MapPartitionsRDD [56] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster149 { label="DeserializeToObject"; 57 [labelType="html" label="MapPartitionsRDD [57] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster148 { label="MapPartitions"; 58 [labelType="html" label="MapPartitionsRDD [58] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster145 { label="WholeStageCodegen (4)"; 59 [labelType="html" label="MapPartitionsRDD [59] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster156 { label="map"; 61 [labelType="html" label="Delta Table State #143 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-sourceofsupply-sourceofsupply/_delta_log [61] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1414 { label="WholeStageCodegen (1)"; 541 [labelType="html" label="MapPartitionsRDD [541] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1422 { label="mapPartitionsInternal"; 542 [labelType="html" label="MapPartitionsRDD [542] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 55->56; 56->57; 57->58; 58->59; 59->60; 60->61; 61->541; 541->542; }
54,55
61
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time