3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 206 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 50
Input Size / Records:
6.4 KiB / 16
Shuffle Write Size / Records:
5.8 KiB / 50
Associated Job Ids:
104
DAG Visualization
digraph G { subgraph clusterstage_206 { label="Stage 206"; 60 [labelType="html" label="SQLExecutionRDD [60] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster155 { label="Exchange"; 55 [labelType="html" label="ShuffledRowRDD [55] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster150 { label="WholeStageCodegen (3)"; 56 [labelType="html" label="MapPartitionsRDD [56] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster149 { label="DeserializeToObject"; 57 [labelType="html" label="MapPartitionsRDD [57] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster148 { label="MapPartitions"; 58 [labelType="html" label="MapPartitionsRDD [58] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster145 { label="WholeStageCodegen (4)"; 59 [labelType="html" label="MapPartitionsRDD [59] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster156 { label="map"; 61 [labelType="html" label="Delta Table State #143 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-sourceofsupply-sourceofsupply/_delta_log [61] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1399 { label="WholeStageCodegen (1)"; 535 [labelType="html" label="MapPartitionsRDD [535] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1398 { label="ObjectHashAggregate"; 536 [labelType="html" label="MapPartitionsRDD [536] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1397 { label="Exchange"; 537 [labelType="html" label="MapPartitionsRDD [537] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 55->56; 56->57; 57->58; 58->59; 59->60; 60->61; 61->535; 535->536; 536->537; }
54,55
61
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time