3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 527 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Node local: 9; Process local: 41
Shuffle Read Size / Records:
21.3 KiB / 30
Associated Job Ids:
275
DAG Visualization
digraph G { subgraph clusterstage_527 { label="Stage 527"; 1396 [labelType="html" label="SQLExecutionRDD [1396] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 1400 [labelType="html" label="SQLExecutionRDD [1400] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster3687 { label="Exchange"; 1391 [labelType="html" label="ShuffledRowRDD [1391] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3682 { label="WholeStageCodegen (2)"; 1392 [labelType="html" label="MapPartitionsRDD [1392] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3681 { label="DeserializeToObject"; 1393 [labelType="html" label="MapPartitionsRDD [1393] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3680 { label="MapPartitions"; 1394 [labelType="html" label="MapPartitionsRDD [1394] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3677 { label="WholeStageCodegen (3)"; 1395 [labelType="html" label="MapPartitionsRDD [1395] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3688 { label="map"; 1397 [labelType="html" label="Delta Table State #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log [1397] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3690 { label="WholeStageCodegen (1)"; 1398 [labelType="html" label="MapPartitionsRDD [1398] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3689 { label="Project"; 1399 [labelType="html" label="MapPartitionsRDD [1399] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3697 { label="map"; 1401 [labelType="html" label="Delta Table State with Stats #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log [1401] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3698 { label="WholeStageCodegen (1)"; 1402 [labelType="html" label="MapPartitionsRDD [1402] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3702 { label="mapPartitionsInternal"; 1403 [labelType="html" label="MapPartitionsRDD [1403] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 1391->1392; 1392->1393; 1393->1394; 1394->1395; 1395->1396; 1396->1397; 1397->1398; 1398->1399; 1399->1400; 1400->1401; 1401->1402; 1402->1403; }
1390,1391
1397
1401
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time