3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 224 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 ms
Locality Level Summary:
Process local: 50
Input Size / Records:
2.4 KiB / 4
Associated Job Ids:
113
DAG Visualization
digraph G { subgraph clusterstage_224 { label="Stage 224"; 575 [labelType="html" label="SQLExecutionRDD [575] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster1508 { label="Exchange"; 570 [labelType="html" label="ShuffledRowRDD [570] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1503 { label="WholeStageCodegen (3)"; 571 [labelType="html" label="MapPartitionsRDD [571] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1502 { label="DeserializeToObject"; 572 [labelType="html" label="MapPartitionsRDD [572] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1501 { label="MapPartitions"; 573 [labelType="html" label="MapPartitionsRDD [573] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1498 { label="WholeStageCodegen (4)"; 574 [labelType="html" label="MapPartitionsRDD [574] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1509 { label="map"; 576 [labelType="html" label="Delta Table State #28 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/constraint-profile/_delta_log [576] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1541 { label="WholeStageCodegen (1)"; 583 [labelType="html" label="MapPartitionsRDD [583] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1549 { label="mapPartitionsInternal"; 584 [labelType="html" label="MapPartitionsRDD [584] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 570->571; 571->572; 572->573; 573->574; 574->575; 575->576; 576->583; 583->584; }
569,570
576
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time