3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 188 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Node local: 25; Process local: 25
Shuffle Read Size / Records:
35.5 KiB / 46
Associated Job Ids:
91
DAG Visualization
digraph G { subgraph clusterstage_188 { label="Stage 188"; 483 [labelType="html" label="SQLExecutionRDD [483] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 487 [labelType="html" label="SQLExecutionRDD [487] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster1238 { label="Exchange"; 478 [labelType="html" label="ShuffledRowRDD [478] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1233 { label="WholeStageCodegen (3)"; 479 [labelType="html" label="MapPartitionsRDD [479] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1232 { label="DeserializeToObject"; 480 [labelType="html" label="MapPartitionsRDD [480] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1231 { label="MapPartitions"; 481 [labelType="html" label="MapPartitionsRDD [481] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1228 { label="WholeStageCodegen (4)"; 482 [labelType="html" label="MapPartitionsRDD [482] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1239 { label="map"; 484 [labelType="html" label="Delta Table State #68 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [484] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1241 { label="WholeStageCodegen (1)"; 485 [labelType="html" label="MapPartitionsRDD [485] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1240 { label="Project"; 486 [labelType="html" label="MapPartitionsRDD [486] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1248 { label="map"; 488 [labelType="html" label="Delta Table State with Stats #68 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [488] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1249 { label="WholeStageCodegen (1)"; 489 [labelType="html" label="MapPartitionsRDD [489] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1253 { label="mapPartitionsInternal"; 490 [labelType="html" label="MapPartitionsRDD [490] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 478->479; 479->480; 480->481; 481->482; 482->483; 483->484; 484->485; 485->486; 486->487; 487->488; 488->489; 489->490; }
477,478
484
488
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time