3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-qty-opt-service
application UI
Details for Stage 499 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Node local: 25; Process local: 25
Shuffle Read Size / Records:
35.5 KiB / 46
Associated Job Ids:
257
DAG Visualization
digraph G { subgraph clusterstage_499 { label="Stage 499"; 1325 [labelType="html" label="SQLExecutionRDD [1325] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 1329 [labelType="html" label="SQLExecutionRDD [1329] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster3473 { label="Exchange"; 1320 [labelType="html" label="ShuffledRowRDD [1320] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3468 { label="WholeStageCodegen (3)"; 1321 [labelType="html" label="MapPartitionsRDD [1321] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3467 { label="DeserializeToObject"; 1322 [labelType="html" label="MapPartitionsRDD [1322] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3466 { label="MapPartitions"; 1323 [labelType="html" label="MapPartitionsRDD [1323] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3463 { label="WholeStageCodegen (4)"; 1324 [labelType="html" label="MapPartitionsRDD [1324] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3474 { label="map"; 1326 [labelType="html" label="Delta Table State #68 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [1326] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3476 { label="WholeStageCodegen (1)"; 1327 [labelType="html" label="MapPartitionsRDD [1327] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3475 { label="Project"; 1328 [labelType="html" label="MapPartitionsRDD [1328] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3483 { label="map"; 1330 [labelType="html" label="Delta Table State with Stats #68 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log [1330] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3484 { label="WholeStageCodegen (1)"; 1331 [labelType="html" label="MapPartitionsRDD [1331] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster3488 { label="mapPartitionsInternal"; 1332 [labelType="html" label="MapPartitionsRDD [1332] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 1320->1321; 1321->1322; 1322->1323; 1323->1324; 1324->1325; 1325->1326; 1326->1327; 1327->1328; 1328->1329; 1329->1330; 1330->1331; 1331->1332; }
1319,1320
1326
1330
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time